mirror of
https://github.com/nerfstudio-project/nerfstudio.git
synced 2026-11-12 19:04:03 +08:00
Add documatations for TensoRF (#2209)
* add tensorf intro video * add tensorf images * update images to adapt dark mode * add documentation for TensoRF * grammer check * add some anotations --------- Co-authored-by: Matthew Tancik <matt@lumalabs.ai>
This commit is contained in:
1 parent
365e4c6663
commit
edbe319924
3 files changed
+15
-1
No files matched your search
Binary file not shown.
|
After Width: | Height: | Size: 43 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 273 KiB |
@@ -8,6 +8,10 @@
|
||||
Paper Website
|
||||
```
|
||||
|
||||
<video id="teaser" muted autoplay playsinline loop controls width="100%">
|
||||
<source id="mp4" src="https://apchenstu.github.io/TensoRF/video/train_process.mp4" type="video/mp4">
|
||||
</video>
|
||||
|
||||
### Running Model
|
||||
|
||||
```bash
|
||||
@@ -16,4 +20,14 @@ ns-train tensorf
|
||||
|
||||
## Overview
|
||||
|
||||
🚧 Guide under construction 🚧
|
||||
```{image} imgs/tensorf/models_tensorf_pipeline.png
|
||||
:align: center
|
||||
```
|
||||
|
||||
TensoRF models the radiance field of a scene as a 4D tensor, which represents a 3D voxel grid with per-voxel multi-channel features. TensoRF factorizes the 4D scene tensor into multiple compact low-rank tensor components using CP or VM modes. CP decomposition factorizes tensors into rank-one components with compact vectors. Vector-Matrix (VM) decomposition factorizes tensors into compact vector and matrix factors.
|
||||
|
||||
```{image} imgs/tensorf/models_tensorf_factorization.png
|
||||
:align: center
|
||||
```
|
||||
|
||||
TensoRF with CP(left) and VM(right) decompositions results in a significantly reduced memory footprint compared to previous and concurrent works that directly optimize per-voxel features, such as [Plenoxels](https://alexyu.net/plenoxels/) and [PlenOctrees](https://alexyu.net/plenoctrees/). In experiments, TensoRF with CP decomposition achieves fast reconstruction with improved rendering quality and a smaller model size compared to NeRF. Furthermore, TensoRF with VM decomposition enhances rendering quality even further, while reducing reconstruction time and maintaining a compact model size.
|
||||
Reference in new issue
Block a user