4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
nerfstudio/docs/nerfology/methods/tensorf.md
Zhizheng Xiang edbe319924
Add documatations for TensoRF (#2209)
* add tensorf intro video

* add tensorf images

* update images to adapt dark mode

* add documentation for TensoRF

* grammer check

* add some anotations

---------

Co-authored-by: Matthew Tancik <matt@lumalabs.ai>
2023-07-13 22:43:11 +00:00

1.5 KiB

TensoRF

Tensorial Radiance Fields

:color: primary
:outline:
Paper Website

Running Model

ns-train tensorf

Overview

:align: center

TensoRF models the radiance field of a scene as a 4D tensor, which represents a 3D voxel grid with per-voxel multi-channel features. TensoRF factorizes the 4D scene tensor into multiple compact low-rank tensor components using CP or VM modes. CP decomposition factorizes tensors into rank-one components with compact vectors. Vector-Matrix (VM) decomposition factorizes tensors into compact vector and matrix factors.

:align: center

TensoRF with CP(left) and VM(right) decompositions results in a significantly reduced memory footprint compared to previous and concurrent works that directly optimize per-voxel features, such as Plenoxels and PlenOctrees. In experiments, TensoRF with CP decomposition achieves fast reconstruction with improved rendering quality and a smaller model size compared to NeRF. Furthermore, TensoRF with VM decomposition enhances rendering quality even further, while reducing reconstruction time and maintaining a compact model size.