tink/nerfstudio
4
0
Fork 0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
Code
4dcbfc55fb
nerfstudio/docs/nerfology/methods/nerfplayer.md
LSong 10dab142d0
Move out NeRFPlayer: clean files and add method link (#2072) 
* clean files and add method link

* fix black

* update
2023-06-14 13:51:09 -07:00

1.8 KiB
Raw Blame History

NeRFPlayer

A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields

:color: primary
:outline:
Paper Website

:color: primary
:outline:
Nerfstudio add-on code

NeRFPlayer Video

Installation

First install nerfstudio dependencies. Then run:

pip install git+https://github.com/lsongx/nerfplayer-nerfstudio.git

Running NeRFPlayer

Details for running NeRFPlayer can be found here. Once installed, run:

ns-train nerfplayer-ngp --help

Two variants of NeRFPlayer are provided:

Method Description
nerfplayer-nerfacto NeRFPlayer with nerfacto backbone
nerfplayer-ngp NeRFPlayer with instant-ngp-bounded backbone

Method Overview

method overview
First, we propose to decompose the 4D spatiotemporal space according to temporal characteristics. Points in the 4D space are associated with probabilities of belonging to three categories: static, deforming, and new areas. Each area is represented and regularized by a separate neural field. Second, we propose a hybrid representations based feature streaming scheme for efficiently modeling the neural fields.

Please see TODO lists to see the unimplemented components in the nerfstudio based version.