Move out NeRFPlayer: clean files and add method link (#2072)

* clean files and add method link

* fix black

* update
This commit is contained in:
LSong authored and GitHub committed 2023-06-14 13:51:09 -07:00
1 parent d18588d5d4
commit 10dab142d0
17 files changed
+67 -2492

No files matched your search

+1
View File
@@ -114,6 +114,7 @@ This documentation is organized into 3 parts:
- [Instruct-NeRF2NeRF](nerfology/methods/in2n.md): Editing 3D Scenes with Instructions
- [K-Planes](nerfology/methods/kplanes.md): Unified 3D and 4D Radiance Fields
- [LERF](nerfology/methods/lerf.md): Language Embedded Radiance Fields
- [NeRFPlayer](nerfology/methods/nerfplayer.md): 4D Radiance Fields by Streaming Feature Channels
- [Tetra-NeRF](nerfology/methods/tetranerf.md): Representing Neural Radiance Fields Using Tetrahedra
**Eager to contribute a method?** We'd love to see you use nerfstudio in implementing new (or even existing) methods! Please view our {ref}`guide<own_method_docs>` for more details about how to add to this list!
+1
View File
@@ -33,6 +33,7 @@ The following methods are supported in nerfstudio:
Mip-NeRF<mipnerf.md>
NeRF<nerf.md>
Nerfacto<nerfacto.md>
NeRFPlayer<nerfplayer.md>
Tetra-NeRF<tetranerf.md>
TensoRF<tensorf.md>
```
+50
View File
@@ -0,0 +1,50 @@
# NeRFPlayer
<h4>A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields</h4>
```{button-link} https://lsongx.github.io/projects/nerfplayer.html
:color: primary
:outline:
Paper Website
```
```{button-link} https://github.com/lsongx/nerfplayer-nerfstudio
:color: primary
:outline:
Nerfstudio add-on code
```
[![NeRFPlayer Video](https://img.youtube.com/vi/flVqSLZWBMI/0.jpg)](https://www.youtube.com/watch?v=flVqSLZWBMI)
## Installation
First install nerfstudio dependencies. Then run:
```bash
pip install git+https://github.com/lsongx/nerfplayer-nerfstudio.git
```
## Running NeRFPlayer
Details for running NeRFPlayer can be found [here](https://github.com/lsongx/nerfplayer-nerfstudio). Once installed, run:
```bash
ns-train nerfplayer-ngp --help
```
Two variants of NeRFPlayer are provided:
| Method | Description |
| --------------------- | ----------------------------------------------- |
| `nerfplayer-nerfacto` | NeRFPlayer with nerfacto backbone |
| `nerfplayer-ngp` | NeRFPlayer with instant-ngp-bounded backbone |
## Method Overview
![method overview](https://lsongx.github.io/projects/images/nerfplayer-framework.png)<br>
First, we propose to decompose the 4D spatiotemporal space according to temporal characteristics. Points in the 4D space are associated with probabilities of belonging to three categories: static, deforming, and new areas. Each area is represented and regularized by a separate neural field. Second, we propose a hybrid representations based feature streaming scheme for efficiently modeling the neural fields.
Please see [TODO lists](https://github.com/lsongx/nerfplayer-nerfstudio#known-todos) to see the unimplemented components in the nerfstudio based version.