add zipnerf-pytorch as external method (#2850)

* add zipnerf-pytorch as external method
This commit is contained in:
Ling Jing authored and GitHub committed 2024-02-12 22:10:14 +00:00
1 parent ce5adbb7d7
commit 1b4b682bce
4 files changed
+51

No files matched your search

+1
View File
@@ -156,6 +156,7 @@ This documentation is organized into 3 parts:
- [Instruct-GS2GS](nerfology/methods/igs2gs.md): Editing 3DGS Scenes with Instructions
- [PyNeRF](nerfology/methods/pynerf.md): Pyramidal Neural Radiance Fields
- [SeaThru-NeRF](nerfology/methods/seathru_nerf.md): Neural Radiance Field for subsea scenes
- [Zip-NeRF](nerfology/methods/zipnerf.md): Anti-Aliased Grid-Based Neural Radiance Fields
**Eager to contribute a method?** We'd love to see you use nerfstudio in implementing new (or even existing) methods! Please view our {ref}`guide<own_method_docs>` for more details about how to add to this list!
+1
View File
@@ -42,6 +42,7 @@ The following methods are supported in nerfstudio:
Instruct-GS2GS<igs2gs.md>
PyNeRF<pynerf.md>
SeaThru-NeRF<seathru_nerf.md>
Zip-NeRF<zipnerf.md>
```
(own_method_docs)=
+33
View File
@@ -0,0 +1,33 @@
# Zip-NeRF
<h4>A pytorch implementation of "Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields"</h4>
```{button-link} https://jonbarron.info/zipnerf/
:color: primary
:outline:
Paper Website
```
```{button-link} https://github.com/SuLvXiangXin/zipnerf-pytorch
:color: primary
:outline:
Code
```
### Installation
First, install nerfstudio and its dependencies. Then run:
```
pip install git+https://github.com/SuLvXiangXin/zipnerf-pytorch#subdirectory=extensions/cuda
pip install git+https://github.com/SuLvXiangXin/zipnerf-pytorch
```
Finally, install torch_scatter corresponding to your cuda version(https://pytorch-geometric.com/whl/torch-2.0.1%2Bcu118.html).
### Running Model
```bash
ns-train zipnerf --data {DATA_DIR/SCENE}
```
## Overview
Zipnerf combines mip-NeRF 360’s overall framework with iNGP’s featurization approach.
Following mip-NeRF, zipnerf assume each pixel corresponds to a cone. Given an interval along the ray, it construct a set of multisamples that approximate the shape of that conical frustum.
Also, it present an alternative loss that, unlike mip-NeRF 360’s interlevel loss, is continuous and smooth with respect to distance along the ray to prevent z-aliasing.
+16
View File
@@ -192,6 +192,22 @@ To enable Seathru-NeRF, you must install it first by running:
)
)
# Zip-NeRF
external_methods.append(
ExternalMethod(
"""[bold yellow]Zip-NeRF[/bold yellow]
For more information visit https://docs.nerf.studio/nerfology/methods/zipnerf.html
To enable Zip-NeRF, you must install it first by running:
[grey]pip install git+https://github.com/SuLvXiangXin/zipnerf-pytorch#subdirectory=extensions/cuda
and pip install git+https://github.com/SuLvXiangXin/zipnerf-pytorch[/grey]""",
configurations=[
("zipnerf", "A pytorch implementation of 'Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields'")
],
pip_package="pip install git+https://github.com/SuLvXiangXin/zipnerf-pytorch",
)
)
@dataclass
class ExternalMethodDummyTrainerConfig: