4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
Commit Graph

248 Commits

Author SHA1 Message Date
Jake Austin
3ffee522e0
TrainerConfig inherit from InstantiateConfig (#1175)
Making TrainerConfig an InstantiateConfig so it can be swapped in and out with different methods. Also made the TrainerConfig a subclass of ExperimentConfig (which was changed from a printableconfig to an instantiateconfig), since we were already instantiating the Trainer class with the ExperimentConfig

Removed the "config" field from the TrainerCallbackAttributes struct to eliminate circular dependencies when types are checked.

Minor scripts and docs changes to accommodate the update to the config struct, meaning the flags that were associated with the TrainerConfig were moved up to the top level of the config.
2022-12-27 18:19:34 -10:00
Nicolas Zunhammer
4a513825c4
[Fix] point cloud export broken in Dockerfile (#1148)
* Added Dockerfile to build docker image including all dependencies and nerfstudio, added description on how to user docker.

* Move docker description to Installation.md.

* Fix mask_filename indices after splitting train set.

* Rebase DOckerfile to newer image for updated libraries.

* Update docker container documentation.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2022-12-20 09:02:31 -08:00
Martin Piala
09e1008069
Fix Discord link in the docs (#1143)
fix discord link
2022-12-18 10:48:49 -08:00
Matthew Tancik
6f85d7118f
Add docs for KIRI Engine (#1124)
Add docs for KIRI engine
2022-12-13 18:37:31 -08:00
Sandros94
13fca7044c
'get docker' typo (#1089)
Just a typo fix about 'get docker'.
2022-12-05 14:39:56 -08:00
RandomPrototypes
740cdebbb5
WIP : support for hloc toolbox (superpoint, superglue, netvlad,...) (#1026)
* basic support for hloc (includes netvlad, super point, superglue in colmap), just a first test, not ready yet

* add exhaustive match option for hloc

* add command line option to choose the type of feature, matcher,...

* make hloc an optional dependency, update doc, and small bug fixes

* fix missing imports

* fix warnings, pylint,...

* fix overwrite previous commits

* fix import order from isort

* move find_tool_feature_matcher_combination to process_data_utils, add type hints and Args/Returns doc

* error message when no valid combination of sfm tool, feature type, and matcher

Co-authored-by: RandomPrototypes <delmotte_ar@yahoo.fr>
2022-12-03 22:45:48 -08:00
Ethan Weber
1052fccec2
Mesh export (#809)
* start of mesh PR

* point cloud export mvp

* start of mesh PR

* point cloud export mvp

* Save out mesh. Poor quality atm

* reorganized mesh algorithms and specified CLI

* CLI reorg

* tsdf algorithm in progress

* debugging

* tsdf functional but camera distortion params not in

* playing with distortion params

* TSDF works but texture looks bad

* added trimesh

* moved to exporter

* removed files

* saving progress

* save texture image

* seems to work w/o barycentric

* barycentric start

* gap between triangles

* blocking out diagonal

* new barcentric and scaling

* meshing working. need to remove extra rows

* fixed triangle packing

* gitignore changes

* removed package

* fix Literal import

* comments

* update .mtl file

* poisson mesh with model output normals & resolved some PR comments on git

* starting docs. breaking up big function. todo: add xatlas

* xatlas and nvdiffrast working

* triangle_id

* progress on expensive texture coordinates method

* pytorch meshing works

* removing nvdiffrast

* remove trimesh

* cleanup

* few changes

* pred normals by default and add minimum additions to viewer

* fix cli in viewer

* add xatlas as dependency

* make point cloud more dense

* reverted viewer changes

* turn off normals by default

* fix docs

* finished todos on github

* remove xatlas

* xatlas

* black

Co-authored-by: Matt Tancik <tancik@berkeley.edu>
2022-12-02 10:49:19 -08:00
Kevin Chen
87c3ead680
Add Support for Equirectangular Images (#966) 2022-11-28 21:29:02 -08:00
Frédéric Devernay
8fc7950719
Fix benchmarking scripts (#1005)
* launch_eval_blender.sh: fix script

- add shebang
- add -s option to launch a single job per GPU
- last GPU was ignored
- kill all subprocesses when script is terminated

* launch_train_blender.sh: fix script

- add -s option to launch a single job per GPU
- add -v option to use tensorboard instead of wandb
- set nerfacto options according to https://github.com/nerfstudio-project/nerfstudio/issues/806#issuecomment-1284327844
- use a single timestamp for all training jobs
- last GPU was ignored
- kill all subprocesses when script is terminated
- print the eval script command-line

* launch_eval_blender.sh: fix script

* Update benchmarking.md

* launch_train_blender.sh: add -s to eval command-line

* Update launch_train_blender.sh

* Update benchmarking.md
2022-11-28 13:25:14 -08:00
Nicolas Zunhammer
bed7ef94c5
Add Docker support (#1022)
* Added Dockerfile to build docker image including all dependencies and nerfstudio, added description on how to user docker.

* Move docker description to Installation.md.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2022-11-28 12:58:59 -08:00
Jake Austin
1eae0839b4
Updating the script for downloading data (#968)
* Updating the script for downloading data

* Making update to config structure

* Updating documentation and colab

* Adding back the save directory

* Pushing an all flag for nerfstudio

* forgot to save some previous edits
2022-11-25 21:40:13 -08:00
Brent Yi
55db89d0c5
(minor) --trainer.load_dir => --trainer.load-dir in docs (#1010)
`--trainer.load_dir` => `--trainer.load-dir` in docs
2022-11-23 08:51:31 -08:00
Matthew Tancik
a6d5b02446
Add metashape to docs (#1004) 2022-11-22 10:30:12 -08:00
Matthew Tancik
d97b834684
Simplify documentation (#1003) 2022-11-22 09:40:14 -08:00
Matthew Tancik
95a27ecba5
Add support for polycam (#958)
* Add support for polycam

* Modify blur score

* Support processing zip and add undistort fallback

* Created using Colaboratory

* Update docs

* Update demo.ipynb

* Address comments

* fix lint
2022-11-15 17:55:29 -08:00
Matthew Tancik
2656e5653e
Update viewer docs (#950) 2022-11-11 15:17:52 -08:00
Matthew Tancik
0271c7ded8
Update docs (#944) 2022-11-11 08:58:53 -08:00
Matthew Tancik
d4119d4086
Add exporting docs (#940) 2022-11-10 22:01:21 -08:00
Matthew Tancik
28b86f8718
Allow specifying colmap path (#917) 2022-11-07 12:11:10 -08:00
Nail Ibrahimli
a6de0f5f60
fixing typos (#915) 2022-11-07 10:34:15 -08:00
Nikhil Mohan
1a24f3e58c
Refactor Data Pipeline (#896)
* add none check

* black formatting

* cleanup

* cleanup

* fix tests

* remove new line

* init

* toy example working

* semantic nerf working

* simplify pixel samplers

* cleanup + fix tests

* comments

* fix tests

* fix tests
2022-11-06 07:40:43 -08:00
Matthew Tancik
761645de05
Minor doc updates (#903) 2022-11-05 22:00:28 -07:00
Ethan Weber
93839ca3f0
Camera and world coordinate conventions (#889)
* documented coordinate conventions without a figure for now

* another sentence

* update frames docs

* explain intrinsics and extrinsics

* more comments

* fix build
2022-11-04 17:18:14 -07:00
Matthew Tancik
afd6fec6e7
Add docs for nerfacto (#891) 2022-11-03 16:45:00 -07:00
Matthew Tancik
96a7853cd0
Update readme (#869) 2022-10-31 11:53:29 -07:00
Matthew Tancik
e3e766c5ca
Update colab links to use repo colab (#866) 2022-10-31 10:22:25 -07:00
Alexander Kristoffersen
f9fa26accf
New Colab Added to README and Docs (#848)
* readme and doc updated.

* added readme button.
2022-10-29 14:30:03 -07:00
Matthew Tancik
fdddbacc45
v0.1.6 (#820) 2022-10-21 09:53:39 -07:00
Ethan Weber
6f4fb506e2
Multi-gpu improvements (#799)
* initial commit

* minor changes

* small changes

* ddp seems to be working

* remove commented out code
2022-10-20 01:11:40 -07:00
Matthew Tancik
9bed69601f
Support python 3.7 (#802)
* Support python 3.7

* Update docs
2022-10-18 16:49:27 -07:00
Matthew Tancik
0a76360f99
v0.1.5.1 (#796) 2022-10-17 09:21:50 -07:00
Matthew Tancik
646adee9f9
v0.1.5 (#786) 2022-10-16 12:59:39 -07:00
Matthew Tancik
ec901c893d
Add support for insta360 data (#781)
* Add support for insta360 data

* Update docs

* Revert unrelated changes

* remove cropping on normal videos

* Address comments
2022-10-15 22:25:21 -07:00
Yudong Jin
2bf9214fd2
Update custom_dataset.md (#771)
* Update custom_dataset.md

Train with the given websocket-port:

```shell
ns-train nerfacto record3d-data --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007
```

Then I get `ns-train: error: unrecognized arguments: --viewer.websocket-port 7007`.

It is recommended to put `record3d-data` at the end of all arguments.

```shell
ns-train nerfacto --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007 record3d-data
```

* Update custom_dataset.md

Update
```
ns-train nerfacto nerfstudio-data --data {PROCESSED_DATA_DIR}
```
to
```
ns-train nerfacto --data {PROCESSED_DATA_DIR} nerfstudio-data
```
2022-10-15 09:52:49 -07:00
Ethan Weber
d71c05f256
Google Colab support with viewer (#747)
* allows bridge server to run on a different machine

* added script

* update version

* starting docs

* update docs and scripts

* ngrok support

* use tcp

* moving webrtc outside bridge server. wop

* lazy commit

* lazy commit

* running code. webrtc not working

* lazy commit

* better logic for webrtc connection

* cleanup

* todo comment

* working webrtc

* removed logging

* fixing black

* fix eslint

* fix python version

* fix readme

* misc cleanup

* small docs fix

Co-authored-by: Ethan Weber <ethanweber@Ethans-MacBook-Pro.local>
2022-10-14 15:05:28 -07:00
Yudong Jin
d4d19cd32b
Update first_nerf.md (#773)
* Update first_nerf.md

Add an example of resuming training, which is a common usage.

* Update first_nerf.md

Update `load_dir` to make it clearer.
2022-10-13 09:34:08 -07:00
Matthew Tancik
6b7cb70f0d
v0.1.4 (#767) 2022-10-12 18:14:21 -07:00
Ethan Weber
f14fbb9153
Add script filenames to CLI docs (#758)
better docs
2022-10-11 14:26:42 -07:00
Ethan Weber
9c52d5df19
fix discord link 2022-10-10 17:10:13 -07:00
Ethan Weber
8b354a498c
v0.1.3 (#736) 2022-10-07 15:52:13 -07:00
Ethan Weber
b37eae5bb2
save renders to a folder and bump viewer version (#733)
save data to renders folder. bump viewer
2022-10-07 15:14:18 -07:00
evonneng
ef4d72c78d
add video link to record3d (#731) 2022-10-07 14:04:48 -07:00
Ethan Weber
802c4daeaf
v0.1.2 (#728)
bump version
2022-10-07 11:48:46 -07:00
Ethan Weber
ee94f23f83
turn on camera opt by default (#727)
* camera opt by default

* fix tests
2022-10-07 11:21:21 -07:00
Alexander Kristoffersen
9afe03eb4c
Pose Opt Doc typo (#726)
small doc typo.
2022-10-07 10:36:20 -07:00
Ethan Weber
cac177717f
Pose optimization (#721)
* pose opt default nerfacto.

* added SO3 cam pose optimization which is slightly faster (~2.2m/iter) than BARF

* integrating record3d

* fix linting errors

* fix save checkpoint logic

* added record3d data

* workaround to avoid flag

* moved dict

* black

* record3d docs

* re-add typing to exp_map.

* Pose optimization refactor

* Fix camera optimizer param group logic

* Update docs + comments

* Update docs, shorten names

* Appease pylint

* repeat -> tile, apply missing name change

* Fix optimizer as scheduler bug

* Fix test

Co-authored-by: akristoffersen <akristoffersen@berkeley.edu>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2022-10-07 10:11:33 -07:00
akanazawa
e307afee0a
Update custom_dataset.md (#723)
instant-gnp to the nerfacto
2022-10-06 22:35:09 -07:00
Alexander Kristoffersen
2aca915d61
Record3D docs added to Custom Data docs (#718)
* alex/record3d_docs_add

* alex/record3d_docs_add

* link from dataparsers to custom_dataset added.

* images are now appearing

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-10-06 14:10:48 -07:00
Matthew Tancik
5ff9fe9c08
v0.1.1 (#720) 2022-10-06 13:47:33 -07:00
Brent Yi
05d264a335
Reduced tyro overhead + helptext formatting (#719)
* `ns-train` helptext formatting for tyro 0.3.23

* Remove unused import
2022-10-06 13:33:42 -07:00
sean
c2fe9ff1ed
Fix typos in index.md (#708)
A handful of minor corrections :)
2022-10-06 00:14:37 -07:00
Brent Yi
edbfccccfe
Rename: dcargs -> tyro (#702)
Rename `dcargs` to `tyro`
2022-10-05 22:26:06 -07:00
Ethan Weber
ea591246cb
semantic nerfw docs update (#704)
* download dataset docs

* Update semantic_nerfw.md
2022-10-05 17:19:03 -07:00
Matthew Tancik
4282aa124e
Update colmap install guide (#696) 2022-10-05 13:45:17 -07:00
Benji York
739e8dcff3
typo fix (missing space) (#694) 2022-10-05 10:27:12 -07:00
Ravi Rahman
469e54d9de
Installation Docs Updates (#671)
A few tweaks
2022-10-05 10:26:43 -07:00
evonneng
917d02c695
adding viewer video + other doc related updates (#688) 2022-10-05 02:59:59 -07:00
Matthew Tancik
9cc50132c5
Add gifs to docs (#687)
* Add gifs to docs

* Update formating
2022-10-05 02:34:49 -07:00
Matthew Tancik
869dceb374
version 0.1.0 (#686) 2022-10-05 02:15:54 -07:00
Ethan Weber
f189da5bf3
update method commands (#685) 2022-10-05 02:06:26 -07:00
Jake Austin
a95bb2d611
Pushing more introduction docs (#683)
* Pushing more introduction docs
2022-10-05 01:50:49 -07:00
Matthew Tancik
ffa47f34e6
Tancik/update opg (#682)
* Update opengraph

* remove quotes
2022-10-05 00:55:39 -07:00
Matthew Tancik
4b3491468e
Update share cards (#677) 2022-10-04 23:49:20 -07:00
Matthew Tancik
757c7ea7f7
Add attributions (#676) 2022-10-04 22:56:51 -07:00
Matthew Tancik
e01206f728
Update cli docs (#674) 2022-10-04 22:11:02 -07:00
Jake Austin
a6ad3a40c4
Updating docs for custom data (#672) 2022-10-04 22:01:03 -07:00
Ethan Weber
8a98dc79f8
update image for viewer docs (#673)
update viewer docs with image
2022-10-04 21:57:56 -07:00
Ethan Weber
49b3acd11a
docs update (#669) 2022-10-04 21:26:21 -07:00
Matthew Tancik
ce8985aeb6
cli improvements to download script (#668) 2022-10-04 21:00:21 -07:00
Ethan Weber
02ca1c678b
improving the pipeline docs (#665)
* change default websocket port

* docs

* more docs

* docs

* pipeline info
2022-10-04 20:31:19 -07:00
Ethan Weber
cb056f1dfe
remove creating new methods docs (#664) 2022-10-04 17:54:50 -07:00
Matthew Tancik
0b3909918a
Update cli docs (#663) 2022-10-04 17:43:03 -07:00
Matthew Tancik
21f58252c1
remove tensorf model (#660)
* remove tensorf model

* lint
2022-10-04 16:39:47 -07:00
Matthew Tancik
654f070553
Remove mipnerf 360 (#659)
remove mipnerf 360
2022-10-04 16:29:11 -07:00
Matthew Tancik
6162f9d81f
Tancik/remove valid mask (#655)
* Install updates

* Remove valid mask logic
2022-10-04 13:54:39 -07:00
akanazawa
4c14088ba1
Update index.md (#653) 2022-10-04 12:44:42 -07:00
Ethan Weber
0695879673
[docs] model to method naming (#652)
* renamed model to methods

* name change
2022-10-04 11:53:16 -07:00
akanazawa
305e0a9dab
Update custom_dataset.md
minor typo and pointers to our discord
2022-10-04 11:50:18 -07:00
Matthew Tancik
30a927622a
Update doc styles (#651) 2022-10-04 10:57:37 -07:00
evonneng
3d7abf5a4d
Eng/doc nits (#650)
cleanup install
2022-10-04 10:27:33 -07:00
evonneng
af58b32cc8
restructuring debugging tools doc (#647)
* not done; restrucutre debugging part;

* 1) fixed all developer guides 2) fixed first_nerf error 3) moved run_actions

* removed md
2022-10-04 09:43:11 -07:00
Matthew Tancik
4d5a1363b1
Update docs (#649) 2022-10-04 09:23:31 -07:00
evonneng
50b9ee83a1
added config docs (#644)
* added config docs

* fixed first_nerf
2022-10-04 01:02:26 -07:00
Matthew Tancik
62a8896b9f
update pipeline figure docs (#642)
* update pipeline figure docs

* Update figures
2022-10-04 00:05:08 -07:00
Ethan Weber
7ba68dde48
update pipeline docs (#643)
update docs
2022-10-03 23:25:49 -07:00
evonneng
5e56e7b229
update quickstart + readme (#641)
* updated quickstart and readme

* damn ctrl c on macs
2022-10-03 22:38:43 -07:00
evonneng
5c3e1e8bb7
split scripts into 2 eval/render (#637)
* done splitting script

* udpate docs

* woops forgot to add function

* update camera panel command
2022-10-03 22:08:21 -07:00
Ethan Weber
05ba4b6b00
semantic nerfw (#640)
transients not working right now
2022-10-03 20:36:32 -07:00
evonneng
968959bdc9
quickstart updates + (other nits+links added to repo) (#633)
* small changes

* rewrite quickstart + readme

* fixed all licensing headers

* nits
2022-10-03 16:01:16 -07:00
Matthew Tancik
d7c34ca2bd
Reorganize documentation (#631)
restructure_docs
2022-10-03 12:59:46 -07:00
Matthew Tancik
3efd3c3298
dataset_inputs -> dataparser_outputs (#627) 2022-10-03 09:45:36 -07:00
Matt Tancik
ef5384afb3 typo 2022-10-03 09:24:51 -07:00
Ethan Weber
020662d4e4
pipeline documentation (#623)
* added images

* structuring
2022-10-02 23:35:49 -07:00
Matthew Tancik
03b7c44880
Tancik/add GitHub button (#624)
* Add github button to docs

* light icon
2022-10-02 23:14:47 -07:00
Matthew Tancik
37907698f2
update cli docs for process-data (#617)
* update cli docs for process-data

* Update recs

* fix toml
2022-10-02 18:09:57 -07:00
Ethan Weber
c20fed83bb
moving around files (#616)
moved around files
2022-10-02 16:54:34 -07:00
Matthew Tancik
afda888591
tcnn encoding integration (#608)
* tcnn encoding integration

* Add tests, fix lint

* lin
2022-10-02 10:33:43 -07:00
Matthew Tancik
178043e906
Slight logo tweaks (#607) 2022-10-01 21:17:09 -07:00
Matthew Tancik
f7de3a8344
Update notebooks to match refactors (#606) 2022-10-01 21:10:30 -07:00
Matthew Tancik
4110bd7a3e
Rename scene bounds (#605) 2022-10-01 20:41:36 -07:00