4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
Commit Graph

199 Commits

Author SHA1 Message Date
Michal Pandy
3da877050d
Depth supervision for Nerfacto (#1173)
* Implement depth supervision

* Fixes

* Change normalize dtype

* refactor

* Change depth weight

* Small refactor

* Change docstring

* Removu unused import

* Add assumption to depth comment

* Implement URF loss

* Remove default depth loss type param

* URF fixes

* Fix depth loss scale

* Visualize gt depths

* Fixes & documentation

* Documentation and formatting

* Fix formatting problems

* Fix linter problems

* Fix tests

* Fix tests
2023-01-02 10:13:38 +01:00
Jake Austin
3ffee522e0
TrainerConfig inherit from InstantiateConfig (#1175)
Making TrainerConfig an InstantiateConfig so it can be swapped in and out with different methods. Also made the TrainerConfig a subclass of ExperimentConfig (which was changed from a printableconfig to an instantiateconfig), since we were already instantiating the Trainer class with the ExperimentConfig

Removed the "config" field from the TrainerCallbackAttributes struct to eliminate circular dependencies when types are checked.

Minor scripts and docs changes to accommodate the update to the config struct, meaning the flags that were associated with the TrainerConfig were moved up to the top level of the config.
2022-12-27 18:19:34 -10:00
Nicolas Zunhammer
4a513825c4
[Fix] point cloud export broken in Dockerfile (#1148)
* Added Dockerfile to build docker image including all dependencies and nerfstudio, added description on how to user docker.

* Move docker description to Installation.md.

* Fix mask_filename indices after splitting train set.

* Rebase DOckerfile to newer image for updated libraries.

* Update docker container documentation.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2022-12-20 09:02:31 -08:00
Martin Piala
09e1008069
Fix Discord link in the docs (#1143)
fix discord link
2022-12-18 10:48:49 -08:00
Matthew Tancik
6f85d7118f
Add docs for KIRI Engine (#1124)
Add docs for KIRI engine
2022-12-13 18:37:31 -08:00
Sandros94
13fca7044c
'get docker' typo (#1089)
Just a typo fix about 'get docker'.
2022-12-05 14:39:56 -08:00
RandomPrototypes
740cdebbb5
WIP : support for hloc toolbox (superpoint, superglue, netvlad,...) (#1026)
* basic support for hloc (includes netvlad, super point, superglue in colmap), just a first test, not ready yet

* add exhaustive match option for hloc

* add command line option to choose the type of feature, matcher,...

* make hloc an optional dependency, update doc, and small bug fixes

* fix missing imports

* fix warnings, pylint,...

* fix overwrite previous commits

* fix import order from isort

* move find_tool_feature_matcher_combination to process_data_utils, add type hints and Args/Returns doc

* error message when no valid combination of sfm tool, feature type, and matcher

Co-authored-by: RandomPrototypes <delmotte_ar@yahoo.fr>
2022-12-03 22:45:48 -08:00
Ethan Weber
1052fccec2
Mesh export (#809)
* start of mesh PR

* point cloud export mvp

* start of mesh PR

* point cloud export mvp

* Save out mesh. Poor quality atm

* reorganized mesh algorithms and specified CLI

* CLI reorg

* tsdf algorithm in progress

* debugging

* tsdf functional but camera distortion params not in

* playing with distortion params

* TSDF works but texture looks bad

* added trimesh

* moved to exporter

* removed files

* saving progress

* save texture image

* seems to work w/o barycentric

* barycentric start

* gap between triangles

* blocking out diagonal

* new barcentric and scaling

* meshing working. need to remove extra rows

* fixed triangle packing

* gitignore changes

* removed package

* fix Literal import

* comments

* update .mtl file

* poisson mesh with model output normals & resolved some PR comments on git

* starting docs. breaking up big function. todo: add xatlas

* xatlas and nvdiffrast working

* triangle_id

* progress on expensive texture coordinates method

* pytorch meshing works

* removing nvdiffrast

* remove trimesh

* cleanup

* few changes

* pred normals by default and add minimum additions to viewer

* fix cli in viewer

* add xatlas as dependency

* make point cloud more dense

* reverted viewer changes

* turn off normals by default

* fix docs

* finished todos on github

* remove xatlas

* xatlas

* black

Co-authored-by: Matt Tancik <tancik@berkeley.edu>
2022-12-02 10:49:19 -08:00
Kevin Chen
87c3ead680
Add Support for Equirectangular Images (#966) 2022-11-28 21:29:02 -08:00
Frédéric Devernay
8fc7950719
Fix benchmarking scripts (#1005)
* launch_eval_blender.sh: fix script

- add shebang
- add -s option to launch a single job per GPU
- last GPU was ignored
- kill all subprocesses when script is terminated

* launch_train_blender.sh: fix script

- add -s option to launch a single job per GPU
- add -v option to use tensorboard instead of wandb
- set nerfacto options according to https://github.com/nerfstudio-project/nerfstudio/issues/806#issuecomment-1284327844
- use a single timestamp for all training jobs
- last GPU was ignored
- kill all subprocesses when script is terminated
- print the eval script command-line

* launch_eval_blender.sh: fix script

* Update benchmarking.md

* launch_train_blender.sh: add -s to eval command-line

* Update launch_train_blender.sh

* Update benchmarking.md
2022-11-28 13:25:14 -08:00
Nicolas Zunhammer
bed7ef94c5
Add Docker support (#1022)
* Added Dockerfile to build docker image including all dependencies and nerfstudio, added description on how to user docker.

* Move docker description to Installation.md.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2022-11-28 12:58:59 -08:00
Jake Austin
1eae0839b4
Updating the script for downloading data (#968)
* Updating the script for downloading data

* Making update to config structure

* Updating documentation and colab

* Adding back the save directory

* Pushing an all flag for nerfstudio

* forgot to save some previous edits
2022-11-25 21:40:13 -08:00
Brent Yi
55db89d0c5
(minor) --trainer.load_dir => --trainer.load-dir in docs (#1010)
`--trainer.load_dir` => `--trainer.load-dir` in docs
2022-11-23 08:51:31 -08:00
Matthew Tancik
a6d5b02446
Add metashape to docs (#1004) 2022-11-22 10:30:12 -08:00
Matthew Tancik
d97b834684
Simplify documentation (#1003) 2022-11-22 09:40:14 -08:00
Matthew Tancik
95a27ecba5
Add support for polycam (#958)
* Add support for polycam

* Modify blur score

* Support processing zip and add undistort fallback

* Created using Colaboratory

* Update docs

* Update demo.ipynb

* Address comments

* fix lint
2022-11-15 17:55:29 -08:00
Matthew Tancik
2656e5653e
Update viewer docs (#950) 2022-11-11 15:17:52 -08:00
Matthew Tancik
0271c7ded8
Update docs (#944) 2022-11-11 08:58:53 -08:00
Matthew Tancik
d4119d4086
Add exporting docs (#940) 2022-11-10 22:01:21 -08:00
Matthew Tancik
28b86f8718
Allow specifying colmap path (#917) 2022-11-07 12:11:10 -08:00
Nail Ibrahimli
a6de0f5f60
fixing typos (#915) 2022-11-07 10:34:15 -08:00
Nikhil Mohan
1a24f3e58c
Refactor Data Pipeline (#896)
* add none check

* black formatting

* cleanup

* cleanup

* fix tests

* remove new line

* init

* toy example working

* semantic nerf working

* simplify pixel samplers

* cleanup + fix tests

* comments

* fix tests

* fix tests
2022-11-06 07:40:43 -08:00
Matthew Tancik
761645de05
Minor doc updates (#903) 2022-11-05 22:00:28 -07:00
Ethan Weber
93839ca3f0
Camera and world coordinate conventions (#889)
* documented coordinate conventions without a figure for now

* another sentence

* update frames docs

* explain intrinsics and extrinsics

* more comments

* fix build
2022-11-04 17:18:14 -07:00
Matthew Tancik
afd6fec6e7
Add docs for nerfacto (#891) 2022-11-03 16:45:00 -07:00
Matthew Tancik
96a7853cd0
Update readme (#869) 2022-10-31 11:53:29 -07:00
Matthew Tancik
e3e766c5ca
Update colab links to use repo colab (#866) 2022-10-31 10:22:25 -07:00
Alexander Kristoffersen
f9fa26accf
New Colab Added to README and Docs (#848)
* readme and doc updated.

* added readme button.
2022-10-29 14:30:03 -07:00
Matthew Tancik
fdddbacc45
v0.1.6 (#820) 2022-10-21 09:53:39 -07:00
Ethan Weber
6f4fb506e2
Multi-gpu improvements (#799)
* initial commit

* minor changes

* small changes

* ddp seems to be working

* remove commented out code
2022-10-20 01:11:40 -07:00
Matthew Tancik
9bed69601f
Support python 3.7 (#802)
* Support python 3.7

* Update docs
2022-10-18 16:49:27 -07:00
Matthew Tancik
0a76360f99
v0.1.5.1 (#796) 2022-10-17 09:21:50 -07:00
Matthew Tancik
646adee9f9
v0.1.5 (#786) 2022-10-16 12:59:39 -07:00
Matthew Tancik
ec901c893d
Add support for insta360 data (#781)
* Add support for insta360 data

* Update docs

* Revert unrelated changes

* remove cropping on normal videos

* Address comments
2022-10-15 22:25:21 -07:00
Yudong Jin
2bf9214fd2
Update custom_dataset.md (#771)
* Update custom_dataset.md

Train with the given websocket-port:

```shell
ns-train nerfacto record3d-data --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007
```

Then I get `ns-train: error: unrecognized arguments: --viewer.websocket-port 7007`.

It is recommended to put `record3d-data` at the end of all arguments.

```shell
ns-train nerfacto --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007 record3d-data
```

* Update custom_dataset.md

Update
```
ns-train nerfacto nerfstudio-data --data {PROCESSED_DATA_DIR}
```
to
```
ns-train nerfacto --data {PROCESSED_DATA_DIR} nerfstudio-data
```
2022-10-15 09:52:49 -07:00
Ethan Weber
d71c05f256
Google Colab support with viewer (#747)
* allows bridge server to run on a different machine

* added script

* update version

* starting docs

* update docs and scripts

* ngrok support

* use tcp

* moving webrtc outside bridge server. wop

* lazy commit

* lazy commit

* running code. webrtc not working

* lazy commit

* better logic for webrtc connection

* cleanup

* todo comment

* working webrtc

* removed logging

* fixing black

* fix eslint

* fix python version

* fix readme

* misc cleanup

* small docs fix

Co-authored-by: Ethan Weber <ethanweber@Ethans-MacBook-Pro.local>
2022-10-14 15:05:28 -07:00
Yudong Jin
d4d19cd32b
Update first_nerf.md (#773)
* Update first_nerf.md

Add an example of resuming training, which is a common usage.

* Update first_nerf.md

Update `load_dir` to make it clearer.
2022-10-13 09:34:08 -07:00
Matthew Tancik
6b7cb70f0d
v0.1.4 (#767) 2022-10-12 18:14:21 -07:00
Ethan Weber
f14fbb9153
Add script filenames to CLI docs (#758)
better docs
2022-10-11 14:26:42 -07:00
Ethan Weber
9c52d5df19
fix discord link 2022-10-10 17:10:13 -07:00
Ethan Weber
8b354a498c
v0.1.3 (#736) 2022-10-07 15:52:13 -07:00
Ethan Weber
b37eae5bb2
save renders to a folder and bump viewer version (#733)
save data to renders folder. bump viewer
2022-10-07 15:14:18 -07:00
evonneng
ef4d72c78d
add video link to record3d (#731) 2022-10-07 14:04:48 -07:00
Ethan Weber
802c4daeaf
v0.1.2 (#728)
bump version
2022-10-07 11:48:46 -07:00
Ethan Weber
ee94f23f83
turn on camera opt by default (#727)
* camera opt by default

* fix tests
2022-10-07 11:21:21 -07:00
Alexander Kristoffersen
9afe03eb4c
Pose Opt Doc typo (#726)
small doc typo.
2022-10-07 10:36:20 -07:00
Ethan Weber
cac177717f
Pose optimization (#721)
* pose opt default nerfacto.

* added SO3 cam pose optimization which is slightly faster (~2.2m/iter) than BARF

* integrating record3d

* fix linting errors

* fix save checkpoint logic

* added record3d data

* workaround to avoid flag

* moved dict

* black

* record3d docs

* re-add typing to exp_map.

* Pose optimization refactor

* Fix camera optimizer param group logic

* Update docs + comments

* Update docs, shorten names

* Appease pylint

* repeat -> tile, apply missing name change

* Fix optimizer as scheduler bug

* Fix test

Co-authored-by: akristoffersen <akristoffersen@berkeley.edu>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2022-10-07 10:11:33 -07:00
akanazawa
e307afee0a
Update custom_dataset.md (#723)
instant-gnp to the nerfacto
2022-10-06 22:35:09 -07:00
Alexander Kristoffersen
2aca915d61
Record3D docs added to Custom Data docs (#718)
* alex/record3d_docs_add

* alex/record3d_docs_add

* link from dataparsers to custom_dataset added.

* images are now appearing

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-10-06 14:10:48 -07:00
Matthew Tancik
5ff9fe9c08
v0.1.1 (#720) 2022-10-06 13:47:33 -07:00