4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
Commit Graph

52 Commits

Author SHA1 Message Date
Michal Pandy
3da877050d
Depth supervision for Nerfacto (#1173)
* Implement depth supervision

* Fixes

* Change normalize dtype

* refactor

* Change depth weight

* Small refactor

* Change docstring

* Removu unused import

* Add assumption to depth comment

* Implement URF loss

* Remove default depth loss type param

* URF fixes

* Fix depth loss scale

* Visualize gt depths

* Fixes & documentation

* Documentation and formatting

* Fix formatting problems

* Fix linter problems

* Fix tests

* Fix tests
2023-01-02 10:13:38 +01:00
Jake Austin
3ffee522e0
TrainerConfig inherit from InstantiateConfig (#1175)
Making TrainerConfig an InstantiateConfig so it can be swapped in and out with different methods. Also made the TrainerConfig a subclass of ExperimentConfig (which was changed from a printableconfig to an instantiateconfig), since we were already instantiating the Trainer class with the ExperimentConfig

Removed the "config" field from the TrainerCallbackAttributes struct to eliminate circular dependencies when types are checked.

Minor scripts and docs changes to accommodate the update to the config struct, meaning the flags that were associated with the TrainerConfig were moved up to the top level of the config.
2022-12-27 18:19:34 -10:00
Nicolas Zunhammer
4a513825c4
[Fix] point cloud export broken in Dockerfile (#1148)
* Added Dockerfile to build docker image including all dependencies and nerfstudio, added description on how to user docker.

* Move docker description to Installation.md.

* Fix mask_filename indices after splitting train set.

* Rebase DOckerfile to newer image for updated libraries.

* Update docker container documentation.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2022-12-20 09:02:31 -08:00
Matthew Tancik
6f85d7118f
Add docs for KIRI Engine (#1124)
Add docs for KIRI engine
2022-12-13 18:37:31 -08:00
Sandros94
13fca7044c
'get docker' typo (#1089)
Just a typo fix about 'get docker'.
2022-12-05 14:39:56 -08:00
Ethan Weber
1052fccec2
Mesh export (#809)
* start of mesh PR

* point cloud export mvp

* start of mesh PR

* point cloud export mvp

* Save out mesh. Poor quality atm

* reorganized mesh algorithms and specified CLI

* CLI reorg

* tsdf algorithm in progress

* debugging

* tsdf functional but camera distortion params not in

* playing with distortion params

* TSDF works but texture looks bad

* added trimesh

* moved to exporter

* removed files

* saving progress

* save texture image

* seems to work w/o barycentric

* barycentric start

* gap between triangles

* blocking out diagonal

* new barcentric and scaling

* meshing working. need to remove extra rows

* fixed triangle packing

* gitignore changes

* removed package

* fix Literal import

* comments

* update .mtl file

* poisson mesh with model output normals & resolved some PR comments on git

* starting docs. breaking up big function. todo: add xatlas

* xatlas and nvdiffrast working

* triangle_id

* progress on expensive texture coordinates method

* pytorch meshing works

* removing nvdiffrast

* remove trimesh

* cleanup

* few changes

* pred normals by default and add minimum additions to viewer

* fix cli in viewer

* add xatlas as dependency

* make point cloud more dense

* reverted viewer changes

* turn off normals by default

* fix docs

* finished todos on github

* remove xatlas

* xatlas

* black

Co-authored-by: Matt Tancik <tancik@berkeley.edu>
2022-12-02 10:49:19 -08:00
Nicolas Zunhammer
bed7ef94c5
Add Docker support (#1022)
* Added Dockerfile to build docker image including all dependencies and nerfstudio, added description on how to user docker.

* Move docker description to Installation.md.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2022-11-28 12:58:59 -08:00
Jake Austin
1eae0839b4
Updating the script for downloading data (#968)
* Updating the script for downloading data

* Making update to config structure

* Updating documentation and colab

* Adding back the save directory

* Pushing an all flag for nerfstudio

* forgot to save some previous edits
2022-11-25 21:40:13 -08:00
Brent Yi
55db89d0c5
(minor) --trainer.load_dir => --trainer.load-dir in docs (#1010)
`--trainer.load_dir` => `--trainer.load-dir` in docs
2022-11-23 08:51:31 -08:00
Matthew Tancik
a6d5b02446
Add metashape to docs (#1004) 2022-11-22 10:30:12 -08:00
Matthew Tancik
d97b834684
Simplify documentation (#1003) 2022-11-22 09:40:14 -08:00
Matthew Tancik
95a27ecba5
Add support for polycam (#958)
* Add support for polycam

* Modify blur score

* Support processing zip and add undistort fallback

* Created using Colaboratory

* Update docs

* Update demo.ipynb

* Address comments

* fix lint
2022-11-15 17:55:29 -08:00
Matthew Tancik
28b86f8718
Allow specifying colmap path (#917) 2022-11-07 12:11:10 -08:00
Matthew Tancik
761645de05
Minor doc updates (#903) 2022-11-05 22:00:28 -07:00
Ethan Weber
93839ca3f0
Camera and world coordinate conventions (#889)
* documented coordinate conventions without a figure for now

* another sentence

* update frames docs

* explain intrinsics and extrinsics

* more comments

* fix build
2022-11-04 17:18:14 -07:00
Matthew Tancik
e3e766c5ca
Update colab links to use repo colab (#866) 2022-10-31 10:22:25 -07:00
Alexander Kristoffersen
f9fa26accf
New Colab Added to README and Docs (#848)
* readme and doc updated.

* added readme button.
2022-10-29 14:30:03 -07:00
Ethan Weber
6f4fb506e2
Multi-gpu improvements (#799)
* initial commit

* minor changes

* small changes

* ddp seems to be working

* remove commented out code
2022-10-20 01:11:40 -07:00
Matthew Tancik
9bed69601f
Support python 3.7 (#802)
* Support python 3.7

* Update docs
2022-10-18 16:49:27 -07:00
Matthew Tancik
ec901c893d
Add support for insta360 data (#781)
* Add support for insta360 data

* Update docs

* Revert unrelated changes

* remove cropping on normal videos

* Address comments
2022-10-15 22:25:21 -07:00
Yudong Jin
2bf9214fd2
Update custom_dataset.md (#771)
* Update custom_dataset.md

Train with the given websocket-port:

```shell
ns-train nerfacto record3d-data --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007
```

Then I get `ns-train: error: unrecognized arguments: --viewer.websocket-port 7007`.

It is recommended to put `record3d-data` at the end of all arguments.

```shell
ns-train nerfacto --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007 record3d-data
```

* Update custom_dataset.md

Update
```
ns-train nerfacto nerfstudio-data --data {PROCESSED_DATA_DIR}
```
to
```
ns-train nerfacto --data {PROCESSED_DATA_DIR} nerfstudio-data
```
2022-10-15 09:52:49 -07:00
Ethan Weber
d71c05f256
Google Colab support with viewer (#747)
* allows bridge server to run on a different machine

* added script

* update version

* starting docs

* update docs and scripts

* ngrok support

* use tcp

* moving webrtc outside bridge server. wop

* lazy commit

* lazy commit

* running code. webrtc not working

* lazy commit

* better logic for webrtc connection

* cleanup

* todo comment

* working webrtc

* removed logging

* fixing black

* fix eslint

* fix python version

* fix readme

* misc cleanup

* small docs fix

Co-authored-by: Ethan Weber <ethanweber@Ethans-MacBook-Pro.local>
2022-10-14 15:05:28 -07:00
Yudong Jin
d4d19cd32b
Update first_nerf.md (#773)
* Update first_nerf.md

Add an example of resuming training, which is a common usage.

* Update first_nerf.md

Update `load_dir` to make it clearer.
2022-10-13 09:34:08 -07:00
Ethan Weber
9c52d5df19
fix discord link 2022-10-10 17:10:13 -07:00
Ethan Weber
b37eae5bb2
save renders to a folder and bump viewer version (#733)
save data to renders folder. bump viewer
2022-10-07 15:14:18 -07:00
evonneng
ef4d72c78d
add video link to record3d (#731) 2022-10-07 14:04:48 -07:00
Ethan Weber
ee94f23f83
turn on camera opt by default (#727)
* camera opt by default

* fix tests
2022-10-07 11:21:21 -07:00
Alexander Kristoffersen
9afe03eb4c
Pose Opt Doc typo (#726)
small doc typo.
2022-10-07 10:36:20 -07:00
Ethan Weber
cac177717f
Pose optimization (#721)
* pose opt default nerfacto.

* added SO3 cam pose optimization which is slightly faster (~2.2m/iter) than BARF

* integrating record3d

* fix linting errors

* fix save checkpoint logic

* added record3d data

* workaround to avoid flag

* moved dict

* black

* record3d docs

* re-add typing to exp_map.

* Pose optimization refactor

* Fix camera optimizer param group logic

* Update docs + comments

* Update docs, shorten names

* Appease pylint

* repeat -> tile, apply missing name change

* Fix optimizer as scheduler bug

* Fix test

Co-authored-by: akristoffersen <akristoffersen@berkeley.edu>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2022-10-07 10:11:33 -07:00
akanazawa
e307afee0a
Update custom_dataset.md (#723)
instant-gnp to the nerfacto
2022-10-06 22:35:09 -07:00
Alexander Kristoffersen
2aca915d61
Record3D docs added to Custom Data docs (#718)
* alex/record3d_docs_add

* alex/record3d_docs_add

* link from dataparsers to custom_dataset added.

* images are now appearing

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-10-06 14:10:48 -07:00
Brent Yi
05d264a335
Reduced tyro overhead + helptext formatting (#719)
* `ns-train` helptext formatting for tyro 0.3.23

* Remove unused import
2022-10-06 13:33:42 -07:00
Matthew Tancik
4282aa124e
Update colmap install guide (#696) 2022-10-05 13:45:17 -07:00
Ravi Rahman
469e54d9de
Installation Docs Updates (#671)
A few tweaks
2022-10-05 10:26:43 -07:00
evonneng
917d02c695
adding viewer video + other doc related updates (#688) 2022-10-05 02:59:59 -07:00
Jake Austin
a95bb2d611
Pushing more introduction docs (#683)
* Pushing more introduction docs
2022-10-05 01:50:49 -07:00
Jake Austin
a6ad3a40c4
Updating docs for custom data (#672) 2022-10-04 22:01:03 -07:00
Ethan Weber
49b3acd11a
docs update (#669) 2022-10-04 21:26:21 -07:00
Matthew Tancik
6162f9d81f
Tancik/remove valid mask (#655)
* Install updates

* Remove valid mask logic
2022-10-04 13:54:39 -07:00
akanazawa
305e0a9dab
Update custom_dataset.md
minor typo and pointers to our discord
2022-10-04 11:50:18 -07:00
evonneng
3d7abf5a4d
Eng/doc nits (#650)
cleanup install
2022-10-04 10:27:33 -07:00
evonneng
af58b32cc8
restructuring debugging tools doc (#647)
* not done; restrucutre debugging part;

* 1) fixed all developer guides 2) fixed first_nerf error 3) moved run_actions

* removed md
2022-10-04 09:43:11 -07:00
Matthew Tancik
4d5a1363b1
Update docs (#649) 2022-10-04 09:23:31 -07:00
evonneng
50b9ee83a1
added config docs (#644)
* added config docs

* fixed first_nerf
2022-10-04 01:02:26 -07:00
evonneng
5e56e7b229
update quickstart + readme (#641)
* updated quickstart and readme

* damn ctrl c on macs
2022-10-03 22:38:43 -07:00
evonneng
5c3e1e8bb7
split scripts into 2 eval/render (#637)
* done splitting script

* udpate docs

* woops forgot to add function

* update camera panel command
2022-10-03 22:08:21 -07:00
evonneng
968959bdc9
quickstart updates + (other nits+links added to repo) (#633)
* small changes

* rewrite quickstart + readme

* fixed all licensing headers

* nits
2022-10-03 16:01:16 -07:00
Matthew Tancik
d7c34ca2bd
Reorganize documentation (#631)
restructure_docs
2022-10-03 12:59:46 -07:00
evonneng
3949739449
Created skeleton structure for documentation (#30)
* added contribution docs

* set up skeleton for readthedocs

* setup skeleton structure for documentation

* added tooling docs

* fixed broken link
2022-06-08 17:27:08 -07:00
Ethan Weber
457788d689
dataloader logic, new folder structure, flatter configs (#26)
* renaming dataloader to data. adding some dataloader classes

* restructuring configs

* fixed instant ngp tcnn direction rescaling

* working through test cases

* black and lint and tests
2022-06-08 09:01:56 -07:00