4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
Commit Graph

60 Commits

Author SHA1 Message Date
Jonáš Kulhánek
6368340aa2
Add ns-viewer command to run viewer only with model in eval mode (#1379)
* Add ns-viewer command to run only viewer with model in eval mode

* Remove profiler and logger

* Fix ns-viewer

* ns-viewer remove writer.setup_local_writer

* ns-viewer add writer.setup_local_writer

* ns-viewer: update docs

* Delete outputs
2023-02-09 17:31:16 -08:00
Matthew Tancik
df784e96e7
Colmap docs note (#1380) 2023-02-08 11:23:34 -08:00
Nicolas Zunhammer
9966c43811
[Fix] Docker not supporting older CUDA architectures (#1328)
Fix docker not supporting older CUDA architectures.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-02-01 21:02:10 +01:00
cvachha
9eb880aa91
Blender addon script and documentation (#1218)
* Blender addon script and documentation

First version of blender addon python script located in scripts/blender and new documentation for the addon. The Blender addon is for importing or exporting a camera path for visual effects and compositing.

* Updated formatting of Blender script

Updated the formatting based on the script tests for the blender addon script.

* Updated Blender addon to fix FOV and alignment

Updated how FOV is calculated for both blender cam to json and json to blender cam. The FOV is calculated based on the aspect ratio, angle of view, and sensor fit and size.

* Updated Blender addon documentation with examples

Updated the Blender add-on documentation with a few example gif composite animations

* Updated Blender addon to match frame rate and fixed formatting

Updated the Blender add-on script and docs to match the Blender frame rate. Also the formatting should be fixed. There are also now error message popups instead of console prints for invalid input in the add-on.

* Updated the blender addon for formatting

Updated pylint formatting and comments
2023-01-19 22:31:07 -08:00
Matthew Tancik
ea45c15e01
Update transform.json docs (#1246)
Update transoform.json docs
2023-01-17 10:53:22 -08:00
Mason McGough
92636c3434
Docs fix (#1244)
* Add the following fixes to documentation:

* Fix trailing backslash in “Use docker image” section
* Replace escaped backslash with double-escaped backslash (see Sphinx issue: https://github.com/sphinx-doc/sphinx/issues/6730)
* Close backtick in `contributing.md`
* Add “run” to instructions for “Render Video”
* Remove unnecessary “,” in “Render Video”
* Correct “before preceding” to “before proceeding”
* Correct “viewpoinrts” to “viewpoints”
* Add missing “.” in “Process data”
* Specify “bash” for code blocks (for consistency with other blocks in the page)
* Fix code block in `viewer_quickstart.rst` (”Copy to clipboard” widget now works)
* Fix some code formatting issues in `export_geometry.md`

* Correct "harmoincs" to "harmonics" in docs.
2023-01-17 09:28:20 -08:00
matsuren
408ab709ec
Fix typo (#1231)
* Fix typo COLAMP->COLMAP

* Fix more typo

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-01-16 12:12:55 -08:00
Matthew Tancik
53c23ba356
Add mask conventions to docs (#1234) 2023-01-16 12:00:44 -08:00
Michal Pandy
3da877050d
Depth supervision for Nerfacto (#1173)
* Implement depth supervision

* Fixes

* Change normalize dtype

* refactor

* Change depth weight

* Small refactor

* Change docstring

* Removu unused import

* Add assumption to depth comment

* Implement URF loss

* Remove default depth loss type param

* URF fixes

* Fix depth loss scale

* Visualize gt depths

* Fixes & documentation

* Documentation and formatting

* Fix formatting problems

* Fix linter problems

* Fix tests

* Fix tests
2023-01-02 10:13:38 +01:00
Jake Austin
3ffee522e0
TrainerConfig inherit from InstantiateConfig (#1175)
Making TrainerConfig an InstantiateConfig so it can be swapped in and out with different methods. Also made the TrainerConfig a subclass of ExperimentConfig (which was changed from a printableconfig to an instantiateconfig), since we were already instantiating the Trainer class with the ExperimentConfig

Removed the "config" field from the TrainerCallbackAttributes struct to eliminate circular dependencies when types are checked.

Minor scripts and docs changes to accommodate the update to the config struct, meaning the flags that were associated with the TrainerConfig were moved up to the top level of the config.
2022-12-27 18:19:34 -10:00
Nicolas Zunhammer
4a513825c4
[Fix] point cloud export broken in Dockerfile (#1148)
* Added Dockerfile to build docker image including all dependencies and nerfstudio, added description on how to user docker.

* Move docker description to Installation.md.

* Fix mask_filename indices after splitting train set.

* Rebase DOckerfile to newer image for updated libraries.

* Update docker container documentation.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2022-12-20 09:02:31 -08:00
Matthew Tancik
6f85d7118f
Add docs for KIRI Engine (#1124)
Add docs for KIRI engine
2022-12-13 18:37:31 -08:00
Sandros94
13fca7044c
'get docker' typo (#1089)
Just a typo fix about 'get docker'.
2022-12-05 14:39:56 -08:00
Ethan Weber
1052fccec2
Mesh export (#809)
* start of mesh PR

* point cloud export mvp

* start of mesh PR

* point cloud export mvp

* Save out mesh. Poor quality atm

* reorganized mesh algorithms and specified CLI

* CLI reorg

* tsdf algorithm in progress

* debugging

* tsdf functional but camera distortion params not in

* playing with distortion params

* TSDF works but texture looks bad

* added trimesh

* moved to exporter

* removed files

* saving progress

* save texture image

* seems to work w/o barycentric

* barycentric start

* gap between triangles

* blocking out diagonal

* new barcentric and scaling

* meshing working. need to remove extra rows

* fixed triangle packing

* gitignore changes

* removed package

* fix Literal import

* comments

* update .mtl file

* poisson mesh with model output normals & resolved some PR comments on git

* starting docs. breaking up big function. todo: add xatlas

* xatlas and nvdiffrast working

* triangle_id

* progress on expensive texture coordinates method

* pytorch meshing works

* removing nvdiffrast

* remove trimesh

* cleanup

* few changes

* pred normals by default and add minimum additions to viewer

* fix cli in viewer

* add xatlas as dependency

* make point cloud more dense

* reverted viewer changes

* turn off normals by default

* fix docs

* finished todos on github

* remove xatlas

* xatlas

* black

Co-authored-by: Matt Tancik <tancik@berkeley.edu>
2022-12-02 10:49:19 -08:00
Nicolas Zunhammer
bed7ef94c5
Add Docker support (#1022)
* Added Dockerfile to build docker image including all dependencies and nerfstudio, added description on how to user docker.

* Move docker description to Installation.md.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2022-11-28 12:58:59 -08:00
Jake Austin
1eae0839b4
Updating the script for downloading data (#968)
* Updating the script for downloading data

* Making update to config structure

* Updating documentation and colab

* Adding back the save directory

* Pushing an all flag for nerfstudio

* forgot to save some previous edits
2022-11-25 21:40:13 -08:00
Brent Yi
55db89d0c5
(minor) --trainer.load_dir => --trainer.load-dir in docs (#1010)
`--trainer.load_dir` => `--trainer.load-dir` in docs
2022-11-23 08:51:31 -08:00
Matthew Tancik
a6d5b02446
Add metashape to docs (#1004) 2022-11-22 10:30:12 -08:00
Matthew Tancik
d97b834684
Simplify documentation (#1003) 2022-11-22 09:40:14 -08:00
Matthew Tancik
95a27ecba5
Add support for polycam (#958)
* Add support for polycam

* Modify blur score

* Support processing zip and add undistort fallback

* Created using Colaboratory

* Update docs

* Update demo.ipynb

* Address comments

* fix lint
2022-11-15 17:55:29 -08:00
Matthew Tancik
28b86f8718
Allow specifying colmap path (#917) 2022-11-07 12:11:10 -08:00
Matthew Tancik
761645de05
Minor doc updates (#903) 2022-11-05 22:00:28 -07:00
Ethan Weber
93839ca3f0
Camera and world coordinate conventions (#889)
* documented coordinate conventions without a figure for now

* another sentence

* update frames docs

* explain intrinsics and extrinsics

* more comments

* fix build
2022-11-04 17:18:14 -07:00
Matthew Tancik
e3e766c5ca
Update colab links to use repo colab (#866) 2022-10-31 10:22:25 -07:00
Alexander Kristoffersen
f9fa26accf
New Colab Added to README and Docs (#848)
* readme and doc updated.

* added readme button.
2022-10-29 14:30:03 -07:00
Ethan Weber
6f4fb506e2
Multi-gpu improvements (#799)
* initial commit

* minor changes

* small changes

* ddp seems to be working

* remove commented out code
2022-10-20 01:11:40 -07:00
Matthew Tancik
9bed69601f
Support python 3.7 (#802)
* Support python 3.7

* Update docs
2022-10-18 16:49:27 -07:00
Matthew Tancik
ec901c893d
Add support for insta360 data (#781)
* Add support for insta360 data

* Update docs

* Revert unrelated changes

* remove cropping on normal videos

* Address comments
2022-10-15 22:25:21 -07:00
Yudong Jin
2bf9214fd2
Update custom_dataset.md (#771)
* Update custom_dataset.md

Train with the given websocket-port:

```shell
ns-train nerfacto record3d-data --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007
```

Then I get `ns-train: error: unrecognized arguments: --viewer.websocket-port 7007`.

It is recommended to put `record3d-data` at the end of all arguments.

```shell
ns-train nerfacto --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007 record3d-data
```

* Update custom_dataset.md

Update
```
ns-train nerfacto nerfstudio-data --data {PROCESSED_DATA_DIR}
```
to
```
ns-train nerfacto --data {PROCESSED_DATA_DIR} nerfstudio-data
```
2022-10-15 09:52:49 -07:00
Ethan Weber
d71c05f256
Google Colab support with viewer (#747)
* allows bridge server to run on a different machine

* added script

* update version

* starting docs

* update docs and scripts

* ngrok support

* use tcp

* moving webrtc outside bridge server. wop

* lazy commit

* lazy commit

* running code. webrtc not working

* lazy commit

* better logic for webrtc connection

* cleanup

* todo comment

* working webrtc

* removed logging

* fixing black

* fix eslint

* fix python version

* fix readme

* misc cleanup

* small docs fix

Co-authored-by: Ethan Weber <ethanweber@Ethans-MacBook-Pro.local>
2022-10-14 15:05:28 -07:00
Yudong Jin
d4d19cd32b
Update first_nerf.md (#773)
* Update first_nerf.md

Add an example of resuming training, which is a common usage.

* Update first_nerf.md

Update `load_dir` to make it clearer.
2022-10-13 09:34:08 -07:00
Ethan Weber
9c52d5df19
fix discord link 2022-10-10 17:10:13 -07:00
Ethan Weber
b37eae5bb2
save renders to a folder and bump viewer version (#733)
save data to renders folder. bump viewer
2022-10-07 15:14:18 -07:00
evonneng
ef4d72c78d
add video link to record3d (#731) 2022-10-07 14:04:48 -07:00
Ethan Weber
ee94f23f83
turn on camera opt by default (#727)
* camera opt by default

* fix tests
2022-10-07 11:21:21 -07:00
Alexander Kristoffersen
9afe03eb4c
Pose Opt Doc typo (#726)
small doc typo.
2022-10-07 10:36:20 -07:00
Ethan Weber
cac177717f
Pose optimization (#721)
* pose opt default nerfacto.

* added SO3 cam pose optimization which is slightly faster (~2.2m/iter) than BARF

* integrating record3d

* fix linting errors

* fix save checkpoint logic

* added record3d data

* workaround to avoid flag

* moved dict

* black

* record3d docs

* re-add typing to exp_map.

* Pose optimization refactor

* Fix camera optimizer param group logic

* Update docs + comments

* Update docs, shorten names

* Appease pylint

* repeat -> tile, apply missing name change

* Fix optimizer as scheduler bug

* Fix test

Co-authored-by: akristoffersen <akristoffersen@berkeley.edu>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2022-10-07 10:11:33 -07:00
akanazawa
e307afee0a
Update custom_dataset.md (#723)
instant-gnp to the nerfacto
2022-10-06 22:35:09 -07:00
Alexander Kristoffersen
2aca915d61
Record3D docs added to Custom Data docs (#718)
* alex/record3d_docs_add

* alex/record3d_docs_add

* link from dataparsers to custom_dataset added.

* images are now appearing

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-10-06 14:10:48 -07:00
Brent Yi
05d264a335
Reduced tyro overhead + helptext formatting (#719)
* `ns-train` helptext formatting for tyro 0.3.23

* Remove unused import
2022-10-06 13:33:42 -07:00
Matthew Tancik
4282aa124e
Update colmap install guide (#696) 2022-10-05 13:45:17 -07:00
Ravi Rahman
469e54d9de
Installation Docs Updates (#671)
A few tweaks
2022-10-05 10:26:43 -07:00
evonneng
917d02c695
adding viewer video + other doc related updates (#688) 2022-10-05 02:59:59 -07:00
Jake Austin
a95bb2d611
Pushing more introduction docs (#683)
* Pushing more introduction docs
2022-10-05 01:50:49 -07:00
Jake Austin
a6ad3a40c4
Updating docs for custom data (#672) 2022-10-04 22:01:03 -07:00
Ethan Weber
49b3acd11a
docs update (#669) 2022-10-04 21:26:21 -07:00
Matthew Tancik
6162f9d81f
Tancik/remove valid mask (#655)
* Install updates

* Remove valid mask logic
2022-10-04 13:54:39 -07:00
akanazawa
305e0a9dab
Update custom_dataset.md
minor typo and pointers to our discord
2022-10-04 11:50:18 -07:00
evonneng
3d7abf5a4d
Eng/doc nits (#650)
cleanup install
2022-10-04 10:27:33 -07:00
evonneng
af58b32cc8
restructuring debugging tools doc (#647)
* not done; restrucutre debugging part;

* 1) fixed all developer guides 2) fixed first_nerf error 3) moved run_actions

* removed md
2022-10-04 09:43:11 -07:00