* Add instructions for using Spectacular AI tools
Adds easy support for new device types: OAK-D, RealSense and
Azure Kinect, as well as an alternative pipeline for iOS.
* Grammar fixes in docs/quickstart/custom_dataset.md (Spectacular AI section)
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
* Fix section label in the Spectacular AI section of custom_dataset.md
* Update custom_dataset.md: typo fix.
"montions" -> "motions"
---------
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
* Add support for Project Aria datasets.
1) An export script for processing Project Aria datasets
2) Add support for Fisheye624 cameras
3) Add support for center-crop masking and sampling
Example commands for running nerfstudio on Project Aria data:
python scripts/datasets/process_project_aria.py --vrs_file=<path_to_vrs> --mps_data_dir=<path to MPS directory> --output_dir=<nerfstudio_data_dir>
ns-train nerfacto --data <nerfstudio_data_dir> nerfstudio-data --orientation-method none
* Clean up type errors
* Fix formatting
* Fix linter errors, import, and use absolute file paths
* Add aria subcommand to ns-process-data
* Appease ruff
* Add Aria to docs
* Fix docs, add back import try/except
* nit: path.as_posix() -> str(path)
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
* Update URLs for readme and image references
Update the image URLs and documentation links due to change in docs url structure. Files edited include readme, documentation, and legacy viewer files.
* Updating url in custom dataset
* nerfbusters dataparser
* nerfbuster dataparser and visualization of eval views
* resolved some errors from pyright
* enable ns-process-data to take two videos as input and use one for eval and the other for train
* resolve some pyright issues
* instead of data being a tuple, I added eval_data as another argument
* implemented train eval split for all cases
* implemented train eval split for all cases
* reverting equi changes
* reverting reality capture changes
* raise valueerror
* revert comment
* added split override code back to dataparser
* reverted one change
* using image border now
* adding docs
---------
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
* Render VR180 video
Adding the VR180 camera model to render VR180 video and images. I condensed the omnidirectional stereo and VR180 render post processing in the render script. I have updated the documentation for VR180 support.
* Condensing formatting of camera types
Condensing the if statement for camera type intrinsics.
Update to omnidirectional stereo rendering (VR 360) to fix slight positional alignment to accurately composite with Blender objects. Modified documentation for ODS and the Blender add-on to include details on Blender camera settings to composite with the Nerfstudio ODS camera model.
Fixed an error in the documentation where the incorrect path notation was used for Windows systems. The documentation had paths denoted with "./", which is incorrect for Windows. This has been corrected to ".\", the appropriate notation for Windows.
This change ensures that Windows users correctly follow the instructions in the documentation without encountering any path-related issues.
* Render Omni-directional stereo (360 3D VR)
Adding the omni-directional stereo camera model to render 3D 360 video and images for VR. This includes the camera models for the left and right eyes and additions to the render script to stack the left and right renders for the final render.
I have also updated the documentation on the custom_dataset page to have information on ODS but let me know if there is a better place to put it.
* Updated ODS camera model and render paths
Updates based on suggested code changes including adding a helper function for ODS and improving path creation.
I also added a part where if a user tries to render a video with an output path that doesn't have an extension it will automatically add .mp4 to the end. Otherwise this usually results in an error when there is no file extension when rendering a video.
* Updated formatting for render and cam path scripts
Updated python formatting for render and camera_paths script
* Adding type checking for ODS function and reformatting camera type code
Added the type checking and doc string for the ODS camera rays function and reformatted the cam_type ray if statements.
* Document how to use equirectangular sensor with metashape
* equirectangular sensor is actually supported by nerfstudio!
* Update custom_dataset.md
* equirectangular: fix COLMAP workflow
* metashape_utils.py: black
---------
Co-authored-by: Frédéric Devernay <f-dy@users.noreply.github.com>
* removed insta360 and also updated equirect images docs to include cropping
* removed unused import
---------
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
* changed percent-crop arg to crop-factor so it's more clear that it's a float
* added error if crop values are less than 0 or more than 1
* added value hint and changed error to console thing
* added imports
* fixed linter issues
* refixed linter issues
* Add the following fixes to documentation:
* Fix trailing backslash in “Use docker image” section
* Replace escaped backslash with double-escaped backslash (see Sphinx issue: https://github.com/sphinx-doc/sphinx/issues/6730)
* Close backtick in `contributing.md`
* Add “run” to instructions for “Render Video”
* Remove unnecessary “,” in “Render Video”
* Correct “before preceding” to “before proceeding”
* Correct “viewpoinrts” to “viewpoints”
* Add missing “.” in “Process data”
* Specify “bash” for code blocks (for consistency with other blocks in the page)
* Fix code block in `viewer_quickstart.rst` (”Copy to clipboard” widget now works)
* Fix some code formatting issues in `export_geometry.md`
* Correct "harmoincs" to "harmonics" in docs.
* Add support for polycam
* Modify blur score
* Support processing zip and add undistort fallback
* Created using Colaboratory
* Update docs
* Update demo.ipynb
* Address comments
* fix lint
* Update custom_dataset.md
Train with the given websocket-port:
```shell
ns-train nerfacto record3d-data --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007
```
Then I get `ns-train: error: unrecognized arguments: --viewer.websocket-port 7007`.
It is recommended to put `record3d-data` at the end of all arguments.
```shell
ns-train nerfacto --data {RECORD3D_CAPTURE_DIR/EXR_RGBD} --viewer.websocket-port 7007 record3d-data
```
* Update custom_dataset.md
Update
```
ns-train nerfacto nerfstudio-data --data {PROCESSED_DATA_DIR}
```
to
```
ns-train nerfacto --data {PROCESSED_DATA_DIR} nerfstudio-data
```
* alex/record3d_docs_add
* alex/record3d_docs_add
* link from dataparsers to custom_dataset added.
* images are now appearing
Co-authored-by: evonneng <evonne_ng@berkeley.edu>
