* Render VR180 video
Adding the VR180 camera model to render VR180 video and images. I condensed the omnidirectional stereo and VR180 render post processing in the render script. I have updated the documentation for VR180 support.
* Condensing formatting of camera types
Condensing the if statement for camera type intrinsics.
* Implement nerfacto alpha transparency training
* Stop adding all ones alpha channel and clean up blend_background
* Make background_color a required argument in blend_background
* Enable alpha transparent training by default
* Improve background_color typing
* Blend uniform background color for metric computation
* Fix typing error
* Clean up typing
* Fix background_color to outputs assignment
* Model outputs returns unblended RGB (black bg) for random bg
* Update renderers
* Fix comments
* Add support for transparent BG for other methods
* Minor refac
* Fix get_background_color
* Fix typing error for blend_background
* Fix comments
* Export utils support transparency
* Pylint fix
* Fix pcd export masking
* Filter pcd view directions based on opacity
* Clean up get_rgba_image
---------
Co-authored-by: Jonas Kulhanek <jonas.kulhanek@live.com>
* Fix arguments that are not passed from config to NerfactoField
* Add comments
* Reset base_res and features_per_level config of nerfacto-big and nerfacto-huge to default to match the original behavior
---------
Co-authored-by: Matthew Tancik <matt@lumalabs.ai>
* Merge video image extraction and downscaling
* Linting
* Fix extracting all frames, only apply vfr when thumnailing
* integrate downscale chains into image processing
* fast polycam upscale/downscale depth
* black
* black
* Update process_data_utils.py
Remove code change from other branch.
* use same suffix for downscale, don't force png
* black
---------
Co-authored-by: Sebastiaan Meijer <seb@stiaan.io>
* Try non-strict model loading on RuntimeError. ...
This allows tcnn models that contained a torch hash_table to load.
In particular, it allows us to load tcnn models prior to PR #2175.
cf. https://github.com/nerfstudio-project/nerfstudio/pull/2175
* Only allow non-strict loading when called with defaults.
* Reflow to avoid code duplication; blacken.
---------
Co-authored-by: Matthew Tancik <matt@lumalabs.ai>
Update to omnidirectional stereo rendering (VR 360) to fix slight positional alignment to accurately composite with Blender objects. Modified documentation for ODS and the Blender add-on to include details on Blender camera settings to composite with the Nerfstudio ODS camera model.
* add `build-arg` cuda version to dockerfile
* [Feature] add 'vis' option to 'ns-viewer' script
* fix pylint
* [Fix] fix data format
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
Co-authored-by: Matthew Tancik <matt@lumalabs.ai>
* fixes div by 1 error
* removes pytorch hash_table if tcnn is used
* formatting
* test fixes
---------
Co-authored-by: Matthew Tancik <matt@lumalabs.ai>
Fixed an error in the documentation where the incorrect path notation was used for Windows systems. The documentation had paths denoted with "./", which is incorrect for Windows. This has been corrected to ".\", the appropriate notation for Windows.
This change ensures that Windows users correctly follow the instructions in the documentation without encountering any path-related issues.
* allow ns-process-data to use CR2 raw images
* Update process_data_utils.py
* black wants an extra newline
---------
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
Ethan Weber
hturki
Frederik Warburg
Cyrus Vachha
hyperzy
Nicholas PfaffandJonas Kulhanek
Khoa Nguyen-Tuanandkhoa
Justin Kerr
Yueh-Cheng Liu 劉岳承andMatthew Tancik
Sebastiaan
Saurav Maheshkar
machenmusikandSebastiaan Meijer
Zhizheng XiangandMatthew Tancik
Jeff CookandMatthew Tancik
Victor Rong
Riley
Paul-Edouard Sarlin
Jan-Niklas Dihlmann
Georg HessandMatthew Tancik
Weibo GaoandWeb
Weihang Li
KaerMorh
Daniel CrispellandBrent Yi
Milan van Wouden
Konstantin Kozlovtsev
Matthew Tancik
olegpokhilchenko
AdamRashid96
Terrance WangandMatthew Tancik