* Render Omni-directional stereo (360 3D VR)
Adding the omni-directional stereo camera model to render 3D 360 video and images for VR. This includes the camera models for the left and right eyes and additions to the render script to stack the left and right renders for the final render.
I have also updated the documentation on the custom_dataset page to have information on ODS but let me know if there is a better place to put it.
* Updated ODS camera model and render paths
Updates based on suggested code changes including adding a helper function for ODS and improving path creation.
I also added a part where if a user tries to render a video with an output path that doesn't have an extension it will automatically add .mp4 to the end. Otherwise this usually results in an error when there is no file extension when rendering a video.
* Updated formatting for render and cam path scripts
Updated python formatting for render and camera_paths script
* Adding type checking for ODS function and reformatting camera type code
Added the type checking and doc string for the ODS camera rays function and reformatted the cam_type ray if statements.
* Increase max_res of first proposal network
* start on ViewerCamera
* crop controls exposed
* lint
* fix viewer crash when invisible element has its value set
* fov, look_at, and camera type
* stuff
* set update interval correctly in cameracontrols, smooth transitions work now
* demo with depth zooming
* depth min
* WIP adding click message
* put the clock back in viewerwindow
* use setlookat when pos and target are defined at the same time
* remove demo from nerfacto
* Add click commands as rays (origin, direction)
* short doc
* Fix double event for doubleclick
* add ViewerClick, cleanup docs
* add docs
* cleanup
* remove scripts
* remove nerfacto changes
* js compile things
* update viewer version
* fix mutable state thing
* docs improvements
* add kwarg value for enableTransition
* fix
* lint
* path in sync-defs
* Misc doc edits requested in pr
* Add click description
* WIP remove redefinition of banner_height, refer to SCSS vars
* add docstring
* radix
* radix
* speed
---------
Co-authored-by: Chung Min Kim <chungmin99@gmail.com>
* knocking out a couple
* Fix more errors
* Add pyright
* Remove some unnecessary cv2 type ignores, warning on missing imports
(for missing tinycudann)
* Minor annotation fixes
* Update docs
* Drop `None` from temporal distortion output
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
* `isort` -> `ruff`
* `pylint` -> `ruff`
* Remove line
* More minor cleanup
* Better documentation for rules we are enabling
* Fix gitignore, run black
* vscode settings
---------
Co-authored-by: Matt Tancik <mattt4001@gmail.com>
* Fix bug related to distributed data parallel training
* fix format by black
* Add nerfacto-big multi-gpu commands
* cleaned up docs
* reverted default dataset to poster
---------
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
* Bump minimum Python version to 3.8
* typing_extensions.Literal -> typing.Literal
* ns-dev-test
* typing_extensions.get_args => typing.get_args
* Format with older version of black
* Bump `black`
* Run black
* Document how to use equirectangular sensor with metashape
* equirectangular sensor is actually supported by nerfstudio!
* Update custom_dataset.md
* equirectangular: fix COLMAP workflow
* metashape_utils.py: black
---------
Co-authored-by: Frédéric Devernay <f-dy@users.noreply.github.com>
* Added Blender tutorial video and documentation on NeRF in NeRF compositing
Updated Blender Add-on documentation to include a video tutorial and added documentation on compositing NeRF objects in NeRF scenes.
* Updating Blender documentation
Removing additional images and resizing images on the documentation.
* Copy in `viser` communication infrastructure
* Update background image
* Add build directory to fix viser HTTP server
May want to remove these later
* Copy in `viser` communication infrastructure
* Update background image
* Pass dataset vis using viser
* initial impl of ViewerParameter
* idk what i did but brent and matt know
* Suppress eslint typescript warnings
* implement ViewerElement base class, then ViewerButton, ViewerSlider, etc
* client -> server message setup
* multi folder stuff
* Stream controls over viser
* import
* add types to viewer_param.py
* Move another message to viser
* Update folder color
* Use non throttled messages
* multiple folders works
* Cleanup, more porting
* starting impl of control panel in viser
* More porting
* scenebox to viser
* Cleanup
* Fix render updates
* More cleanup, docs, typing
* start control_panel.py
* set_hidden logic but not merged in
* control_panel replicates behavior of existing control panel (visually), except for setting the list of output options. not yet integrated with viewer_utils.py for logic flow. also implemented set_disabled and set_hidden in javscript/ViewerElement side
* Remove some original leva components
* add some train util logic, attempt set_value, doesn't work on javascript side fully yet (value updates but not slider visually
* bye zmq
* missing call to decoder
* 'gui_set' works properly, control panel now replicates behavior of original
* remove print
* Fix status viewer message
* More cleanup
* support set_options in dropdown
* hiding buttons works correctly
* fix set_options, switch from cur_value to get_value()
* Fix slowdown
* output options
* colormap logic converted
* add handle to cb_hook
* fix some lambda bugs
* cleanup
* Save checkpoint logic readded
* Cleanup and minor fixes
* snappier ui
* Refactoring
* Fix state update bugs
* Bug fixes
* Write less to redux
* added comments to reducer code
* Render state machine (#1727)
* state machine works, but train step throttling not implemented
* more step logic, cleanup
* remove random try catcH
* mutex logic for render
* Update lock logic
* types and docs
* added some state machine logic to help rerenders
* merge
---------
Co-authored-by: Justin <justin.g.kerr@gmail.com>
* Refactor and cleanup
* More cleanup and docs
* docstring to gui_utils
* docstrings, rename viewer_param.py to viewer_elements.py
* Fix viewer, remove bridge stuff
* Render on connect
* Fix lint errors
* More eslint fixes
* render_freq logic
* better rerender logic for crop
* More cleanup
* Purge
* Cleanup
* Lint fixes
* Fix cache
* better parsing logic
* Fix infinite test
* More cleanup
* typo
* Update webdocs
* Update docs
* rerender on custom hooks
* add more docs
* Use shared utilities in `viser.infra`
* rework callback to use elements instead of handles
* Fix ESlint errors
* change naming of handle to element, add setter for value
* cleanup
---------
Co-authored-by: Matt Tancik <mattt4001@gmail.com>
Co-authored-by: Justin <justin.g.kerr@gmail.com>
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
* removed insta360 and also updated equirect images docs to include cropping
* removed unused import
---------
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
Cyrus Vachha
Ethan Weber
Matthew Tancik
Sophus
Milan van Wouden
Justin KerrandChung Min Kim
Jonáš KulhánekandBrent Yi
Giodiroandgmeanti
J.YandEthan Weber
wuziruiandMatthew Tancik
Ayaan HaqueandRuilong Li
Frédéric DevernayandFrédéric Devernay
Rohan Mathur
LownyCGI
Alex-Zhang