* Fix bug: Improve mask generation script for nuScenes data
* Run black
---------
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
Co-authored-by: Matthew Tancik <mattt4001@gmail.com>
* Copy in `viser` communication infrastructure
* Update background image
* Add build directory to fix viser HTTP server
May want to remove these later
* Copy in `viser` communication infrastructure
* Update background image
* Pass dataset vis using viser
* initial impl of ViewerParameter
* idk what i did but brent and matt know
* Suppress eslint typescript warnings
* implement ViewerElement base class, then ViewerButton, ViewerSlider, etc
* client -> server message setup
* multi folder stuff
* Stream controls over viser
* import
* add types to viewer_param.py
* Move another message to viser
* Update folder color
* Use non throttled messages
* multiple folders works
* Cleanup, more porting
* starting impl of control panel in viser
* More porting
* scenebox to viser
* Cleanup
* Fix render updates
* More cleanup, docs, typing
* start control_panel.py
* set_hidden logic but not merged in
* control_panel replicates behavior of existing control panel (visually), except for setting the list of output options. not yet integrated with viewer_utils.py for logic flow. also implemented set_disabled and set_hidden in javscript/ViewerElement side
* Remove some original leva components
* add some train util logic, attempt set_value, doesn't work on javascript side fully yet (value updates but not slider visually
* bye zmq
* missing call to decoder
* 'gui_set' works properly, control panel now replicates behavior of original
* remove print
* Fix status viewer message
* More cleanup
* support set_options in dropdown
* hiding buttons works correctly
* fix set_options, switch from cur_value to get_value()
* Fix slowdown
* output options
* colormap logic converted
* add handle to cb_hook
* fix some lambda bugs
* cleanup
* Save checkpoint logic readded
* Cleanup and minor fixes
* snappier ui
* Refactoring
* Fix state update bugs
* Bug fixes
* Write less to redux
* added comments to reducer code
* Render state machine (#1727)
* state machine works, but train step throttling not implemented
* more step logic, cleanup
* remove random try catcH
* mutex logic for render
* Update lock logic
* types and docs
* added some state machine logic to help rerenders
* merge
---------
Co-authored-by: Justin <justin.g.kerr@gmail.com>
* Refactor and cleanup
* More cleanup and docs
* docstring to gui_utils
* docstrings, rename viewer_param.py to viewer_elements.py
* Fix viewer, remove bridge stuff
* Render on connect
* Fix lint errors
* More eslint fixes
* render_freq logic
* better rerender logic for crop
* More cleanup
* Purge
* Cleanup
* Lint fixes
* Fix cache
* better parsing logic
* Fix infinite test
* More cleanup
* typo
* Update webdocs
* Update docs
* rerender on custom hooks
* add more docs
* Use shared utilities in `viser.infra`
* rework callback to use elements instead of handles
* Fix ESlint errors
* change naming of handle to element, add setter for value
* cleanup
---------
Co-authored-by: Matt Tancik <mattt4001@gmail.com>
Co-authored-by: Justin <justin.g.kerr@gmail.com>
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
* add neus_facto method
* fix missing pixsfm from video process
* fix dev errors and small typos
---------
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
* add sdf mesh export and texturing
* update bug not allowing use of no monopriors
* resolve comments
* update sdf name to be more generic
* fix silly naming bug
* removed insta360 and also updated equirect images docs to include cropping
* removed unused import
---------
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
* changed percent-crop arg to crop-factor so it's more clear that it's a float
* added error if crop values are less than 0 or more than 1
* added value hint and changed error to console thing
* added imports
* fixed linter issues
* refixed linter issues
* started bottom crop functionality
* first draft of cropping
* cleaned up and debugged cropping equirectangular and re added mask stuff just without percent crop
* added nonequirectangular video crop
* added left right crop for equirectangular
* shortened equirect utils
* finished regular video cropping
* removed print, added underscores, changed type to List[float]
* Extending ns-render to support loop rendering using interpolated cameras.
* Adding docstring for render.py. Applying formating.
* Expanding docstrings for class. Renaming trajectory type.
* Removing mentions of loop from render.py.
* started adding equirectangular to process_data
* was multiplying frame by 255 twice
* added equi2planar configs for the 3 presets
* fixed presets
* setup process data
* changed variable name and comment
* fixed middle preset
* removed third preset
* added progress bar and fixed video for equirectangular input
* fixed whitespace stuff
* added pyequilib dependencey
* Updated for JPG support for equirectangular image input
Updated process_data_utils for JPG support for equirectangular image input, since even though .jpg images worked, .JPG images (output from 360 camera software) were not working.
* changed file type matching
* added equirect utils
* added license header
* added docstring on equirect utils
* added heuristic for image size
* added heuristic for videos
* fixed linty stuff
* shortened code
* raised error if no ims in directory
* Updated ProcessVideo for fixing directories for equirectangular input
Updated the ProcessVideo for equirectangular input to make the image directory have the correct perspective projections. The original equirectangular images are copied into a temp_images folder which also holds the perspective projections. This folder is deleted once the perspective projections are copied into the process data images folder.
---------
Co-authored-by: cvachha <cyrus.vachha@yahoo.com>
Co-authored-by: cvachha <cvachha549@gmail.com>
* Allow black/white background color in Nerfacto
* Use white background in Nerfacto Blender Benchmark
* Fixed unused import
* Updated index for license headers script
* Allow skipping copy+downscale of images in ns-process-data, fix bug when using --skip-colmap on images.bin with non-standard image names
* Rename flags and improve error messages
---------
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
Updated Blender on calculating duration
Updated how the Blender add on calculates duration with frame steps and added the case when frame step size is 0.
* Blender addon script and documentation
First version of blender addon python script located in scripts/blender and new documentation for the addon. The Blender addon is for importing or exporting a camera path for visual effects and compositing.
* Updated formatting of Blender script
Updated the formatting based on the script tests for the blender addon script.
* Updated Blender addon to fix FOV and alignment
Updated how FOV is calculated for both blender cam to json and json to blender cam. The FOV is calculated based on the aspect ratio, angle of view, and sensor fit and size.
* Updated Blender addon documentation with examples
Updated the Blender add-on documentation with a few example gif composite animations
* Updated Blender addon to match frame rate and fixed formatting
Updated the Blender add-on script and docs to match the Blender frame rate. Also the formatting should be fixed. There are also now error message popups instead of console prints for invalid input in the add-on.
* Updated the blender addon for formatting
Updated pylint formatting and comments
* implement the camera exporter
* remove train_dataset from exporter
* fix linter errors
* add docstring
* correct comment
* fix linter errors
* make image_filenames a property of the dataset
Making TrainerConfig an InstantiateConfig so it can be swapped in and out with different methods. Also made the TrainerConfig a subclass of ExperimentConfig (which was changed from a printableconfig to an instantiateconfig), since we were already instantiating the Trainer class with the ExperimentConfig
Removed the "config" field from the TrainerCallbackAttributes struct to eliminate circular dependencies when types are checked.
Minor scripts and docs changes to accommodate the update to the config struct, meaning the flags that were associated with the TrainerConfig were moved up to the top level of the config.
