Otto Seiskari
eba72db22a
Camera pose optimization for Splatfacto ( #2891 )
...
* Add pose optimization to Splatfacto
* Disable Splatfacto pose optimization by default
* Improve apply_to_camera for Gaussian Splatting pose optimization
Do not chain modifications to camera_to_worlds to improve
numerical stability and enable L2 rot/trans penalties.
* Add separate mean and max rot/trans metrics to camera-opt
* Tweak pose optimization hyperparameters
Parameters used in the Gaussian Splatting on the Move paper v1
* Unit test fix for new cameara_optimizer training metrics
* Adjust splatfacto-big camera pose optimization parameters
Same parameters as in normal Splatfacto
---------
Co-authored-by: jh-surh <jh.surh@bucketplace.net>
2024-04-11 14:23:17 -04:00
dberga
2d9bbe5091
fix exporter.py for FullImageDataManager and RandomCamerasDataManager ( #3065 )
...
* fix exporter.py for FullImageDataManager and RandomCamerasDataManager
* sort imports
* ruff
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-11 02:04:33 +00:00
Justin Kerr
c381fc818d
Fix custom elements nested under @property ( #3066 )
...
* patch custom elements bug
* Skip `cached_property`
* fomrat
* comment, type hint
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-10 18:59:20 -07:00
Saurav Maheshkar
d1fc2ee338
feat(ci): migrate to uv in CI ( #3038 )
...
* feat(ci): migrate to `uv` in CI
* feat(ci): drop upgrade strategy
* feat(ci): use `uv` in docs workflow
* fix(ci/doc): update sphinx build cmd
* fix(ci/doc): specify python path
* (experimental) simplify
* remove venv
* Revert line wrap change for doc.yml
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-08 15:46:00 -07:00
Sahil Jain
2b9171528b
Fix config loading for Eyeful Tower dataset ( #3054 )
...
Add test_filenames to transforms.json generated by eyeful_tower.py
2024-04-08 17:04:20 +00:00
Ling Jing
26804f8124
Make colmapDataParser compatible with 360_v2 dataset format ( #2860 )
...
* added an option to colmapdataparser to round up the image size when downscaling
* add round mode and update ffmpeg command
* [fix] wrong variable order
* update format
---------
Co-authored-by: Jing <jing1ling@intel.com>
2024-04-08 12:07:21 -04:00
Jan-Niklas Dihlmann
911091ccb6
Added SIGNeRF to Nerfstudio methods ( #3053 )
...
* feat: signerf as nerfstudio method
* fix: formating issues and indexing
2024-04-08 07:17:56 -07:00
Gina Wu
fba4aa9903
New Google Drive link for poster dataset ( #3045 )
...
Change poster dataset link
2024-04-04 21:36:29 -07:00
Brent Yi
3ac1b6bec7
Only load+undistort splatfacto images when they're used ( #3043 )
...
* Only load splatfacto dataset when it's used
* ruff
* typo fix
* Fix #2817 ; don't undistort for `ns-viewer --viewer.max-num-display-images 0`
* ruff
2024-04-04 23:25:04 +00:00
Chung Min Kim
c572eb7f19
Refactor ScenePointerCallbacks for viser compatibility ( #3036 )
...
* Update to match viser pr
* Bump viser version
* `done` => `removed` in docs
* Update viewer_elements.py
* Fix
* Point function signature overload
* Update viewer_control.md
* type ignore on callback
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-02 23:42:15 -07:00
J.Y
5fbb4b0af8
bump version to 1.0.3 ( #3035 )
2024-04-02 13:42:39 -07:00
Zac Stewart
1b9dfe8bb3
Support COLMAP reconstructions with non-flat image dirs ( #3006 )
...
* Support COLMAP reconstructions with nested image dirs
The code was previously looking for the file.name, which drops all
directory information from the path. Instead, we want to get the file
path relative to the data dir, which will only drop parts of the path
above the data dir, allowing us to recurse into subdirectories within
the images dir
* Adhere to style guidelines
* Add testcase to cover image dirs with subdirs
2024-04-02 14:17:17 -04:00
J.Y
a990721fa8
Fix core tests with Pillow>=10.3.0 ( #3034 )
2024-04-02 09:30:14 -07:00
Maxime Vandegar
59d6acf9da
Exporting Splatfacto: correct errors when there are NaN/Inf values in some attributes ( #3032 )
...
* Apply the mask on the proper axis for removing NaN/Inf values
* Remove unnecessary indexing which raises an error for 1-d arrays
* Update the number of gaussians after removing NaN/Inf values
2024-03-31 13:26:11 -04:00
Otto Seiskari
05ce76db99
Get rid of redundant projection matrix computations in Splatfacto (needs a gsplat update) ( #3019 )
...
Get rid of projection matrix in ProjectGaussians with gsplat >= 0.1.9
2024-03-28 19:03:53 +00:00
Chung Min Kim
71de07163a
Support rectangle selection in viewer ( #3014 )
...
* Support rectangle selection in viewer
* Update doc for click screen_pos
* Raise callback override warning from nerfstudio
* Bump viser version, rect-select only in >0.1.26
2024-03-25 19:48:49 +00:00
MildMystery
0e889f7cb1
Fix bug when trying to create a camera path in viewer ( #3016 )
...
* Directly import interpolate function
2024-03-24 09:44:17 -07:00
J.Y
12195f034f
Fix rotation_matrix for opposite float32 vectors ( #3011 )
...
* Fix rotation_matrix for opposite float32 vectors
* Reformulate rotation_matrix() without division => drop unnecessary `eps`
* Rename `rotation_matrix()` => `rotation_matrix_between()`
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
2024-03-21 23:07:07 -07:00
Mathijs Henquet
d7ceaa13dc
Make ply export property ordering backward compatible (fixes nerfstudio-project/nerfstudio#3004) ( #3005 )
...
* Fixes nerfstudio-project/nerfstudio#3004
---------
Co-authored-by: Mathijs Henquet <mathijs.henquet@nlr.nl>
2024-03-20 12:48:31 -07:00
Matthew Hoffman
712e1827ed
Upgrade to latest nbformat 5.9.2 ( #2964 )
...
open3d 0.18.0 depends on nbformat>=5.7.0
2024-03-18 17:59:30 +00:00
J.Y
8e0c68754b
enable coarse-to-fine training ( #2984 )
2024-03-11 17:50:53 +00:00
Tobias Fischer
946151ac45
Add 'within' function to SceneBox ( #2991 )
...
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
2024-03-11 10:27:36 -07:00
Daewoon Kim
9960de0e84
update Camera models in data processing script ( #2997 )
...
* update colmap camera models
2024-03-11 12:20:25 +02:00
Nicolas Zunhammer
ae6c46cfea
Fix: Masks having wrong dimension after undistortion (causes crash in splatfacto) ( #2987 )
...
* Add third dim to masks after undistortion to fix error in multiplying color images with masks.
* Revert auto format of imports to fix ruff error
---------
Co-authored-by: Nicolas Zunhammer <n.zunhammer@dromni.eu>
2024-03-08 19:18:30 +02:00
trinh31201
6e6cedd438
Handle alpha images properly for instant-ngp and tensorf models ( #2979 )
...
Co-authored-by: Đinh Trinh <dinhtrinh@MacBook-Air-cua-Trinh.local>
2024-03-05 21:00:39 +00:00
Ethan Weber
0555132d40
Fix depth-nerfacto edge cases ( #2939 )
...
* fixes pixel sampling
* reverting indexing change
* adressing PR change
---------
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-03-03 11:10:17 -08:00
Lei Lei
3a4ed804d3
doc: fix code typo in 'NeRF' method doc ( #2978 )
...
In NeRF methods doc, old code component was found. So just fix this small typo issue.
2024-03-01 21:34:28 +00:00
Justin Kerr
da2f833e3b
Refactor splatfacto gaussian params with a ParameterDict ( #2946 )
...
* refactor splatfacto with parameterdict to simplify subclassing, defining new gaussian features
* stray comment
* fix exp_avg key error
* backwards compatibility for checkpoint
* backwards comp fix
---------
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
2024-03-01 10:52:52 +00:00
Anthony Zhang
56d1d19f01
Adding Terminal Window to Jupyter Cells so all Colab users (free and pro) can train with Nerfstudio ( #2870 )
...
* adding terminal window to jupyter cells for free colab users to train and render
* updating torchaudio package dependency
* deleting viewer connection cell, replaced with ns-train's sharable URL viewer link
* fixing flying apostrophe
* fixing pip torch download installation typo
---------
Co-authored-by: Gina Wu <42229107+ginazhouhuiwu@users.noreply.github.com>
2024-03-01 06:47:40 +00:00
AdamRashid96
6df06f264e
add splatfacto-big docs ( #2955 )
...
* add splatfacto-big docs
2024-02-29 12:04:15 -08:00
Jinhwan Choi
55a2688763
fix bug that opacity compentation not being applied to depth raterization ( #2966 )
2024-02-28 19:47:50 +00:00
Brent Yi
8b728d4ec8
Fix progress bar for full images datamanager ( #2969 )
2024-02-28 11:41:03 -08:00
Brent Yi
c491e3e101
Fix Nerfacto + Aria ( #2950 )
2024-02-26 18:16:54 +00:00
Brent Yi
4dcbfc55fb
Show viewer resolution as WxH instead of HxW ( #2948 )
2024-02-23 18:21:02 +00:00
Brent Yi
29ddd2ca3a
Support new MPS filenames for Project Aria point clouds ( #2949 )
...
* Support new point cloud filename for Project Aria point clouds
* Comment details
2024-02-23 03:26:59 +00:00
AdamRashid96
cc0205943a
splatfacto-big ( #2945 )
2024-02-22 14:43:42 -08:00
Justin Kerr
c4b030b816
1.0.2 ( #2943 )
2024-02-22 12:57:56 -08:00
Jinhwan Choi
fee8ab7d13
fix crash when both mask and downscale_factor are set ( #2920 )
...
* fix crash when both mask and downscale_factor are set
2024-02-21 08:52:16 +00:00
Sacha Lewin
a8b3f71eeb
Full implementation of features for dynamic scenes into the Viser viewer. ( #2936 )
...
* Add time buttons & export render_time
* Added preview of dynamic scenes, time interpolation for rendering, etc. (Fixes #2934 )
* Fixes to comply with Ruff
* Fixed UnboundLocalError in static mode
* Formatting
* Fixed pyrights compliance
* Nit remove unused sleep
* Fixed JSON export/import for dynamic camera paths
* Fixed fov override check for loading json camera paths
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-02-21 00:02:05 +00:00
Justin Kerr
36c48c7177
Update project, rasterize with block_width interface ( #2937 )
...
* new interface for block width in gsplat
2024-02-20 22:09:55 +00:00
Pierre-Alain Langlois
59d1097962
Fixed ns_render dataset bug in splatfacto ( #2917 )
...
* Fixed ns_render dataset bug in splatfacto
2024-02-20 09:19:05 -08:00
Sacha Lewin
6c2bfad931
Make time slider effective in viewer ( Fixes #2928 ) ( #2931 )
2024-02-19 14:42:38 -08:00
Piero Toffanin
45db2bcfab
Call rescale_output_resolution before early return ( #2897 )
...
* Call rescale_output_resolution before early return
Co-authored-by: Chung Min Kim <chungmin99@gmail.com>
2024-02-13 23:12:18 +00:00
Justin Kerr
7f9def1ff0
Switch default matching method for videos to 'sequential' in COLMAP ( #2912 )
...
default matching method for video to sequential for COLMAP
2024-02-13 20:26:17 +00:00
J.Y
eb9bcb577d
Implement new rasterization mode using opacity compensation factor ( #2888 )
...
Implement new rasterization mode for tiny gaussians
2024-02-13 11:43:04 -08:00
Sebastiaan
4f798b23f6
Fix an issue where gradient accumulation could not be passed as argument due to a type error. ( #2910 )
2024-02-13 18:09:59 +00:00
Pierre-Alain Langlois
57fbc07bf1
Add transparency carving to splatfacto ( #2889 )
...
Implemented alpha training in splatfacto
2024-02-12 15:31:42 -08:00
Ling Jing
1b4b682bce
add zipnerf-pytorch as external method ( #2850 )
...
* add zipnerf-pytorch as external method
2024-02-12 22:10:14 +00:00
Gunjan Chhablani
ce5adbb7d7
Fix benchmarking script camera optimizer argument ( #2899 )
2024-02-10 16:00:59 -08:00
Tobias Fischer
efa91e5df7
[Fix] convert camera_idx to tensor ( #2890 )
...
convert camera_idx to tensor
2024-02-09 17:53:34 +02:00
