Commit Graph
1926 Commits
Author SHA1 Message Date
b190874ef1 Use AbsGrad to get better results with less gaussians (#3113)
* Use AbsGrad to get better results with less gaussians

* some adjustment such that splatfacto-big don't go OOM

* use new gsplat version

---------

Co-authored-by: Jianbo Ye <jianboye@amazon.com>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-04-29 16:32:48 -04:00
Mathijs Henquet bc9328c7ff GaussianSplats export: allow uint8 in ply (#3111)
* GaussianSplats export: allow uint8 in ply

* Ruff formatting

* Add test and narrower typing

* Formatting

* Revert narrow typing, not supported by old python

* Fix typing for old pythons
2024-04-29 14:30:25 -04:00
Rohan MathurandJustin Kerr f046ceadf6 Adding cropping for gaussian splat exports (#3105)
* added bounding box to splat export params

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-04-29 17:05:49 +00:00
Satvik SharmaandJustin Kerr 3f39546653 Adding lock for Viser Element callbacks (#3067)
* add callback lock, prepare for testing

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-04-25 23:35:24 -07:00
dbergaandJianbo Ye db93476b6a Hloc fix for image_ids (camera per image) (#3081)
* changed run_hloc args to fill image_ids (added image_list and changed camera_mode to PER_IMAGE)

* added parameter same_camera on ns-process-data for multifocal cases in hloc. Also updated colmap_to_json to detect if there is one or several cameras per frame while keeping the camera type specifications

* ruff-formatted changes in colmap_utils.py

* use_single_camera_mode update args, including colmap_utils and hloc_utils

* changed multicamera warning's print to CONSOLE.print

* fix path typo console print

* rewritten use-single-camera-mode comment in ns-process-data

* (fix) inverted bool for colmap_utils

* change im_id to im_data.camera_id

---------

Co-authored-by: Jianbo Ye <jianboye@amazon.com>
2024-04-24 12:43:45 -04:00
J.YandJustin Kerr d9b022b25f Allow alpha transparency training for blender datasets input (#3088)
Allow alpha transparency training for rgba input

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-04-19 18:03:55 +00:00
Congrong XuandBrent Yi eddf2d21b5 Changes for trainer.py to support the Gradio webui (#3046)
* changes for trainer to support webui

* Update trainer to support webui

* format

* add a seperated shutdown() function to stop training

* typo fix

* get rid of _stop_viewer_server()

* Update trainer.py

* organize import

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-19 00:37:50 +00:00
Justin Kerr 45d8bb79ea updates to apply_pca_colormap (#3086)
* improvements to pca_colormap: allow input pca matrix, optional ignore_zeros arg

* typo
2024-04-17 23:54:43 -07:00
Patrick Morgan babf57718c Fix call to detect ODM reconstruction file (#3018) 2024-04-12 21:23:47 +00:00
Justin Kerr a64026f8db shift principle points by .5 in undistortion (#3071)
* shift principle points by .5

* fix ordering

* add fisheye offset
2024-04-12 15:32:22 -04:00
Gunjan ChhablaniandBrent Yi c302cc5301 Add pointcloud loading for blender parser (#2902)
* Add pointcloud loading for blender parser

* Fix argument

* Fix docstring

* Fix metadata in dataparsers

* Add changes from review

* Avoid changing default behavior

* Apply `scale_factor` to loaded points

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-11 13:41:14 -07:00
hyperzy 03bdeff2ad Fixed Unexpectedly huge RAM consumption of parallel datamanager (#3060)
* Reduced the memory usage by caching image after the datamanager process starts
2024-04-11 18:56:37 +00:00
J.Y 4714ae75f7 write eval combined images for diagnostics (#3070) 2024-04-11 18:37:02 +00:00
Otto Seiskariandjh-surh eba72db22a Camera pose optimization for Splatfacto (#2891)
* Add pose optimization to Splatfacto

* Disable Splatfacto pose optimization by default

* Improve apply_to_camera for Gaussian Splatting pose optimization

Do not chain modifications to camera_to_worlds to improve
numerical stability and enable L2 rot/trans penalties.

* Add separate mean and max rot/trans metrics to camera-opt

* Tweak pose optimization hyperparameters

Parameters used in the Gaussian Splatting on the Move paper v1

* Unit test fix for new cameara_optimizer training metrics

* Adjust splatfacto-big camera pose optimization parameters

Same parameters as in normal Splatfacto

---------

Co-authored-by: jh-surh <jh.surh@bucketplace.net>
2024-04-11 14:23:17 -04:00
dbergaandBrent Yi 2d9bbe5091 fix exporter.py for FullImageDataManager and RandomCamerasDataManager (#3065)
* fix exporter.py for FullImageDataManager and RandomCamerasDataManager

* sort imports

* ruff

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-11 02:04:33 +00:00
Justin KerrandBrent Yi c381fc818d Fix custom elements nested under @property (#3066)
* patch custom elements bug

* Skip `cached_property`

* fomrat

* comment, type hint

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-10 18:59:20 -07:00
Saurav MaheshkarandBrent Yi d1fc2ee338 feat(ci): migrate to uv in CI (#3038)
* feat(ci): migrate to `uv` in CI

* feat(ci): drop upgrade strategy

* feat(ci): use `uv` in docs workflow

* fix(ci/doc): update sphinx build cmd

* fix(ci/doc): specify python path

* (experimental) simplify

* remove venv

* Revert line wrap change for doc.yml

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-08 15:46:00 -07:00
Sahil Jain 2b9171528b Fix config loading for Eyeful Tower dataset (#3054)
Add test_filenames to transforms.json generated by eyeful_tower.py
2024-04-08 17:04:20 +00:00
Ling JingandJing 26804f8124 Make colmapDataParser compatible with 360_v2 dataset format (#2860)
* added an option to colmapdataparser to round up the image size when downscaling

* add round mode and update ffmpeg command

* [fix] wrong variable order

* update format

---------

Co-authored-by: Jing <jing1ling@intel.com>
2024-04-08 12:07:21 -04:00
Jan-Niklas Dihlmann 911091ccb6 Added SIGNeRF to Nerfstudio methods (#3053)
* feat: signerf as nerfstudio method

* fix: formating issues and indexing
2024-04-08 07:17:56 -07:00
Gina Wu fba4aa9903 New Google Drive link for poster dataset (#3045)
Change poster dataset link
2024-04-04 21:36:29 -07:00
Brent Yi 3ac1b6bec7 Only load+undistort splatfacto images when they're used (#3043)
* Only load splatfacto dataset when it's used

* ruff

* typo fix

* Fix #2817; don't undistort for `ns-viewer --viewer.max-num-display-images 0`

* ruff
2024-04-04 23:25:04 +00:00
Chung Min KimandBrent Yi c572eb7f19 Refactor ScenePointerCallbacks for viser compatibility (#3036)
* Update to match viser pr

* Bump viser version

* `done` => `removed` in docs

* Update viewer_elements.py

* Fix

* Point function signature overload

* Update viewer_control.md

* type ignore on callback

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-02 23:42:15 -07:00
J.Y 5fbb4b0af8 bump version to 1.0.3 (#3035) v1.0.3 2024-04-02 13:42:39 -07:00
Zac Stewart 1b9dfe8bb3 Support COLMAP reconstructions with non-flat image dirs (#3006)
* Support COLMAP reconstructions with nested image dirs

The code was previously looking for the file.name, which drops all
directory information from the path. Instead, we want to get the file
path relative to the data dir, which will only drop parts of the path
above the data dir, allowing us to recurse into subdirectories within
the images dir

* Adhere to style guidelines

* Add testcase to cover image dirs with subdirs
2024-04-02 14:17:17 -04:00
J.Y a990721fa8 Fix core tests with Pillow>=10.3.0 (#3034) 2024-04-02 09:30:14 -07:00
Maxime Vandegar 59d6acf9da Exporting Splatfacto: correct errors when there are NaN/Inf values in some attributes (#3032)
* Apply the mask on the proper axis for removing NaN/Inf values

* Remove unnecessary indexing which raises an error for 1-d arrays

* Update the number of gaussians after removing NaN/Inf values
2024-03-31 13:26:11 -04:00
Otto Seiskari 05ce76db99 Get rid of redundant projection matrix computations in Splatfacto (needs a gsplat update) (#3019)
Get rid of projection matrix in ProjectGaussians with gsplat >= 0.1.9
2024-03-28 19:03:53 +00:00
Chung Min Kim 71de07163a Support rectangle selection in viewer (#3014)
* Support rectangle selection in viewer

* Update doc for click screen_pos

* Raise callback override warning from nerfstudio

* Bump viser version, rect-select only in >0.1.26
2024-03-25 19:48:49 +00:00
MildMystery 0e889f7cb1 Fix bug when trying to create a camera path in viewer (#3016)
* Directly import interpolate function
2024-03-24 09:44:17 -07:00
12195f034f Fix rotation_matrix for opposite float32 vectors (#3011)
* Fix rotation_matrix for opposite float32 vectors

* Reformulate rotation_matrix() without division => drop unnecessary `eps`

* Rename `rotation_matrix()` => `rotation_matrix_between()`

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
2024-03-21 23:07:07 -07:00
Mathijs HenquetandMathijs Henquet d7ceaa13dc Make ply export property ordering backward compatible (fixes nerfstudio-project/nerfstudio#3004) (#3005)
* Fixes nerfstudio-project/nerfstudio#3004
---------

Co-authored-by: Mathijs Henquet <mathijs.henquet@nlr.nl>
2024-03-20 12:48:31 -07:00
Matthew Hoffman 712e1827ed Upgrade to latest nbformat 5.9.2 (#2964)
open3d 0.18.0 depends on nbformat>=5.7.0
2024-03-18 17:59:30 +00:00
J.Y 8e0c68754b enable coarse-to-fine training (#2984) 2024-03-11 17:50:53 +00:00
Tobias FischerandMatias Turkulainen 946151ac45 Add 'within' function to SceneBox (#2991)
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
2024-03-11 10:27:36 -07:00
Daewoon Kim 9960de0e84 update Camera models in data processing script (#2997)
* update colmap camera models
2024-03-11 12:20:25 +02:00
Nicolas ZunhammerandNicolas Zunhammer ae6c46cfea Fix: Masks having wrong dimension after undistortion (causes crash in splatfacto) (#2987)
* Add third dim to masks after undistortion to fix error in multiplying color images with masks.

* Revert auto format of imports to fix ruff error

---------

Co-authored-by: Nicolas Zunhammer <n.zunhammer@dromni.eu>
2024-03-08 19:18:30 +02:00
trinh31201andĐinh Trinh 6e6cedd438 Handle alpha images properly for instant-ngp and tensorf models (#2979)
Co-authored-by: Đinh Trinh <dinhtrinh@MacBook-Air-cua-Trinh.local>
2024-03-05 21:00:39 +00:00
Ethan WeberandJustin Kerr 0555132d40 Fix depth-nerfacto edge cases (#2939)
* fixes pixel sampling

* reverting indexing change

* adressing PR change

---------

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-03-03 11:10:17 -08:00
Lei Lei 3a4ed804d3 doc: fix code typo in 'NeRF' method doc (#2978)
In NeRF methods doc, old code component was found. So just fix this small typo issue.
2024-03-01 21:34:28 +00:00
Justin KerrandMatias Turkulainen da2f833e3b Refactor splatfacto gaussian params with a ParameterDict (#2946)
* refactor splatfacto with parameterdict to simplify subclassing, defining new gaussian features

* stray comment

* fix exp_avg key error

* backwards compatibility for checkpoint

* backwards comp fix

---------

Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
2024-03-01 10:52:52 +00:00
Anthony ZhangandGina Wu 56d1d19f01 Adding Terminal Window to Jupyter Cells so all Colab users (free and pro) can train with Nerfstudio (#2870)
* adding terminal window to jupyter cells for free colab users to train and render

* updating torchaudio package dependency

* deleting viewer connection cell, replaced with ns-train's sharable URL viewer link

* fixing flying apostrophe

* fixing pip torch download installation typo

---------

Co-authored-by: Gina Wu <42229107+ginazhouhuiwu@users.noreply.github.com>
2024-03-01 06:47:40 +00:00
AdamRashid96 6df06f264e add splatfacto-big docs (#2955)
* add splatfacto-big docs
2024-02-29 12:04:15 -08:00
Jinhwan Choi 55a2688763 fix bug that opacity compentation not being applied to depth raterization (#2966) 2024-02-28 19:47:50 +00:00
Brent Yi 8b728d4ec8 Fix progress bar for full images datamanager (#2969) 2024-02-28 11:41:03 -08:00
Brent Yi c491e3e101 Fix Nerfacto + Aria (#2950) 2024-02-26 18:16:54 +00:00
Brent Yi 4dcbfc55fb Show viewer resolution as WxH instead of HxW (#2948) 2024-02-23 18:21:02 +00:00
Brent Yi 29ddd2ca3a Support new MPS filenames for Project Aria point clouds (#2949)
* Support new point cloud filename for Project Aria point clouds

* Comment details
2024-02-23 03:26:59 +00:00
AdamRashid96 cc0205943a splatfacto-big (#2945) 2024-02-22 14:43:42 -08:00
Justin Kerr c4b030b816 1.0.2 (#2943) v1.0.2 2024-02-22 12:57:56 -08:00