4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 10:34:29 +08:00
Commit Graph

1940 Commits

Author SHA1 Message Date
J.Y
e2a9793ba4
bump version to 1.1.0 (#3143) 2024-05-13 10:58:49 -07:00
Elias Watson
e3ef9fb163
Clarify flag name in docs/nerfology/methods/splat.md (#3140)
Clarify full flag name
2024-05-13 08:55:35 +01:00
Feez2403
ffbd16a375
Fix edge case of depth colormap (#3139)
If the user sets near_plane as 0.0, the "or" will take the second term (float(torch.min(depth))) instead of using the 0.0 value.  We fix this by checking explicitely for a "None" variable
2024-05-11 21:38:13 -04:00
Leandro Passos
7ba02be8cf
adding the link for the paper page and fixing image paths (#3132)
* bionerf markdown file
2024-05-09 16:02:48 +00:00
J.Y
a4c32ada52
Make RealityCapture csv/ply exports work! (#3131)
* support ply input file for ns-process-data realitycapture


Co-authored-by: Jianbo Ye <jianboye@amazon.com>
2024-05-09 08:58:03 -07:00
Chung Min Kim
c17d1d7315
Add kwargs handling for patchpixelsampler patch size (#2622)
* Add kwargs handling for patchpixelsampler patch size

* Run black

---------

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
Co-authored-by: J.Y <132313008+jb-ye@users.noreply.github.com>
2024-05-08 10:45:58 -07:00
Leandro Passos
3d61d8cbdc
Fixing typos and symbols in bionerf.md (#3126)
* bionerf markdown file

* method description in markdown file

* inserting bionerf in index file

* bionerf description

* fixing image paths

* including results on readme

* deleting last line from bionerfs page

* fixing typos in bionerf.md
2024-05-07 00:43:10 -07:00
Leandro Passos
9fe8e6c27c
BioNeRF (#3125)
* bionerf markdown file

* method description in markdown file

* inserting bionerf in index file

* bionerf description

* fixing image paths

* including results on readme

* deleting last line from bionerfs page
2024-05-06 22:11:07 -07:00
Justin Kerr
3096f445b8
Add a pointcloud export from polycam to process-data (#3124)
* add a pointcloud export from polycam mesh to process-data

* bugfix
2024-05-06 14:40:05 -07:00
hturki
f2a73804d4
fix nerfstudio collate function (#2965)
* fix nerfstudio collate function

* run ruff

* address PR feedback
2024-05-06 13:37:42 -04:00
J.Y
49f5934ab3
Support splatfacto training for metashape exports (#3122)
* Added the possibility to import a metashape ply file

* FIxed double import and import order

* Ruff Format

* Ruff Format

* Ruff Format

* Ruff SUCKS

* make ply as an option and use applied_transform

* fix ruff

* fix bugs when ply doesn't exist

* fix bugs when ply doesn't exist

* no backtrace for ValueError

* hot fix

* Add return type

---------

Co-authored-by: simonbethke <simon.bethke@gmail.com>
Co-authored-by: Jianbo Ye <jianboye@amazon.com>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-05-01 21:24:33 -04:00
J.Y
3c4c3ae07e
Fix #3064 and some minor changes (#3121) 2024-05-01 12:43:41 -07:00
Frédéric Devernay
e232227e31
metashape_utils: work with camera groups (#2626)
* metashape_utils: work with camera groups

* metashape_utils: console message when skipping a camera due to a missing image

---------

Co-authored-by: Frédéric Devernay <f-dy@users.noreply.github.com>
Co-authored-by: J.Y <132313008+jb-ye@users.noreply.github.com>
2024-04-30 20:25:59 +00:00
Carl Lindström
759fda8285
Fix bug in pixel sampler (#3103)
* Fix bug in pixel sampler

* Refactor code for distributing rays across images
2024-04-30 09:57:20 -04:00
J.Y
b190874ef1
Use AbsGrad to get better results with less gaussians (#3113)
* Use AbsGrad to get better results with less gaussians

* some adjustment such that splatfacto-big don't go OOM

* use new gsplat version

---------

Co-authored-by: Jianbo Ye <jianboye@amazon.com>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-04-29 16:32:48 -04:00
Mathijs Henquet
bc9328c7ff
GaussianSplats export: allow uint8 in ply (#3111)
* GaussianSplats export: allow uint8 in ply

* Ruff formatting

* Add test and narrower typing

* Formatting

* Revert narrow typing, not supported by old python

* Fix typing for old pythons
2024-04-29 14:30:25 -04:00
Rohan Mathur
f046ceadf6
Adding cropping for gaussian splat exports (#3105)
* added bounding box to splat export params

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-04-29 17:05:49 +00:00
Satvik Sharma
3f39546653
Adding lock for Viser Element callbacks (#3067)
* add callback lock, prepare for testing

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-04-25 23:35:24 -07:00
dberga
db93476b6a
Hloc fix for image_ids (camera per image) (#3081)
* changed run_hloc args to fill image_ids (added image_list and changed camera_mode to PER_IMAGE)

* added parameter same_camera on ns-process-data for multifocal cases in hloc. Also updated colmap_to_json to detect if there is one or several cameras per frame while keeping the camera type specifications

* ruff-formatted changes in colmap_utils.py

* use_single_camera_mode update args, including colmap_utils and hloc_utils

* changed multicamera warning's print to CONSOLE.print

* fix path typo console print

* rewritten use-single-camera-mode comment in ns-process-data

* (fix) inverted bool for colmap_utils

* change im_id to im_data.camera_id

---------

Co-authored-by: Jianbo Ye <jianboye@amazon.com>
2024-04-24 12:43:45 -04:00
J.Y
d9b022b25f
Allow alpha transparency training for blender datasets input (#3088)
Allow alpha transparency training for rgba input

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-04-19 18:03:55 +00:00
Congrong Xu
eddf2d21b5
Changes for trainer.py to support the Gradio webui (#3046)
* changes for trainer to support webui

* Update trainer to support webui

* format

* add a seperated shutdown() function to stop training

* typo fix

* get rid of _stop_viewer_server()

* Update trainer.py

* organize import

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-19 00:37:50 +00:00
Justin Kerr
45d8bb79ea
updates to apply_pca_colormap (#3086)
* improvements to pca_colormap: allow input pca matrix, optional ignore_zeros arg

* typo
2024-04-17 23:54:43 -07:00
Patrick Morgan
babf57718c
Fix call to detect ODM reconstruction file (#3018) 2024-04-12 21:23:47 +00:00
Justin Kerr
a64026f8db
shift principle points by .5 in undistortion (#3071)
* shift principle points by .5

* fix ordering

* add fisheye offset
2024-04-12 15:32:22 -04:00
Gunjan Chhablani
c302cc5301
Add pointcloud loading for blender parser (#2902)
* Add pointcloud loading for blender parser

* Fix argument

* Fix docstring

* Fix metadata in dataparsers

* Add changes from review

* Avoid changing default behavior

* Apply `scale_factor` to loaded points

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-11 13:41:14 -07:00
hyperzy
03bdeff2ad
Fixed Unexpectedly huge RAM consumption of parallel datamanager (#3060)
* Reduced the memory usage by caching image after the datamanager process starts
2024-04-11 18:56:37 +00:00
J.Y
4714ae75f7
write eval combined images for diagnostics (#3070) 2024-04-11 18:37:02 +00:00
Otto Seiskari
eba72db22a
Camera pose optimization for Splatfacto (#2891)
* Add pose optimization to Splatfacto

* Disable Splatfacto pose optimization by default

* Improve apply_to_camera for Gaussian Splatting pose optimization

Do not chain modifications to camera_to_worlds to improve
numerical stability and enable L2 rot/trans penalties.

* Add separate mean and max rot/trans metrics to camera-opt

* Tweak pose optimization hyperparameters

Parameters used in the Gaussian Splatting on the Move paper v1

* Unit test fix for new cameara_optimizer training metrics

* Adjust splatfacto-big camera pose optimization parameters

Same parameters as in normal Splatfacto

---------

Co-authored-by: jh-surh <jh.surh@bucketplace.net>
2024-04-11 14:23:17 -04:00
dberga
2d9bbe5091
fix exporter.py for FullImageDataManager and RandomCamerasDataManager (#3065)
* fix exporter.py for FullImageDataManager and RandomCamerasDataManager

* sort imports

* ruff

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-11 02:04:33 +00:00
Justin Kerr
c381fc818d
Fix custom elements nested under @property (#3066)
* patch custom elements bug

* Skip `cached_property`

* fomrat

* comment, type hint

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-10 18:59:20 -07:00
Saurav Maheshkar
d1fc2ee338
feat(ci): migrate to uv in CI (#3038)
* feat(ci): migrate to `uv` in CI

* feat(ci): drop upgrade strategy

* feat(ci): use `uv` in docs workflow

* fix(ci/doc): update sphinx build cmd

* fix(ci/doc): specify python path

* (experimental) simplify

* remove venv

* Revert line wrap change for doc.yml

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-08 15:46:00 -07:00
Sahil Jain
2b9171528b
Fix config loading for Eyeful Tower dataset (#3054)
Add test_filenames to transforms.json generated by eyeful_tower.py
2024-04-08 17:04:20 +00:00
Ling Jing
26804f8124
Make colmapDataParser compatible with 360_v2 dataset format (#2860)
* added an option to colmapdataparser to round up the image size when downscaling

* add round mode and update ffmpeg command

* [fix] wrong variable order

* update format

---------

Co-authored-by: Jing <jing1ling@intel.com>
2024-04-08 12:07:21 -04:00
Jan-Niklas Dihlmann
911091ccb6
Added SIGNeRF to Nerfstudio methods (#3053)
* feat: signerf as nerfstudio method

* fix: formating issues and indexing
2024-04-08 07:17:56 -07:00
Gina Wu
fba4aa9903
New Google Drive link for poster dataset (#3045)
Change poster dataset link
2024-04-04 21:36:29 -07:00
Brent Yi
3ac1b6bec7
Only load+undistort splatfacto images when they're used (#3043)
* Only load splatfacto dataset when it's used

* ruff

* typo fix

* Fix #2817; don't undistort for `ns-viewer --viewer.max-num-display-images 0`

* ruff
2024-04-04 23:25:04 +00:00
Chung Min Kim
c572eb7f19
Refactor ScenePointerCallbacks for viser compatibility (#3036)
* Update to match viser pr

* Bump viser version

* `done` => `removed` in docs

* Update viewer_elements.py

* Fix

* Point function signature overload

* Update viewer_control.md

* type ignore on callback

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-04-02 23:42:15 -07:00
J.Y
5fbb4b0af8
bump version to 1.0.3 (#3035) 2024-04-02 13:42:39 -07:00
Zac Stewart
1b9dfe8bb3
Support COLMAP reconstructions with non-flat image dirs (#3006)
* Support COLMAP reconstructions with nested image dirs

The code was previously looking for the file.name, which drops all
directory information from the path. Instead, we want to get the file
path relative to the data dir, which will only drop parts of the path
above the data dir, allowing us to recurse into subdirectories within
the images dir

* Adhere to style guidelines

* Add testcase to cover image dirs with subdirs
2024-04-02 14:17:17 -04:00
J.Y
a990721fa8
Fix core tests with Pillow>=10.3.0 (#3034) 2024-04-02 09:30:14 -07:00
Maxime Vandegar
59d6acf9da
Exporting Splatfacto: correct errors when there are NaN/Inf values in some attributes (#3032)
* Apply the mask on the proper axis for removing NaN/Inf values

* Remove unnecessary indexing which raises an error for 1-d arrays

* Update the number of gaussians after removing NaN/Inf values
2024-03-31 13:26:11 -04:00
Otto Seiskari
05ce76db99
Get rid of redundant projection matrix computations in Splatfacto (needs a gsplat update) (#3019)
Get rid of projection matrix in ProjectGaussians with gsplat >= 0.1.9
2024-03-28 19:03:53 +00:00
Chung Min Kim
71de07163a
Support rectangle selection in viewer (#3014)
* Support rectangle selection in viewer

* Update doc for click screen_pos

* Raise callback override warning from nerfstudio

* Bump viser version, rect-select only in >0.1.26
2024-03-25 19:48:49 +00:00
MildMystery
0e889f7cb1
Fix bug when trying to create a camera path in viewer (#3016)
* Directly import interpolate function
2024-03-24 09:44:17 -07:00
J.Y
12195f034f
Fix rotation_matrix for opposite float32 vectors (#3011)
* Fix rotation_matrix for opposite float32 vectors

* Reformulate rotation_matrix() without division => drop unnecessary `eps`

* Rename `rotation_matrix()` => `rotation_matrix_between()`

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
2024-03-21 23:07:07 -07:00
Mathijs Henquet
d7ceaa13dc
Make ply export property ordering backward compatible (fixes nerfstudio-project/nerfstudio#3004) (#3005)
* Fixes nerfstudio-project/nerfstudio#3004
---------

Co-authored-by: Mathijs Henquet <mathijs.henquet@nlr.nl>
2024-03-20 12:48:31 -07:00
Matthew Hoffman
712e1827ed
Upgrade to latest nbformat 5.9.2 (#2964)
open3d 0.18.0 depends on nbformat>=5.7.0
2024-03-18 17:59:30 +00:00
J.Y
8e0c68754b
enable coarse-to-fine training (#2984) 2024-03-11 17:50:53 +00:00
Tobias Fischer
946151ac45
Add 'within' function to SceneBox (#2991)
Co-authored-by: Matias Turkulainen <30566358+maturk@users.noreply.github.com>
2024-03-11 10:27:36 -07:00
Daewoon Kim
9960de0e84
update Camera models in data processing script (#2997)
* update colmap camera models
2024-03-11 12:20:25 +02:00