4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-10 18:17:31 +08:00
Commit Graph

2063 Commits

Author SHA1 Message Date
J.Y.
7a0b8cbc89
use gsplat strategy interface to simplify splatfacto (#3376)
* use gsplat strategy interface to simplify splatfacto

* change splatfacto-big densify_grad_thresh to 0.0005

* upgrade gsplat version

* filter low opacities when exporting

* remove num_sh_bases

---------

Co-authored-by: Jianbo Ye <jianboye@amazon.com>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-09-13 07:10:37 -04:00
Jonáš Kulhánek
194b5d4e46
Fix docker attestation fail on forked repo PRs (#3423) 2024-09-12 09:43:36 -04:00
Aayush Gupta
e7b7dc9c6f
Add option to start training paused (#3420) 2024-09-10 19:56:44 +00:00
Daniel Crispell
e2a0915e56
bugfix: handle multiple camera types in a single batch (#3415) 2024-09-10 15:31:05 -04:00
Hardik Dava
d67b281f7d
RGBA renderer for splatfacto (#3307)
* Update base_model.py

* Update render.py

* Update render.py

* fixing error

* Update render.py

* Update render.py
2024-09-09 16:20:26 -04:00
Jonáš Kulhánek
f86dbe6d45
Update dockerfile and add docker build action (#3283)
* Use github docker registry

* Fix DDP train for GPU in exclusive mode

* Improve docker image - compile gsplat, decrease image size

* Drop unrelated change

* Add build docker image action

* Rename build docker image action

* nit

* Remove commented line from Dockerfile

* Fix dockerfile when explicit source is specified

* Fix failing dynamo build for torch.compile

* Lock dockerfile and tcnn versions

* Add `torch.cuda.is_available()` condition

* Drop set_cuda_device

* Fix build docker image github action

* Docker build save disk space

* Set MAX_JOBS to limit resource usage for docker build

* Try bumping `MAX_JOBS` 2 => 4

* Install fixed gsplat version from nerfstudio's pyproject.toml

* Update docs

* Finish docker build action

* Fix ignores push when PR

---------

Co-authored-by: Gina Wu <ginawu98@gmail.com>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-09-05 10:12:21 +02:00
Hoanh Le
96b7fe2230
update documentation for instant-ngp (#3406)
update documentation
2024-09-03 10:09:18 -04:00
jiaruiyu99
a6214921f8
Add eval data to image_rename_map (#3396)
* Add eval data to image_rename_map

* Follow name convention

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
Co-authored-by: J.Y. <132313008+jb-ye@users.noreply.github.com>
2024-09-03 01:35:54 +00:00
Hoanh Le
d395aa2e53
change grid resolution type (#3400) 2024-08-30 17:32:42 +03:00
Gina Wu
dff42c9a81
Bump viser to 0.2.7 (#3398)
Bump viser 0.2.7

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-08-29 17:53:34 -07:00
Brent Yi
33dce833ee
Suppress wandb type error (#3397) 2024-08-29 17:21:45 -07:00
J.Y.
6410080244
bump version to v1.1.4 (#3394)
bump version

Co-authored-by: Jianbo Ye <jianboye@amazon.com>
2024-08-28 17:06:59 -04:00
J.Y.
96ca8b0ab7
Update exporter.py to export sh_degree 0 case #3371 (#3374)
* Update exporter.py for sh_degree 0

Change to write sh coefficients instead of color values

* Add flag for use_sh0_renderer

Add sh0 renderer case for model.config.sh_degree == 0

* fix ruff

* add warning if use_sh0_renderer is used when higher order of SH is available

* fix rgb export for color-only training

* use ply_color_mode

* better handling ply_color_mode=='rgb' when sh_degree>0

* clean RGB2SH

* fix issues

* update description

---------

Co-authored-by: bell-one <bellone1991@gmail.com>
Co-authored-by: Jianbo Ye <jianboye@amazon.com>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-08-28 19:41:25 +00:00
Hoanh Le
22dae34eeb
add assertion to make sure positions and positions_flat are not empty (#3387) 2024-08-28 12:37:54 -07:00
Anthony Zhang
69ae4abbfd
Updating camera intrinsics (principal points) when the undistorted image is cropped (#3382)
* added notes and a possible bugfix when region of interest crops image during undistortion to update intrinsics

* fixing index error, principal points are on the 3rd column of 3x3 matrix K

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
Co-authored-by: J.Y. <132313008+jb-ye@users.noreply.github.com>
2024-08-26 17:26:51 -07:00
Ruilong Li(李瑞龙)
1f2344a731
get rid of gsplat legacy dep (#3386)
Co-authored-by: Ruilong Li <397653553@qq.com>
2024-08-26 11:28:34 -04:00
Yufeng Zhang
792c5fa9f7
Add an example on how to customize dataparser with ns-train (#3385) 2024-08-25 22:04:23 +00:00
J.Y.
02d45c1fd7
Fix #3355 (#3381)
* fix nonzero colmap K4
2024-08-25 14:48:17 -07:00
Brent Yi
b707727950
Fix memory leak in full_images_datamanager.py (#3375)
* Fix memory leak in full_images_datamanager.py

* remove trailing space

* follow-up remove some deepcopy

---------

Co-authored-by: J.Y. <132313008+jb-ye@users.noreply.github.com>
Co-authored-by: Jianbo Ye <jianboye@amazon.com>
2024-08-23 11:04:32 -07:00
pierremerriaux-leddartech
e3a506f346
fix bugs in generfacto, train_dataparser_outputs.save_dataparser_transform and viewer camera on cpu (#3378)
* fix bugs in generfacto, train_dataparser_outputs.save_dataparser_transform and viewer camera on cpu

* fix formating
2024-08-23 11:44:47 -04:00
Alex Jean
36d5e35801
Addressed TODO in full_images_datamanager.py to return image resolution as train rays (#3312)
* addressed a todo in full_images_datamanager.py that should return the resolution of the image being rendered

* fixed docstring get_train_rays_per_batch
2024-08-21 21:59:44 +00:00
J.Y.
a281d99eac
bug fix for splatfacto (#3367)
* bug fix for splatfacto

* fix core tests

* Remove ipynb exclude for ruff, will fix in #3369

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2024-08-19 16:11:12 -04:00
Sebastiaan
096116097a
installation.md: Remove manual gsplat installation for Windows (#3333)
* installation.md: Remove manual gsplat installation for Windows

* installation.md: Reformat and clarify Windows instructions.

* Update installation.md

installation.md: Minor change in wording

---------

Co-authored-by: J.Y. <132313008+jb-ye@users.noreply.github.com>
2024-08-19 15:44:41 +00:00
Brent Yi
c669d865c1
Bump + run ruff (#3369)
* Bump + run ruff

* Fix notebook import
2024-08-19 11:23:14 -04:00
Congrong Xu
2ed1716980
Bilagird for splatfacto (#3316)
add bilateral grid as option to splatfacto training
2024-08-13 19:18:43 +00:00
Ethan Weber
ec10c49d51
Lazy import for open3d in Blender DataParser (#3347)
lazy import for open3d in blender dataparser

Co-authored-by: Ethan Weber <ethanjohnweber@meta.com>
2024-08-05 18:55:59 +00:00
Congrong Xu
9ffbc374f4
Allows rendering the appearance of specific training camera indices (#3346)
allows render given camera idx
2024-08-05 10:41:55 -07:00
Guangyun-Xu
b0dd3d4730
make np.array compatible with numpy 2.0 (#3339)
* make np.array compatible with numpy 2.0

* Update camera_utils.py
2024-07-29 12:44:06 -07:00
Sebastiaan
8c87906971
Swap out opencv-python for opencv-python-headless (#3336) 2024-07-27 15:48:56 -04:00
J.Y.
702886b213
fix ruff check (#3328) 2024-07-25 09:22:59 +09:00
Congrong Xu
3a46c4274a
Pass current camera idx in metadata to get output from viser (#3293)
allows viser camera to pass clicked training camera idx into metadata
2024-07-18 08:03:18 +00:00
Congrong Xu
d2510aa02f
Splatw doc updates (#3311)
* splatw doc

* fix

* fix typo

* update doc

---------

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-07-18 16:59:55 +09:00
Congrong Xu
7736539cc7
Loose assert condition for datamanger in get_average_eval_image_metrics() (#3310)
* loosen datamanger assert

* linter
2024-07-16 15:16:38 -04:00
Junyuan_F
5945851598
Added _load_3D_points to scannet_dataparser.py (#3305)
* Update scannet_dataparser.py

Reading .ply file in scannet_dataparser.py is now possible.

* Reformatted scannet_dataparser.py

* solved returing None issue from _load_3D_points
2024-07-15 16:25:37 -04:00
Sebastiaan
bf3664a19a
Update installation.md: Add missing Pixi documentation (#3302) 2024-07-12 16:25:04 -04:00
Kei Ishikawa
27801d2a47
Update the docstring of SplatfactoModel.get_outputs (#3289)
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-07-10 03:47:22 +00:00
Ruilong Li(李瑞龙)
8f5867a0b4
fix color shape when sh_degree=0 in splatfacto (#3296)
* fix color shape when sh_degree=0 in splatfacto

* format

---------

Co-authored-by: Ruilong Li <397653553@qq.com>
2024-07-09 12:11:45 -07:00
Congrong Xu
b28cc78b7c
Document updates for splatfacto-w (#3281)
* splatw doc

* fix

* fix typo

---------

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-07-09 10:00:10 -04:00
pculbertson-bdai
592615ff51
Make awscli an optional dependency (#3279)
* removed awscli from deps + added warning during attempted download.

* update docs to flag manual awscli install to users.

* add awscli to dev dependencies

* add proper awscli error handling to ns-download-data

* minor typing fix for ns-download-data when awscli is not installed
2024-07-03 19:43:59 +00:00
Brent Yi
f97eb2e5f0
Bump viser to 0.2.3 (#3277) 2024-06-30 23:38:55 -07:00
Jisung Yoo
90cc4f1d1e
Fix dimension mismatch between downscaled cameras and images in colmap. (#3232)
Co-authored-by: jisung.yoo <jisung.yoo@naverlabs.com>
2024-06-29 04:46:54 +00:00
Nicolas Zunhammer
c8fcf081ec
Update pytorch in Dockerfile to 2.1.2 (#3268)
Update pytorch in Dockerfile to 2.1.2 to fix incompatibilities with gsplat 1, remove version pinnin of tinycudann as 1.6 is not compatible with the new pytorch, pin setuptools to <70.

Co-authored-by: Nicolas Zunhammer <n.zunhammer@dromni.eu>
2024-06-28 23:15:42 +00:00
Gina Wu
c3bcee89a3
Bump viser (#3234)
* Bump viser to 0.2.2
---------

Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-06-28 13:27:19 -07:00
Tamir Cohen
1af71f2fff
Fix parsing of non ascii image names in colmap's images.bin (#3256)
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2024-06-28 19:50:35 +00:00
Zhensheng Yuan
df57a8db72
Fix different initial tension value between tension_slider and `cam… (#3271)
* Fix different initial tension value between `tension_slider` and `camera_path.tension`

* Fix ruff check
2024-06-28 12:31:26 -04:00
Justin Kerr
d6df39b70d
Compatibility for numpy 2.0 (#3265)
* compat for numpy 2.0

* lint changes
2024-06-28 08:07:10 +09:00
Brent Yi
9b3cbc79bf
Bump to 1.1.3 2024-06-18 00:59:14 +09:00
Congrong Xu
3d27dd4609
Add descriptions for splatfacto-big and nerfacto-huge (#3233)
Update method_configs.py
2024-06-16 15:38:30 -04:00
Alex Jean
2e3c3c179a
Background device (#3219)
added to(self.device) for background_color when in eval mode for splatfacto
2024-06-13 14:57:46 +03:00
Congrong Xu
290f3fa028
Adds back screen size too bigs culling as an option (#3211)
* revert too bigs

* format

* remove squeeze(0)

* add if not training to the bg expand logic
2024-06-12 17:29:36 +00:00