4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-10 18:17:31 +08:00
Commit Graph

1324 Commits

Author SHA1 Message Date
Jonas Kulhanek
77b7bfb1b1 Implement ForwardRef generic interface 2023-03-01 11:36:50 +01:00
Jonáš Kulhánek
8d24a3bcab
Merge branch 'main' into generic-model-interface 2023-02-27 01:52:00 +01:00
Jonas Kulhanek
1e036372cf Add generic type interface 2023-02-27 01:48:32 +01:00
Georgy Ponimatkin
5d640bfcfd
Dataparsers for ScanNet and ARKitScenes (#1514)
* Adding dataparsers for ScanNet and ARKitScenes datasets.

* Fixing automatic width and height determination in ARKitScenes.

* Making arkitscenes_dataparser.py to pass pylint checks.

* Fixing docstring in arkitscenes_dataparser.py.

* Fixing function name in arkitscenes_dataparser.py.
2023-02-26 16:29:57 -08:00
Saurav Maheshkar
4545dcb6b3
feat: improve type hints (#1515)
* feat(plugins/registry): Improve Type Hints

* feat(exporter/texture_utils): Improve Type Hints

* feat(exporter/tsdf_utils): Improve Type Hints

* feat(cameras/camera_utils): Improve Type Hints

* feat(cameras/cameras): Improve Type Hints

* feat(cameras/rays): Improve Type Hints

* fix: add default value for device

* fix: ArrayLike type hint
2023-02-26 12:22:45 -08:00
Jonáš Kulhánek
7309273d92
Add support for more colmap camera models in ns-process-data (#1500)
* Add support for more colmap camera models in ns-process-data

* Fix bugs introduced in #1457
2023-02-26 18:53:08 +01:00
Georgy Ponimatkin
7da588c5d2
Extending ns-render to support loop rendering using interpolated cameras (#1508)
* Extending ns-render to support loop rendering using interpolated cameras.

* Adding docstring for render.py. Applying formating.

* Expanding docstrings for class. Renaming trajectory type.

* Removing mentions of loop from render.py.
2023-02-26 09:30:19 -08:00
Matthew Tancik
3e005815cc
Check that video path is correct (#1513) 2023-02-25 22:54:49 -08:00
Paul Wais
5c73766653
SFM: sfm-based depth, some breadcrumbs for pycolmap (#1457)
* save

* save

* more cleanup

* save

* save

* update phototourism

* save

* works

* works

* cleanup

* cleanup

* lint

* python3 default

* cleanup
2023-02-25 21:10:53 -08:00
Alexander Kristoffersen
b62571d537
Colab tinycudann drive link updated. (#1512)
* updated tinycudann drive link.

* updated tinycuda drive link
2023-02-25 20:12:46 -08:00
Saurav Maheshkar
0b87c43d0d
feat(engine): improve type hints (#1509)
* feat(engine): improve type hints

* fix: add pylint ignore statement

* fix: order imports as per isort

* fix: update Optimizer setup return type

* feat: add new TORCH_DEVICE type
2023-02-25 16:33:43 -08:00
Matthew Tancik
5158cc36ff
Fix logic when using filename datasets (#1510) 2023-02-25 16:06:41 -08:00
Matthew Tancik
1916d9c85f
Update ffmpeg comment (#1505)
update ffmpeg comment
2023-02-25 15:24:16 -08:00
Fernando Rivas-Manzaneque
9053643932
Volinga model and NVOL documentation (#1486)
* added volinga model to NeRFStudio

* Removed unused dependencies

* Modified dockerfile to match main

* Corrected typo in core_code_checks.yml

* Corrected typo in core_code_checks.yml

* updated test with Volinga

* Added conversion to NVOL documentation

* [WIP] Refactor documentation and removing Volinga config

* Volinga use existing NerfactoModelConfig

* Added Unreal Engine documentation to extensions

* removed unused field class import

* Updated docs

* Documentation ready

* Update Dockerfile

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-02-25 14:49:53 -08:00
Jingchen Ye
871eb0f7d3
Rename friends dataset to sitcoms3d (#1503)
* Rename friends dataset with official name sitcoms3d

* Rename downloaded folder

* Fix pylint
2023-02-25 14:38:23 -08:00
Ruilong Li(李瑞龙)
7dc7129cf8
fixes for nerf synthetic dataset (#1507)
* fixes for nerf synthetic dataset

* restore eval script

* fix format with black
2023-02-25 14:37:10 -08:00
Saurav Maheshkar
92c9cee4c7
feat(docker): Add opencontainers image-spec to Dockerfile (#1502)
This PR makes a few tiny changes to improve the overall quality of the docker image 🐳 . For reference more annotations can be found [here](https://github.com/opencontainers/image-spec/blob/main/annotations.md)
2023-02-25 12:30:02 -08:00
Jonáš Kulhánek
079f419e54
Fixes bug introduced in #1499 preventing load_from_checkpoint to work correctly (#1501)
* Call load_state_dict on model classes

* Fixing bug introduced in #1499
2023-02-25 08:06:08 -08:00
Jonáš Kulhánek
93359b131e
Call load_state_dict on model classes (#1499) 2023-02-25 08:00:04 +01:00
Jonáš Kulhánek
7e9af33c03
ns-process-data: fix image renaming for the --skip-colmap case (#1459)
* Fix ns-process-data with skip colmap

* Fix docstring

* Fix pylint problem

* Change OrderedDict to dict
2023-02-24 20:40:52 -08:00
Saurav Maheshkar
a28442a82c
chore: delete setup.cfg (#1495)
Fixes #1489
2023-02-24 11:18:58 -08:00
Ruilong Li(李瑞龙)
3933589b94
bump nerfacc to 0.3.5 (#1492) 2023-02-24 11:17:21 -08:00
Jingchen Ye
e0ad53762e
Rename train_split_percentage with train_split_fraction (#1497)
rename train_split_percentage with train_split_fraction
2023-02-24 11:16:37 -08:00
Matthew Tancik
1a2bbc5725
Add extensions tab (#1488) 2023-02-23 16:04:57 -08:00
Matthew Tancik
a3a1b1f667
Fix relative argument (#1487) 2023-02-23 09:31:24 -08:00
Nikhil Mohan
a91b92f89d
semantic_nerfw_configurability (#1467)
* fix semseg vis

* semantic configs

* change defaults

* Fix type

* format

* fix imports

* suggested fix for issue 1465

* fix docstring placement; avoid log spam and runtime errors

`nerfstudio\models\semantic_nerfw.py:81: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
  self.colormap = torch.tensor(self.semantics.colors).to(self.device)`

* hide semantics output choice, since it kills the viewer

* revert some changes

* caps

* move both image and mask to GPU to avoid runtime error

as suggested in https://github.com/nerfstudio-project/nerfstudio/issues/1465#issuecomment-1441117562

---------

Co-authored-by: machenmusik <machenmusik@users.noreply.github.com>
2023-02-22 22:21:04 -05:00
Matthew Tancik
69fdc7db9c
Datamanager eval fix (#1482)
* Fix datamanager

* Datamanager tweak

* Hopefully fixed now

* readd comment
2023-02-22 16:53:23 -08:00
Jake Austin
50dc5d6cd7
Triplanes (#1456)
* Triplanes working

* Doing the TODOs, better variable names

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-02-22 16:23:12 -08:00
Matthew Tancik
9e68a46abe
Fix datamanager (#1481) 2023-02-22 16:08:53 -08:00
Matthew Tancik
ba161a2234
Update blender_addon.md 2023-02-22 15:33:33 -08:00
Nicolas Zunhammer
4d333f4cb6
[Update] Add hloc to Dockerfile, bump version of docker image in dev-container, improve docs (#1478)
* Add hloc to Dockerfile, bump versions of docker release.

* Add missing dependency for pycolmap.

* Improve commenting.

---------

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2023-02-22 21:44:53 +01:00
Matthew Tancik
27eb33f491
Enable viewer with eval (#1474) 2023-02-22 10:21:55 -08:00
Ethan Weber
3066819241
Fix eval dataloader to use eval ray generator (#1473)
fix eval ray generator
2023-02-22 09:53:42 -08:00
Matthew Tancik
0d336a181e
Update exponential scheduler (#1468) 2023-02-21 16:09:38 -08:00
Matthew Tancik
f3a34bbf95
Refactor schedulers (#1466)
* Refactor schedulers

* lint

* lint
2023-02-21 12:51:51 -08:00
Dreek Fire
53e99c396b
Add Windows installation tips to quickstart. (#1427)
* add hashmap size and num_levels to instant_ngp_field, issue 1158

* Add Windows installation tips to quickstart

* Include notes for CUDA 11.7

* separate duplicate targets in installation.md

* change installation page to use tabs
2023-02-21 09:24:09 -08:00
Sacha Lewin
151b1060fe
Uniform Sampler in Nerfacto (#1464)
* Allow black/white background color in Nerfacto

* Use white background in Nerfacto Blender Benchmark

* Fixed unused import

* Updated index for license headers script

* Removed debug code in NGP models

* Uniform initial sampler config in Nerfacto

* Undo changes in settings.json

* Removed unwanted settings file

* Removed unneeded config parameter

* Use uniform sampler on Blender benchmark
2023-02-21 09:17:57 -08:00
Rohan Mathur
796fad8bcb
Equirectangular input (#1446)
* started adding equirectangular to process_data

* was multiplying frame by 255 twice

* added equi2planar configs for the 3 presets

* fixed presets

* setup process data

* changed variable name and comment

* fixed middle preset

* removed third preset

* added progress bar and fixed video for equirectangular input

* fixed whitespace stuff

* added pyequilib dependencey

* Updated for JPG support for equirectangular image input

Updated process_data_utils for JPG support for equirectangular image input, since even though .jpg images worked, .JPG images (output from 360 camera software) were not working.

* changed file type matching

* added equirect utils

* added license header

* added docstring on equirect utils

* added heuristic for image size

* added heuristic for videos

* fixed linty stuff

* shortened code

* raised error if no ims in directory

* Updated ProcessVideo for fixing directories for equirectangular input

Updated the ProcessVideo for equirectangular input to make the image directory have the correct perspective projections. The original equirectangular images are copied into a temp_images folder which also holds the perspective projections. This folder is deleted once the perspective projections are copied into the process data images folder.

---------

Co-authored-by: cvachha <cyrus.vachha@yahoo.com>
Co-authored-by: cvachha <cvachha549@gmail.com>
2023-02-20 10:58:42 -08:00
Matthew Tancik
36514797fd
Support multiple versions of stable diffusion (#1461)
Co-authored-by: David McAllister <davidrmc2@gmail.com>
2023-02-20 10:12:41 -08:00
Alexander Kristoffersen
f8e8d8266e
Patch Sampling (#1458)
* patch sampling.

* changed str to literal.

* clean up sample selector.
2023-02-19 22:14:27 -08:00
Matthew Tancik
e2dadc20ab
v0.1.18 (#1455) 2023-02-19 14:49:59 -08:00
Matthew Tancik
e89d113ddc
Fix colmap bug when not all images are matched (#1454)
Fix colmap when not 100 matching
2023-02-19 14:48:31 -08:00
Matthew Tancik
ceda935e64
Fix depth nerfacto exporting (#1453) 2023-02-19 13:53:01 -08:00
Matthew Tancik
73f0f5a16a
Fix mesh export normals (#1452)
* Fix mesh export normals

* lint
2023-02-19 13:43:43 -08:00
Nicolas Zunhammer
2901e5f31a
Bump Dockerfile versions, add user to sudoers list. (#1448)
* Update Dockerfile, bump CUDA from 11.7.1 to 11.8.0, bump Colmap from 3.7 to 3.8, add user to sudoers list.

* Improve description.

* Fix wrong description and typos.

* Add better description.

* Fix build error of Dockerfile.

* Bump pytorch versions.

---------

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2023-02-19 13:58:33 +01:00
Matthew Tancik
df0f3205f4
Add ns-viewer docs (#1450) 2023-02-18 19:03:46 -08:00
Matthew Tancik
15dfc68453
Delete nerfstudio/.vscode directory
Added by mistake.
2023-02-18 17:13:46 -08:00
Sacha Lewin
8e4ae6bebf
Allow use of black or white background in Nerfacto models (#1441)
* Allow black/white background color in Nerfacto

* Use white background in Nerfacto Blender Benchmark

* Fixed unused import

* Updated index for license headers script
2023-02-17 20:39:10 -08:00
Matthew Tancik
2357332e66
Proposal network initial sampler (#1435)
Allow first proposal sampling method
2023-02-15 15:35:08 -08:00
Pablo Vela
6619dd1ac2
add monosdf normal loss and midas scale invariant depth loss (#1410)
* add monosdf normal loss and midas scale invariant depth loss

* add context to scale/shift calc and normal loss, consolidate MidasMSE loss

* consolidated, add info on gradient reg term

* add info on ssi

* more documentation and type annotation

* move compute scale/shift to class

* fix pylint errors

* fix tensortype error

* fix comments

* change single var name and update comment

* fix input tensortype

* fix black error

* fix mask shape
2023-02-15 13:49:35 -06:00