Commit Graph
1325 Commits
Author SHA1 Message Date
Georgy Ponimatkin 2eda6b4523 Fix pose centering flag for ARKitScenes dataparser (#1528) 2023-02-27 17:30:53 -08:00
Saurav Maheshkar 258ee26983 feat(fields): Improve Type Hints (#1524)
* feat(fields/tensorf_fields): Improve Type Hints

* feat(fields/base_field): Improve Type Hints

* feat(fields/density_fields): Improve Type Hints

* feat(fields/instant_ngp_field): Improve Type Hints

* feat(fields/nerfacto_field): Improve Type Hints

* feat(fields/nerplayer_nerfacto_field): Improve Type Hints

* fix(fields/nerplayer_nerfacto_field): add typing imports

* feat(fields/nerfplayer_ngp_field): Improve Type Hints

* feat(fields/nerfw_field): Improve Type Hints

* feat(fields/semantic_nerf_field): Improve Type Hints

* feat(fields/vanilla_nerf_field): Improve Type Hints

* fix(fields/nerfplayer/nerfacto_field): reorder imports

* fix(feilds): str -> FieldHeadNames

* fix: remove Optionals

* fix: add missing comma
2023-02-27 13:22:56 -08:00
Koke_Cacao edb54602da Bug fix for SHRenderer() (#1526)
The current SHRenderer does not apply the activation function correctly due to a typo. Now it's fixed.
2023-02-27 10:40:17 -08:00
Jonáš Kulhánek 955497fcb2 Add weight-decay option to RAdam optimizer (#1525) 2023-02-27 09:21:00 -08:00
Georgy Ponimatkin 5d640bfcfd Dataparsers for ScanNet and ARKitScenes (#1514)
* Adding dataparsers for ScanNet and ARKitScenes datasets.

* Fixing automatic width and height determination in ARKitScenes.

* Making arkitscenes_dataparser.py to pass pylint checks.

* Fixing docstring in arkitscenes_dataparser.py.

* Fixing function name in arkitscenes_dataparser.py.
2023-02-26 16:29:57 -08:00
Saurav Maheshkar 4545dcb6b3 feat: improve type hints (#1515)
* feat(plugins/registry): Improve Type Hints

* feat(exporter/texture_utils): Improve Type Hints

* feat(exporter/tsdf_utils): Improve Type Hints

* feat(cameras/camera_utils): Improve Type Hints

* feat(cameras/cameras): Improve Type Hints

* feat(cameras/rays): Improve Type Hints

* fix: add default value for device

* fix: ArrayLike type hint
2023-02-26 12:22:45 -08:00
Jonáš Kulhánek 7309273d92 Add support for more colmap camera models in ns-process-data (#1500)
* Add support for more colmap camera models in ns-process-data

* Fix bugs introduced in #1457
2023-02-26 18:53:08 +01:00
Georgy Ponimatkin 7da588c5d2 Extending ns-render to support loop rendering using interpolated cameras (#1508)
* Extending ns-render to support loop rendering using interpolated cameras.

* Adding docstring for render.py. Applying formating.

* Expanding docstrings for class. Renaming trajectory type.

* Removing mentions of loop from render.py.
2023-02-26 09:30:19 -08:00
Matthew Tancik 3e005815cc Check that video path is correct (#1513) 2023-02-25 22:54:49 -08:00
Paul Wais 5c73766653 SFM: sfm-based depth, some breadcrumbs for pycolmap (#1457)
* save

* save

* more cleanup

* save

* save

* update phototourism

* save

* works

* works

* cleanup

* cleanup

* lint

* python3 default

* cleanup
2023-02-25 21:10:53 -08:00
Alexander Kristoffersen b62571d537 Colab tinycudann drive link updated. (#1512)
* updated tinycudann drive link.

* updated tinycuda drive link
2023-02-25 20:12:46 -08:00
Saurav Maheshkar 0b87c43d0d feat(engine): improve type hints (#1509)
* feat(engine): improve type hints

* fix: add pylint ignore statement

* fix: order imports as per isort

* fix: update Optimizer setup return type

* feat: add new TORCH_DEVICE type
2023-02-25 16:33:43 -08:00
Matthew Tancik 5158cc36ff Fix logic when using filename datasets (#1510) 2023-02-25 16:06:41 -08:00
Matthew Tancik 1916d9c85f Update ffmpeg comment (#1505)
update ffmpeg comment
2023-02-25 15:24:16 -08:00
Fernando Rivas-ManzanequeandMatthew Tancik 9053643932 Volinga model and NVOL documentation (#1486)
* added volinga model to NeRFStudio

* Removed unused dependencies

* Modified dockerfile to match main

* Corrected typo in core_code_checks.yml

* Corrected typo in core_code_checks.yml

* updated test with Volinga

* Added conversion to NVOL documentation

* [WIP] Refactor documentation and removing Volinga config

* Volinga use existing NerfactoModelConfig

* Added Unreal Engine documentation to extensions

* removed unused field class import

* Updated docs

* Documentation ready

* Update Dockerfile

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-02-25 14:49:53 -08:00
Jingchen Ye 871eb0f7d3 Rename friends dataset to sitcoms3d (#1503)
* Rename friends dataset with official name sitcoms3d

* Rename downloaded folder

* Fix pylint
2023-02-25 14:38:23 -08:00
Ruilong Li(李瑞龙) 7dc7129cf8 fixes for nerf synthetic dataset (#1507)
* fixes for nerf synthetic dataset

* restore eval script

* fix format with black
2023-02-25 14:37:10 -08:00
Saurav Maheshkar 92c9cee4c7 feat(docker): Add opencontainers image-spec to Dockerfile (#1502)
This PR makes a few tiny changes to improve the overall quality of the docker image 🐳 . For reference more annotations can be found [here](https://github.com/opencontainers/image-spec/blob/main/annotations.md)
2023-02-25 12:30:02 -08:00
Jonáš Kulhánek 079f419e54 Fixes bug introduced in #1499 preventing load_from_checkpoint to work correctly (#1501)
* Call load_state_dict on model classes

* Fixing bug introduced in #1499
2023-02-25 08:06:08 -08:00
Jonáš Kulhánek 93359b131e Call load_state_dict on model classes (#1499) 2023-02-25 08:00:04 +01:00
Jonáš Kulhánek 7e9af33c03 ns-process-data: fix image renaming for the --skip-colmap case (#1459)
* Fix ns-process-data with skip colmap

* Fix docstring

* Fix pylint problem

* Change OrderedDict to dict
2023-02-24 20:40:52 -08:00
Saurav Maheshkar a28442a82c chore: delete setup.cfg (#1495)
Fixes #1489
2023-02-24 11:18:58 -08:00
Ruilong Li(李瑞龙) 3933589b94 bump nerfacc to 0.3.5 (#1492) 2023-02-24 11:17:21 -08:00
Jingchen Ye e0ad53762e Rename train_split_percentage with train_split_fraction (#1497)
rename train_split_percentage with train_split_fraction
2023-02-24 11:16:37 -08:00
Matthew Tancik 1a2bbc5725 Add extensions tab (#1488) 2023-02-23 16:04:57 -08:00
Matthew Tancik a3a1b1f667 Fix relative argument (#1487) 2023-02-23 09:31:24 -08:00
Nikhil Mohanandmachenmusik a91b92f89d semantic_nerfw_configurability (#1467)
* fix semseg vis

* semantic configs

* change defaults

* Fix type

* format

* fix imports

* suggested fix for issue 1465

* fix docstring placement; avoid log spam and runtime errors

`nerfstudio\models\semantic_nerfw.py:81: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
  self.colormap = torch.tensor(self.semantics.colors).to(self.device)`

* hide semantics output choice, since it kills the viewer

* revert some changes

* caps

* move both image and mask to GPU to avoid runtime error

as suggested in https://github.com/nerfstudio-project/nerfstudio/issues/1465#issuecomment-1441117562

---------

Co-authored-by: machenmusik <machenmusik@users.noreply.github.com>
2023-02-22 22:21:04 -05:00
Matthew Tancik 69fdc7db9c Datamanager eval fix (#1482)
* Fix datamanager

* Datamanager tweak

* Hopefully fixed now

* readd comment
2023-02-22 16:53:23 -08:00
Jake AustinandMatthew Tancik 50dc5d6cd7 Triplanes (#1456)
* Triplanes working

* Doing the TODOs, better variable names

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-02-22 16:23:12 -08:00
Matthew Tancik 9e68a46abe Fix datamanager (#1481) 2023-02-22 16:08:53 -08:00
Matthew Tancik ba161a2234 Update blender_addon.md 2023-02-22 15:33:33 -08:00
Nicolas ZunhammerandNicolas Zunhammer 4d333f4cb6 [Update] Add hloc to Dockerfile, bump version of docker image in dev-container, improve docs (#1478)
* Add hloc to Dockerfile, bump versions of docker release.

* Add missing dependency for pycolmap.

* Improve commenting.

---------

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2023-02-22 21:44:53 +01:00
Matthew Tancik 27eb33f491 Enable viewer with eval (#1474) 2023-02-22 10:21:55 -08:00
Ethan Weber 3066819241 Fix eval dataloader to use eval ray generator (#1473)
fix eval ray generator
2023-02-22 09:53:42 -08:00
Matthew Tancik 0d336a181e Update exponential scheduler (#1468) 2023-02-21 16:09:38 -08:00
Matthew Tancik f3a34bbf95 Refactor schedulers (#1466)
* Refactor schedulers

* lint

* lint
2023-02-21 12:51:51 -08:00
Dreek Fire 53e99c396b Add Windows installation tips to quickstart. (#1427)
* add hashmap size and num_levels to instant_ngp_field, issue 1158

* Add Windows installation tips to quickstart

* Include notes for CUDA 11.7

* separate duplicate targets in installation.md

* change installation page to use tabs
2023-02-21 09:24:09 -08:00
Sacha Lewin 151b1060fe Uniform Sampler in Nerfacto (#1464)
* Allow black/white background color in Nerfacto

* Use white background in Nerfacto Blender Benchmark

* Fixed unused import

* Updated index for license headers script

* Removed debug code in NGP models

* Uniform initial sampler config in Nerfacto

* Undo changes in settings.json

* Removed unwanted settings file

* Removed unneeded config parameter

* Use uniform sampler on Blender benchmark
2023-02-21 09:17:57 -08:00
796fad8bcb Equirectangular input (#1446)
* started adding equirectangular to process_data

* was multiplying frame by 255 twice

* added equi2planar configs for the 3 presets

* fixed presets

* setup process data

* changed variable name and comment

* fixed middle preset

* removed third preset

* added progress bar and fixed video for equirectangular input

* fixed whitespace stuff

* added pyequilib dependencey

* Updated for JPG support for equirectangular image input

Updated process_data_utils for JPG support for equirectangular image input, since even though .jpg images worked, .JPG images (output from 360 camera software) were not working.

* changed file type matching

* added equirect utils

* added license header

* added docstring on equirect utils

* added heuristic for image size

* added heuristic for videos

* fixed linty stuff

* shortened code

* raised error if no ims in directory

* Updated ProcessVideo for fixing directories for equirectangular input

Updated the ProcessVideo for equirectangular input to make the image directory have the correct perspective projections. The original equirectangular images are copied into a temp_images folder which also holds the perspective projections. This folder is deleted once the perspective projections are copied into the process data images folder.

---------

Co-authored-by: cvachha <cyrus.vachha@yahoo.com>
Co-authored-by: cvachha <cvachha549@gmail.com>
2023-02-20 10:58:42 -08:00
Matthew TancikandDavid McAllister 36514797fd Support multiple versions of stable diffusion (#1461)
Co-authored-by: David McAllister <davidrmc2@gmail.com>
2023-02-20 10:12:41 -08:00
Alexander Kristoffersen f8e8d8266e Patch Sampling (#1458)
* patch sampling.

* changed str to literal.

* clean up sample selector.
2023-02-19 22:14:27 -08:00
Matthew Tancik e2dadc20ab v0.1.18 (#1455) v0.1.18 2023-02-19 14:49:59 -08:00
Matthew Tancik e89d113ddc Fix colmap bug when not all images are matched (#1454)
Fix colmap when not 100 matching
2023-02-19 14:48:31 -08:00
Matthew Tancik ceda935e64 Fix depth nerfacto exporting (#1453) 2023-02-19 13:53:01 -08:00
Matthew Tancik 73f0f5a16a Fix mesh export normals (#1452)
* Fix mesh export normals

* lint
2023-02-19 13:43:43 -08:00
Nicolas ZunhammerandNicolas Zunhammer 2901e5f31a Bump Dockerfile versions, add user to sudoers list. (#1448)
* Update Dockerfile, bump CUDA from 11.7.1 to 11.8.0, bump Colmap from 3.7 to 3.8, add user to sudoers list.

* Improve description.

* Fix wrong description and typos.

* Add better description.

* Fix build error of Dockerfile.

* Bump pytorch versions.

---------

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2023-02-19 13:58:33 +01:00
Matthew Tancik df0f3205f4 Add ns-viewer docs (#1450) 2023-02-18 19:03:46 -08:00
Matthew Tancik 15dfc68453 Delete nerfstudio/.vscode directory
Added by mistake.
2023-02-18 17:13:46 -08:00
Sacha Lewin 8e4ae6bebf Allow use of black or white background in Nerfacto models (#1441)
* Allow black/white background color in Nerfacto

* Use white background in Nerfacto Blender Benchmark

* Fixed unused import

* Updated index for license headers script
2023-02-17 20:39:10 -08:00
Matthew Tancik 2357332e66 Proposal network initial sampler (#1435)
Allow first proposal sampling method
2023-02-15 15:35:08 -08:00