Commit Graph
1406 Commits
Author SHA1 Message Date
Matt Tancik 207959da16 Warmups 2023-02-21 17:12:23 -08:00
Matt Tancik 77d15f9b74 Merge remote-tracking branch 'origin' into generative 2023-02-21 16:20:58 -08:00
Matthew Tancik 0d336a181e Update exponential scheduler (#1468) 2023-02-21 16:09:38 -08:00
Matthew Tancik f3a34bbf95 Refactor schedulers (#1466)
* Refactor schedulers

* lint

* lint
2023-02-21 12:51:51 -08:00
Matt Tancik 293ae8d643 Fix test 2023-02-21 09:51:46 -08:00
Dreek Fire 53e99c396b Add Windows installation tips to quickstart. (#1427)
* add hashmap size and num_levels to instant_ngp_field, issue 1158

* Add Windows installation tips to quickstart

* Include notes for CUDA 11.7

* separate duplicate targets in installation.md

* change installation page to use tabs
2023-02-21 09:24:09 -08:00
Sacha Lewin 151b1060fe Uniform Sampler in Nerfacto (#1464)
* Allow black/white background color in Nerfacto

* Use white background in Nerfacto Blender Benchmark

* Fixed unused import

* Updated index for license headers script

* Removed debug code in NGP models

* Uniform initial sampler config in Nerfacto

* Undo changes in settings.json

* Removed unwanted settings file

* Removed unneeded config parameter

* Use uniform sampler on Blender benchmark
2023-02-21 09:17:57 -08:00
Matt Tancik 410b981205 cleanup 2023-02-20 18:12:18 -08:00
796fad8bcb Equirectangular input (#1446)
* started adding equirectangular to process_data

* was multiplying frame by 255 twice

* added equi2planar configs for the 3 presets

* fixed presets

* setup process data

* changed variable name and comment

* fixed middle preset

* removed third preset

* added progress bar and fixed video for equirectangular input

* fixed whitespace stuff

* added pyequilib dependencey

* Updated for JPG support for equirectangular image input

Updated process_data_utils for JPG support for equirectangular image input, since even though .jpg images worked, .JPG images (output from 360 camera software) were not working.

* changed file type matching

* added equirect utils

* added license header

* added docstring on equirect utils

* added heuristic for image size

* added heuristic for videos

* fixed linty stuff

* shortened code

* raised error if no ims in directory

* Updated ProcessVideo for fixing directories for equirectangular input

Updated the ProcessVideo for equirectangular input to make the image directory have the correct perspective projections. The original equirectangular images are copied into a temp_images folder which also holds the perspective projections. This folder is deleted once the perspective projections are copied into the process data images folder.

---------

Co-authored-by: cvachha <cyrus.vachha@yahoo.com>
Co-authored-by: cvachha <cvachha549@gmail.com>
2023-02-20 10:58:42 -08:00
Matthew TancikandDavid McAllister 36514797fd Support multiple versions of stable diffusion (#1461)
Co-authored-by: David McAllister <davidrmc2@gmail.com>
2023-02-20 10:12:41 -08:00
Matt Tancik 8754beeb85 cleanup 2023-02-20 10:05:09 -08:00
Matt Tancik 36be1fe4b0 Merge remote-tracking branch 'origin' into generative 2023-02-20 09:48:41 -08:00
Alexander Kristoffersen f8e8d8266e Patch Sampling (#1458)
* patch sampling.

* changed str to literal.

* clean up sample selector.
2023-02-19 22:14:27 -08:00
Matthew Tancik e2dadc20ab v0.1.18 (#1455) v0.1.18 2023-02-19 14:49:59 -08:00
Matthew Tancik e89d113ddc Fix colmap bug when not all images are matched (#1454)
Fix colmap when not 100 matching
2023-02-19 14:48:31 -08:00
Matthew Tancik ceda935e64 Fix depth nerfacto exporting (#1453) 2023-02-19 13:53:01 -08:00
Matthew Tancik 73f0f5a16a Fix mesh export normals (#1452)
* Fix mesh export normals

* lint
2023-02-19 13:43:43 -08:00
Nicolas ZunhammerandNicolas Zunhammer 2901e5f31a Bump Dockerfile versions, add user to sudoers list. (#1448)
* Update Dockerfile, bump CUDA from 11.7.1 to 11.8.0, bump Colmap from 3.7 to 3.8, add user to sudoers list.

* Improve description.

* Fix wrong description and typos.

* Add better description.

* Fix build error of Dockerfile.

* Bump pytorch versions.

---------

Co-authored-by: Nicolas Zunhammer <n.zunhammer@tum.de>
2023-02-19 13:58:33 +01:00
Matthew Tancik df0f3205f4 Add ns-viewer docs (#1450) 2023-02-18 19:03:46 -08:00
Matthew Tancik 15dfc68453 Delete nerfstudio/.vscode directory
Added by mistake.
2023-02-18 17:13:46 -08:00
Sacha Lewin 8e4ae6bebf Allow use of black or white background in Nerfacto models (#1441)
* Allow black/white background color in Nerfacto

* Use white background in Nerfacto Blender Benchmark

* Fixed unused import

* Updated index for license headers script
2023-02-17 20:39:10 -08:00
terrance a474aa3fb8 add stable diff utils 2023-02-17 00:16:25 +00:00
Matt Tancik 52ab319953 Update configs 2023-02-16 15:45:54 -08:00
terrance b89883562d merging + remove dreamfusion pipeline file 2023-02-16 23:11:57 +00:00
terrance 8e9d5310bd update sd 2023-02-16 23:05:18 +00:00
terrance ca767bc9c7 remove dreamfusion pipeline file 2023-02-16 23:03:43 +00:00
mcallisterdavid c81e24bd5a Choose your own diffusion 2023-02-16 02:37:31 +00:00
terrance ce0d97f811 merging 2023-02-16 00:55:49 +00:00
terrance 72d9642d6a add prompt edditing to viewer 2023-02-16 00:49:40 +00:00
Matthew Tancik 2357332e66 Proposal network initial sampler (#1435)
Allow first proposal sampling method
2023-02-15 15:35:08 -08:00
Matt Tancik 4db2410b40 Fix opacity loss, use unform sampling first round of prop 2023-02-15 13:43:49 -08:00
Pablo Vela 6619dd1ac2 add monosdf normal loss and midas scale invariant depth loss (#1410)
* add monosdf normal loss and midas scale invariant depth loss

* add context to scale/shift calc and normal loss, consolidate MidasMSE loss

* consolidated, add info on gradient reg term

* add info on ssi

* more documentation and type annotation

* move compute scale/shift to class

* fix pylint errors

* fix tensortype error

* fix comments

* change single var name and update comment

* fix input tensortype

* fix black error

* fix mask shape
2023-02-15 13:49:35 -06:00
Matthew Tancik be5274db09 Add arxiv link (#1434) 2023-02-15 10:05:18 -08:00
Jonáš Kulhánek 97498e3223 Improve ns-install-cli (#1396)
* Improve ns-install-cli

* Remove unused code

* ns-install-cli conda specify encoding explicitly

* Fix missing directory in ns-install-cli

* Implement ns-install-cli deactivate for conda env

* ns-install-cli: conda create deactivate.d
2023-02-15 17:46:55 +01:00
Pablo Vela 78eeb3bfe8 devcontainer for VSCode development (#1428)
add devcontainer for easy development in VSCode
2023-02-14 18:57:55 -06:00
Matt Tancik 06ec4bd982 Update configs 2023-02-14 14:37:03 -08:00
Matt Tancik b79aa04b62 Cleanup 2023-02-14 10:39:45 -08:00
Matt Tancik 0a8ae2fe59 Merge remote-tracking branch 'origin' into generative 2023-02-14 10:38:40 -08:00
NCJ 2878aff1c5 Fix LPIPS data range (#1425) 2023-02-14 10:18:33 -08:00
Matthew Tancik 71fd9f7245 Update SDS loss (#1426) 2023-02-14 10:14:48 -08:00
Matt Tancik caa914830a Fix CFG 2023-02-14 09:46:34 -08:00
Matt Tancik b8d99713f3 SDS return loss 2023-02-14 09:38:54 -08:00
machenmusik 9c5423f181 Update to allow pytorch (and functorch) 1.13.1 (#1390)
* Update pytorch (and functorch) to 1.13.1

Note that for existing installations, the following is recommended due to complications with older versions of functorch:
- `pip uninstall torch torchvision functorch`
- install the correct pytorch 1.13.1 version for your CUDA installation from https://pytorch.org/get-started/locally/ but add functorch to the command -- for example, Windows CUDA 11.7 would be `pip3 install torch torchvision functorch--extra-index-url https://download.pytorch.org/whl/cu117`
- reinstall nerfstudio e.g. `pip install -e .` from the source directory

* Update installation.md

* Allow 1.13.1, don't force

* pytorch 1.12.1 and 1.13.1

* Update README.md

* Update installation.md
2023-02-14 08:59:26 -05:00
David McAllister 76e5bd9b46 Remove Dreamfusion Trainer (#1423)
* Dreamfusion trainer no longer needed

* Added typing for grad scaler
2023-02-13 22:15:13 -08:00
terrance 69b98459a5 add option to use random bg color + bg mlp 2023-02-13 21:05:55 +00:00
Matthew Tancik 9808ebbcb8 v0.1.17 (#1409) v0.1.17 2023-02-12 11:14:12 -08:00
Matthew Tancik 2b52f51b88 Downgrade nerfacc to 0.3.3 (#1408)
reset nerfacc to 0.3.3
2023-02-12 11:05:59 -08:00
Pablo Vela a37c73fb07 sdfstudio dataparser/dataset (#1381)
* add downloads for sdfstudio datasets

* add sdfstudio parser to work with sdfstudio data

* fix licensing and doc strings

* fix linter errors

* move depths/normals to metadata, create sdfdataset

* remove extra scenebox parameters

* more linting errors fix

* fix wrong annotation

* add in missing depth/normal files

* minor fixes

---------
2023-02-12 10:31:31 -08:00
Matthew Tancik 71eacd5932 Update reality capture doc (#1404) 2023-02-11 10:51:22 -08:00
Mark Colley 259f3aa4dd Fix IPython error display (#1397) 2023-02-10 15:30:57 -08:00