Commit Graph
1068 Commits
Author SHA1 Message Date
Matthew Tancik a7b2af185c Cleanup configs (#963) 2022-11-15 16:56:56 -08:00
Alexander Kristoffersen 9ee6c31c02 Small Typos (#960)
small typos.
2022-11-15 14:59:31 -08:00
Julian KnodtandMatthew Tancik 9ff167d705 Add temporal distortion and D-NeRF model (#825)
* Add D-NeRF temporal distortion and D-NeRF model

This allows for temporal distortion to be enabled on a variety of models through config
parameters, without an explicit model. Temporal distortion and MIP-NeRF are not currently
jointly runnable but can be changed in the future.

* Simplifying changes

* Simplifying changes

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-15 14:29:29 -08:00
dependabot[bot] 8678f4c2e6 Bump loader-utils from 2.0.2 to 2.0.4 in /nerfstudio/viewer/app (#962)
Bumps [loader-utils](https://github.com/webpack/loader-utils) from 2.0.2 to 2.0.4.
- [Release notes](https://github.com/webpack/loader-utils/releases)
- [Changelog](https://github.com/webpack/loader-utils/blob/v2.0.4/CHANGELOG.md)
- [Commits](https://github.com/webpack/loader-utils/compare/v2.0.2...v2.0.4)

---
updated-dependencies:
- dependency-name: loader-utils
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-15 14:11:51 -08:00
Matthew Tancik 6baf31dc9a Fix python 3.7 support (#959) 2022-11-15 09:51:23 -08:00
Nikhil Mohan b5c34f0154 Add 'inference' mode to pipeline (#956)
* cleanup test mode

* cleanup eval loading

* change default

* cleanup

* cleanup

* comment
2022-11-14 16:56:36 +00:00
Matthew Tancik b67f96fc56 Filter torchvision warnings (#954) 2022-11-12 18:23:24 -08:00
Matthew Tancik 5b0f1ffacb Remove unimplemented interp render option (#953) 2022-11-12 17:18:11 -08:00
Alexander Kristoffersen 57d56efb1e Colab hotfix: forgot glob import (#952)
Created using Colaboratory
2022-11-12 15:45:53 -08:00
Zak Murezandzmurez 6ea7dbf934 NuScenes dataparser (#939)
* nuscenes dataparser

* cleanup

* style

* cleanup

* cleanup

* cleanup

Co-authored-by: zmurez <zmurez@eng.ucsd.edu>
2022-11-11 18:40:36 -08:00
Alexander Kristoffersen fdbeb2ae31 Streamline Viewer in Colab, added more checks before training (#947)
Created using Colaboratory
2022-11-11 15:27:57 -08:00
Matthew Tancik 2656e5653e Update viewer docs (#950) 2022-11-11 15:17:52 -08:00
Matthew Tancik 714d6c96b4 Dont crash on invalid websocket (#949) 2022-11-11 15:11:36 -08:00
Matthew Tancik 50f9895f1a Add flag to kill training when complete (#948) 2022-11-11 11:38:36 -08:00
Matthew Tancik 36b514fc20 Update viewer zoom sensitivity (#945) 2022-11-11 10:54:55 -08:00
Matthew Tancik 0271c7ded8 Update docs (#944) 2022-11-11 08:58:53 -08:00
Matthew Tancik f964e0dfe4 v0.1.9 (#941) v0.1.9 2022-11-10 22:50:44 -08:00
Matthew Tancik 0a5331fc5c Add pointcloud export panel to UI (#938)
Add export panel to UI
2022-11-10 22:49:32 -08:00
Matthew Tancik d4119d4086 Add exporting docs (#940) 2022-11-10 22:01:21 -08:00
Alexander Kristoffersen 4cf13857d0 Record3D added to Colab (#926)
* record3d added to colab.

* Created using Colaboratory

* Created using Colaboratory
2022-11-10 17:32:42 -08:00
Brent YiandEthan Weber ad8599aad0 Add missing __init__.py files (#935)
* Add missing __init__.py files

* fixing lint

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-11-10 16:56:13 -08:00
Matthew Tancik 4b65180a57 Add missing activation (#933) 2022-11-10 13:27:10 -08:00
Kevin Chen 3e52aebd9a Do not apply activation for last MLP layer (#932) 2022-11-10 10:08:02 -08:00
Matthew Tancik 3833e4de56 Missing mlp output activation (#930) 2022-11-09 22:54:04 -08:00
Matthew Tancik ee6b007155 Avoid boolean flag auto conversion (#929) 2022-11-09 20:23:05 -08:00
Matthew Tancik c5c980dd4d Add viewport controls help modal (#927) 2022-11-09 11:45:53 -08:00
Matthew Tancik 8d3640c6a1 Support exporting point clouds (#924)
* Support exporting point clouds

* Fix typing

* lint

* Update requirements
2022-11-08 22:23:06 -08:00
Abhik Ahuja 3a056ed622 Fixed crash when camera looping is on, but no cameras (#922)
Fixed camera cycle crash
2022-11-07 22:45:00 -08:00
David McAllister c325e90a8e 3D Viewer Displays cameras' Chosen Names (#920)
3D viewer displays cameras' chosen names
2022-11-07 22:36:53 -08:00
Matthew Tancik 28b86f8718 Allow specifying colmap path (#917) 2022-11-07 12:11:10 -08:00
Nikhil MohanandMatthew Tancik b978209858 [WIP] nan-training-debug (#910)
* add repro

* update eps

* lint

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-07 10:53:30 -08:00
Nail Ibrahimli a6de0f5f60 fixing typos (#915) 2022-11-07 10:34:15 -08:00
Matthew Tancik 49e89365bc Add training finished statement (#914) 2022-11-06 22:55:50 -08:00
39462e78b5 Camera Controls Overhaul (FOV + Keyframing) (#792)
* Fov interpolation, FOV/focal length switch, better bounds detection

* Camera reordering

* Progress on expandable camera panels

* Fixed console errors from clickable cameras

* Enumerations for FOV options

* Updated render camera controls

* Removed console logs

* Minor ui changes, fov changes again

* Linting

* Cleaned up code, bug fixes

* Use Three.js functions for fov/focal length

* Temp fix for ui field of view

* Some duplicate imports removed

* Fixed merge

* Added explicit edit button

* Added tooltip for fov/focal length

* Cleaned up console

* Keyframe interface, won't render

* Keyframe interpolation works

* Better default keyframes

* lint

* Style

* Keyframe timing outputs to camera path

* Focal length label bug fix, visual updates

* Fixed looping with keyframes

* Replace linear toggle with reset keyframes button

* UI updates

* remove comment

* Save and load properties from json

* Added VanillaJS-React state sharing

* Lint

* Lint 2

* Animate button functionally working

* Interface improvements

* Animation Button Styling Fixed

* Better animation button styling

* Updated disabled color

* Changed animate color to blue

* Viewport fov does not change

* Fixed merge conflict regression

* Disabled text is now blue

* Fixed FOV interpolation

Co-authored-by: mcallisterdavid <davidrmc2@gmail.com>
Co-authored-by: Matt Tancik <tancik@berkeley.edu>
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-11-06 19:38:49 -08:00
Terrance WangandMatthew Tancik b86a21caf2 Terrance/camera controls (#748)
* adding keyboard camera control instructions to viewer

* adding orbit / fps controls

* adding button to toggle first person cams and orbit cam, spacebar resets view dir and position now

* renaming button

* getting started element now scrolls, adding instructions for camera controls

* fixed first person bug, removed orbit controls

* fixing style

* fixed mouse controls w viewer

* adjust rotate speed

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-06 14:38:52 -08:00
Matthew Tancik a13c10ba61 Use tan instead of tanh (#913) 2022-11-06 12:42:30 -08:00
Nikhil Mohan 1a24f3e58c Refactor Data Pipeline (#896)
* add none check

* black formatting

* cleanup

* cleanup

* fix tests

* remove new line

* init

* toy example working

* semantic nerf working

* simplify pixel samplers

* cleanup + fix tests

* comments

* fix tests

* fix tests
2022-11-06 07:40:43 -08:00
Matthew Tancik 761645de05 Minor doc updates (#903) 2022-11-05 22:00:28 -07:00
Matthew Tancik 71601f304f Start viewer with more accurate speed calculation (#899)
Start viewer with more accurate speed calc
2022-11-04 17:30:29 -07:00
Ethan Weber 93839ca3f0 Camera and world coordinate conventions (#889)
* documented coordinate conventions without a figure for now

* another sentence

* update frames docs

* explain intrinsics and extrinsics

* more comments

* fix build
2022-11-04 17:18:14 -07:00
Matthew Tancik afd6fec6e7 Add docs for nerfacto (#891) 2022-11-03 16:45:00 -07:00
Matthew Tancik cda22ce606 v0.1.8 (#890) v0.1.8 2022-11-03 12:24:28 -07:00
Alexander Kristoffersen 0afcd1774b Record3D Dataparser moved to ns-process-data script. (#872)
* init commit.

* added docstring.

* added tyro command.

* bugfix.

* added max dataset size logic.

* string cleanup.

* updated depracation warning.

* typo.
2022-11-03 10:43:52 -07:00
Matthew Tancik 121771d126 Update render UI (#885)
* Update render UI

* update text
2022-11-02 22:17:45 -07:00
Terrance WangandMatthew Tancik 7106f42fcc tensorf (#586)
* tensorf wip

* model changes

* tuning model

* changing imports

* merging

* changing rff encoding to nerfencoding, basis matrix should be properly updated, changed density activation, lr scheduler

* debugging tensorf

* debugging tensorf

* tensorf debugging

* tensorf debugging

* tensorf debugging

* tensorf debug

* debugging tensorf, fixed bug with collider

* tuning model, ray sampling

* adding thresholding for ray computations

* removing unused imports

* making more params configurable in config, adding spherical harmonics

* removing scene contraction, adding arg docstrings

* fixing style

* Fixing bug

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-02 14:32:03 -07:00
Julian Knodt 35610cb9e2 DNeRF Data Parser (#817)
* Add dnerf dataparser

* Switch time to be stored per camera

I realized it would be better downstream to store times on the ray bundle, and in order to store
them on the ray bundle it's much easier to store them on the camera. Rather than having to
revert this change, I just made it here.
2022-11-02 12:23:13 -07:00
Nikhil Mohan 6f158a3e68 add correct none check to distortion params (#878)
* add none check

* black formatting
2022-11-02 10:20:26 -07:00
Daniel Crispell c53df92b9c disallow fars <= nears (#881) 2022-11-02 10:04:04 -07:00
Terrance Wang be70b86b18 remove sf street (#876) 2022-11-01 16:58:23 -07:00
Matthew Tancik ca69adaaec Add median depth calculation (#877)
* Add median depth calculation

* lint

* Fix test
2022-11-01 15:05:16 -07:00