Commit Graph
1077 Commits
Author SHA1 Message Date
Matthew Tancik 4065bb4733 Add Metashape support (#989)
Add metashape support
2022-11-20 14:55:41 -08:00
b829499c12 Computing and predicting normals (#905)
* staring normals PR

* code runs but visualization looks bad

* Camera and world coordinate conventions (#889)

* documented coordinate conventions without a figure for now

* another sentence

* update frames docs

* explain intrinsics and extrinsics

* more comments

* fix build

* Start viewer with more accurate speed calculation (#899)

Start viewer with more accurate speed calc

* Minor doc updates (#903)

* fix conflicts

* code runs but visualization looks bad

* normals implemented and vis fixed. still debugging quality

* minor name change

* comment

* fix black

* lint

* predicting normals

* adding detach

* predicted normals

* improved normals prediction performance

* cleaning code

* cleaning code

* cleaning code

* adding type to function param

* fixing tensorf forward func

* reverting tensorf changes

* fix style with tensorf field

* adding normals check to tensorffield

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
Co-authored-by: terrance <terrance.3512@gmail.com>
2022-11-20 13:22:37 -08:00
Nikhil Mohan a82d19f549 Support downsample in dataset (#973)
* init

* tests passing

* pass through arguments

* verbose

* remove debug prints

* switch to bilinear

* update viewer

* make parser outputs private

* change name
2022-11-19 17:06:34 +00:00
Matthew Tancik aaaa2fa393 Simplify readme (#982)
* Simplify readme

* Cleanup
2022-11-18 20:56:37 -08:00
Matthew Tancik 532f8067fd Refactor process data (#976) 2022-11-18 09:19:44 -08:00
Matthew Tancik 1f85a31120 Update viewer sensitivity (#975) 2022-11-17 21:54:34 -08:00
Matthew Tancik 54d822afcc v0.1.10 (#974) v0.1.10 2022-11-17 10:17:52 -08:00
Matthew Tancik 009e21be24 Fix loading in inference mode (#965) 2022-11-15 21:06:54 -08:00
Matthew Tancik 95a27ecba5 Add support for polycam (#958)
* Add support for polycam

* Modify blur score

* Support processing zip and add undistort fallback

* Created using Colaboratory

* Update docs

* Update demo.ipynb

* Address comments

* fix lint
2022-11-15 17:55:29 -08:00
Matthew Tancik a7b2af185c Cleanup configs (#963) 2022-11-15 16:56:56 -08:00
Alexander Kristoffersen 9ee6c31c02 Small Typos (#960)
small typos.
2022-11-15 14:59:31 -08:00
Julian KnodtandMatthew Tancik 9ff167d705 Add temporal distortion and D-NeRF model (#825)
* Add D-NeRF temporal distortion and D-NeRF model

This allows for temporal distortion to be enabled on a variety of models through config
parameters, without an explicit model. Temporal distortion and MIP-NeRF are not currently
jointly runnable but can be changed in the future.

* Simplifying changes

* Simplifying changes

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-15 14:29:29 -08:00
dependabot[bot] 8678f4c2e6 Bump loader-utils from 2.0.2 to 2.0.4 in /nerfstudio/viewer/app (#962)
Bumps [loader-utils](https://github.com/webpack/loader-utils) from 2.0.2 to 2.0.4.
- [Release notes](https://github.com/webpack/loader-utils/releases)
- [Changelog](https://github.com/webpack/loader-utils/blob/v2.0.4/CHANGELOG.md)
- [Commits](https://github.com/webpack/loader-utils/compare/v2.0.2...v2.0.4)

---
updated-dependencies:
- dependency-name: loader-utils
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-15 14:11:51 -08:00
Matthew Tancik 6baf31dc9a Fix python 3.7 support (#959) 2022-11-15 09:51:23 -08:00
Nikhil Mohan b5c34f0154 Add 'inference' mode to pipeline (#956)
* cleanup test mode

* cleanup eval loading

* change default

* cleanup

* cleanup

* comment
2022-11-14 16:56:36 +00:00
Matthew Tancik b67f96fc56 Filter torchvision warnings (#954) 2022-11-12 18:23:24 -08:00
Matthew Tancik 5b0f1ffacb Remove unimplemented interp render option (#953) 2022-11-12 17:18:11 -08:00
Alexander Kristoffersen 57d56efb1e Colab hotfix: forgot glob import (#952)
Created using Colaboratory
2022-11-12 15:45:53 -08:00
Zak Murezandzmurez 6ea7dbf934 NuScenes dataparser (#939)
* nuscenes dataparser

* cleanup

* style

* cleanup

* cleanup

* cleanup

Co-authored-by: zmurez <zmurez@eng.ucsd.edu>
2022-11-11 18:40:36 -08:00
Alexander Kristoffersen fdbeb2ae31 Streamline Viewer in Colab, added more checks before training (#947)
Created using Colaboratory
2022-11-11 15:27:57 -08:00
Matthew Tancik 2656e5653e Update viewer docs (#950) 2022-11-11 15:17:52 -08:00
Matthew Tancik 714d6c96b4 Dont crash on invalid websocket (#949) 2022-11-11 15:11:36 -08:00
Matthew Tancik 50f9895f1a Add flag to kill training when complete (#948) 2022-11-11 11:38:36 -08:00
Matthew Tancik 36b514fc20 Update viewer zoom sensitivity (#945) 2022-11-11 10:54:55 -08:00
Matthew Tancik 0271c7ded8 Update docs (#944) 2022-11-11 08:58:53 -08:00
Matthew Tancik f964e0dfe4 v0.1.9 (#941) v0.1.9 2022-11-10 22:50:44 -08:00
Matthew Tancik 0a5331fc5c Add pointcloud export panel to UI (#938)
Add export panel to UI
2022-11-10 22:49:32 -08:00
Matthew Tancik d4119d4086 Add exporting docs (#940) 2022-11-10 22:01:21 -08:00
Alexander Kristoffersen 4cf13857d0 Record3D added to Colab (#926)
* record3d added to colab.

* Created using Colaboratory

* Created using Colaboratory
2022-11-10 17:32:42 -08:00
Brent YiandEthan Weber ad8599aad0 Add missing __init__.py files (#935)
* Add missing __init__.py files

* fixing lint

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-11-10 16:56:13 -08:00
Matthew Tancik 4b65180a57 Add missing activation (#933) 2022-11-10 13:27:10 -08:00
Kevin Chen 3e52aebd9a Do not apply activation for last MLP layer (#932) 2022-11-10 10:08:02 -08:00
Matthew Tancik 3833e4de56 Missing mlp output activation (#930) 2022-11-09 22:54:04 -08:00
Matthew Tancik ee6b007155 Avoid boolean flag auto conversion (#929) 2022-11-09 20:23:05 -08:00
Matthew Tancik c5c980dd4d Add viewport controls help modal (#927) 2022-11-09 11:45:53 -08:00
Matthew Tancik 8d3640c6a1 Support exporting point clouds (#924)
* Support exporting point clouds

* Fix typing

* lint

* Update requirements
2022-11-08 22:23:06 -08:00
Abhik Ahuja 3a056ed622 Fixed crash when camera looping is on, but no cameras (#922)
Fixed camera cycle crash
2022-11-07 22:45:00 -08:00
David McAllister c325e90a8e 3D Viewer Displays cameras' Chosen Names (#920)
3D viewer displays cameras' chosen names
2022-11-07 22:36:53 -08:00
Matthew Tancik 28b86f8718 Allow specifying colmap path (#917) 2022-11-07 12:11:10 -08:00
Nikhil MohanandMatthew Tancik b978209858 [WIP] nan-training-debug (#910)
* add repro

* update eps

* lint

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-07 10:53:30 -08:00
Nail Ibrahimli a6de0f5f60 fixing typos (#915) 2022-11-07 10:34:15 -08:00
Matthew Tancik 49e89365bc Add training finished statement (#914) 2022-11-06 22:55:50 -08:00
39462e78b5 Camera Controls Overhaul (FOV + Keyframing) (#792)
* Fov interpolation, FOV/focal length switch, better bounds detection

* Camera reordering

* Progress on expandable camera panels

* Fixed console errors from clickable cameras

* Enumerations for FOV options

* Updated render camera controls

* Removed console logs

* Minor ui changes, fov changes again

* Linting

* Cleaned up code, bug fixes

* Use Three.js functions for fov/focal length

* Temp fix for ui field of view

* Some duplicate imports removed

* Fixed merge

* Added explicit edit button

* Added tooltip for fov/focal length

* Cleaned up console

* Keyframe interface, won't render

* Keyframe interpolation works

* Better default keyframes

* lint

* Style

* Keyframe timing outputs to camera path

* Focal length label bug fix, visual updates

* Fixed looping with keyframes

* Replace linear toggle with reset keyframes button

* UI updates

* remove comment

* Save and load properties from json

* Added VanillaJS-React state sharing

* Lint

* Lint 2

* Animate button functionally working

* Interface improvements

* Animation Button Styling Fixed

* Better animation button styling

* Updated disabled color

* Changed animate color to blue

* Viewport fov does not change

* Fixed merge conflict regression

* Disabled text is now blue

* Fixed FOV interpolation

Co-authored-by: mcallisterdavid <davidrmc2@gmail.com>
Co-authored-by: Matt Tancik <tancik@berkeley.edu>
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-11-06 19:38:49 -08:00
Terrance WangandMatthew Tancik b86a21caf2 Terrance/camera controls (#748)
* adding keyboard camera control instructions to viewer

* adding orbit / fps controls

* adding button to toggle first person cams and orbit cam, spacebar resets view dir and position now

* renaming button

* getting started element now scrolls, adding instructions for camera controls

* fixed first person bug, removed orbit controls

* fixing style

* fixed mouse controls w viewer

* adjust rotate speed

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-06 14:38:52 -08:00
Matthew Tancik a13c10ba61 Use tan instead of tanh (#913) 2022-11-06 12:42:30 -08:00
Nikhil Mohan 1a24f3e58c Refactor Data Pipeline (#896)
* add none check

* black formatting

* cleanup

* cleanup

* fix tests

* remove new line

* init

* toy example working

* semantic nerf working

* simplify pixel samplers

* cleanup + fix tests

* comments

* fix tests

* fix tests
2022-11-06 07:40:43 -08:00
Matthew Tancik 761645de05 Minor doc updates (#903) 2022-11-05 22:00:28 -07:00
Matthew Tancik 71601f304f Start viewer with more accurate speed calculation (#899)
Start viewer with more accurate speed calc
2022-11-04 17:30:29 -07:00
Ethan Weber 93839ca3f0 Camera and world coordinate conventions (#889)
* documented coordinate conventions without a figure for now

* another sentence

* update frames docs

* explain intrinsics and extrinsics

* more comments

* fix build
2022-11-04 17:18:14 -07:00
Matthew Tancik afd6fec6e7 Add docs for nerfacto (#891) 2022-11-03 16:45:00 -07:00