Commit Graph
123 Commits
Author SHA1 Message Date
Matthew Tancik 8d3640c6a1 Support exporting point clouds (#924)
* Support exporting point clouds

* Fix typing

* lint

* Update requirements
2022-11-08 22:23:06 -08:00
Abhik Ahuja 3a056ed622 Fixed crash when camera looping is on, but no cameras (#922)
Fixed camera cycle crash
2022-11-07 22:45:00 -08:00
David McAllister c325e90a8e 3D Viewer Displays cameras' Chosen Names (#920)
3D viewer displays cameras' chosen names
2022-11-07 22:36:53 -08:00
Nikhil MohanandMatthew Tancik b978209858 [WIP] nan-training-debug (#910)
* add repro

* update eps

* lint

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-07 10:53:30 -08:00
Matthew Tancik 49e89365bc Add training finished statement (#914) 2022-11-06 22:55:50 -08:00
39462e78b5 Camera Controls Overhaul (FOV + Keyframing) (#792)
* Fov interpolation, FOV/focal length switch, better bounds detection

* Camera reordering

* Progress on expandable camera panels

* Fixed console errors from clickable cameras

* Enumerations for FOV options

* Updated render camera controls

* Removed console logs

* Minor ui changes, fov changes again

* Linting

* Cleaned up code, bug fixes

* Use Three.js functions for fov/focal length

* Temp fix for ui field of view

* Some duplicate imports removed

* Fixed merge

* Added explicit edit button

* Added tooltip for fov/focal length

* Cleaned up console

* Keyframe interface, won't render

* Keyframe interpolation works

* Better default keyframes

* lint

* Style

* Keyframe timing outputs to camera path

* Focal length label bug fix, visual updates

* Fixed looping with keyframes

* Replace linear toggle with reset keyframes button

* UI updates

* remove comment

* Save and load properties from json

* Added VanillaJS-React state sharing

* Lint

* Lint 2

* Animate button functionally working

* Interface improvements

* Animation Button Styling Fixed

* Better animation button styling

* Updated disabled color

* Changed animate color to blue

* Viewport fov does not change

* Fixed merge conflict regression

* Disabled text is now blue

* Fixed FOV interpolation

Co-authored-by: mcallisterdavid <davidrmc2@gmail.com>
Co-authored-by: Matt Tancik <tancik@berkeley.edu>
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-11-06 19:38:49 -08:00
Terrance WangandMatthew Tancik b86a21caf2 Terrance/camera controls (#748)
* adding keyboard camera control instructions to viewer

* adding orbit / fps controls

* adding button to toggle first person cams and orbit cam, spacebar resets view dir and position now

* renaming button

* getting started element now scrolls, adding instructions for camera controls

* fixed first person bug, removed orbit controls

* fixing style

* fixed mouse controls w viewer

* adjust rotate speed

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-06 14:38:52 -08:00
Matthew Tancik a13c10ba61 Use tan instead of tanh (#913) 2022-11-06 12:42:30 -08:00
Nikhil Mohan 1a24f3e58c Refactor Data Pipeline (#896)
* add none check

* black formatting

* cleanup

* cleanup

* fix tests

* remove new line

* init

* toy example working

* semantic nerf working

* simplify pixel samplers

* cleanup + fix tests

* comments

* fix tests

* fix tests
2022-11-06 07:40:43 -08:00
Matthew Tancik 71601f304f Start viewer with more accurate speed calculation (#899)
Start viewer with more accurate speed calc
2022-11-04 17:30:29 -07:00
Alexander Kristoffersen 0afcd1774b Record3D Dataparser moved to ns-process-data script. (#872)
* init commit.

* added docstring.

* added tyro command.

* bugfix.

* added max dataset size logic.

* string cleanup.

* updated depracation warning.

* typo.
2022-11-03 10:43:52 -07:00
Matthew Tancik 121771d126 Update render UI (#885)
* Update render UI

* update text
2022-11-02 22:17:45 -07:00
Terrance WangandMatthew Tancik 7106f42fcc tensorf (#586)
* tensorf wip

* model changes

* tuning model

* changing imports

* merging

* changing rff encoding to nerfencoding, basis matrix should be properly updated, changed density activation, lr scheduler

* debugging tensorf

* debugging tensorf

* tensorf debugging

* tensorf debugging

* tensorf debugging

* tensorf debug

* debugging tensorf, fixed bug with collider

* tuning model, ray sampling

* adding thresholding for ray computations

* removing unused imports

* making more params configurable in config, adding spherical harmonics

* removing scene contraction, adding arg docstrings

* fixing style

* Fixing bug

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-02 14:32:03 -07:00
Julian Knodt 35610cb9e2 DNeRF Data Parser (#817)
* Add dnerf dataparser

* Switch time to be stored per camera

I realized it would be better downstream to store times on the ray bundle, and in order to store
them on the ray bundle it's much easier to store them on the camera. Rather than having to
revert this change, I just made it here.
2022-11-02 12:23:13 -07:00
Nikhil Mohan 6f158a3e68 add correct none check to distortion params (#878)
* add none check

* black formatting
2022-11-02 10:20:26 -07:00
Daniel Crispell c53df92b9c disallow fars <= nears (#881) 2022-11-02 10:04:04 -07:00
Matthew Tancik ca69adaaec Add median depth calculation (#877)
* Add median depth calculation

* lint

* Fix test
2022-11-01 15:05:16 -07:00
Thomas Wang d9f6426e0d Check main thread when always rendering. (#865)
Check main thread
2022-11-01 00:45:20 +01:00
Kevin Chen e8487a0785 Add control for resampling images (#847) 2022-10-31 12:34:13 -07:00
Matthew Tancik cd468a8e94 Don't add relative paths to experiment name (#871)
dont add relative paths to exp name
2022-10-31 12:27:58 -07:00
Thomas Wang b088e230f6 Viewer visualization crashes when using DDP (#863)
Setup viewer only in rank 0
2022-10-31 09:30:55 -07:00
Matthew Tancik 724ec17d75 Fix camera interpolation bug (#858) 2022-10-30 19:52:24 -07:00
Kevin Chen d6543a8a13 Limit number of images in viewer (#845) 2022-10-28 22:24:34 -07:00
dolhaszandadolhasz def6ba5c51 Fix semantic NeRF config bug (#838)
Fix semantic nerf config bug

Co-authored-by: adolhasz <adolhasz@matterport.com>
2022-10-27 08:44:34 +03:00
Kevin Chen 359f955f3f Fix skipping non-existent images (#832)
Fix skipping non-existant images
2022-10-26 23:27:08 +03:00
Kevin Chen cc49356d97 Normalize depth for packed samples (#824) 2022-10-25 23:49:31 +03:00
Kevin Chen d824040ade Fix pose translation when orientation_method=none (#823) 2022-10-21 16:39:02 -07:00
Matthew Tancik 4c62a05415 Fix camera rounding bug (#816)
fix rounding bug
2022-10-20 16:31:07 -07:00
Ethan Weber 6f4fb506e2 Multi-gpu improvements (#799)
* initial commit

* minor changes

* small changes

* ddp seems to be working

* remove commented out code
2022-10-20 01:11:40 -07:00
Matthew Tancik 863fc77ab5 Update viewer UI (#808) 2022-10-19 10:13:12 -07:00
Ethan WeberandMatthew Tancik 7a8f29f623 Add viewer version function (#801)
version function

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-10-19 08:54:27 -07:00
Abhik Ahuja 21eddc4b17 Add ability to load path from file (#804)
* Added button in camera panel to load camera path from file

* Loading camera paths not backwards compatible with old camera paths.
2022-10-18 23:59:55 -07:00
Matthew Tancik 9bed69601f Support python 3.7 (#802)
* Support python 3.7

* Update docs
2022-10-18 16:49:27 -07:00
Matthew Tancik 951d972716 Add more controls for orienting poses (#800) 2022-10-18 13:50:02 -07:00
Ruilong Li(李瑞龙) 52e2c61e6b General acceleration of nerfacto (#797)
* faster pdf compute

* fix
2022-10-17 17:05:34 -07:00
Matthew Tancik b50f10931f Speedup get_ray_sample (#794)
speedup ray sample
2022-10-17 09:17:29 -07:00
Ethan Weber c79de3af81 Quick fix to zmq ip address (#795)
quick fix to zmq host / ip address
2022-10-17 09:12:29 -07:00
David McAllister 97cec622d8 [VIEWER] Camera Select Bug Fixes (#791)
* Out of viewer click fixes

* Reset material color too

* Recursive visibility check

* Lint

* Semicolons
2022-10-16 18:58:58 -07:00
Matthew Tancik 419289ef5b Color outside of render view (#790) 2022-10-16 14:59:29 -07:00
Ethan Weber 555cec9387 Quick fix to ZMQ deadlock error (#784)
quick fix
2022-10-16 11:39:11 -07:00
Matthew Tancik b30b9ef45e Fix threading bug (#780)
* Fix threading bug

* fix
2022-10-15 21:38:54 -07:00
Brent YiandMatthew Tancik 192a7efcba Fix tab completion for PyPI installs, add py.typed (#777)
Add py.typed + tab completion scripts to package data

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-10-14 18:55:48 -07:00
Kyle Corbitt 006008b72f Respect custom timestamps passed to ns-train (#778)
When using `ns-train` as part of a pipeline, it's convenient for the output directory to be deterministic. This should be achievable by passing the `--timestamp` argument to `ns-train`, but that argument is currently being overwritten. This PR fixes the logic to respect a custom user-provided `--timestamp` value.
2022-10-14 18:55:01 -07:00
Ethan WeberandEthan Weber d71c05f256 Google Colab support with viewer (#747)
* allows bridge server to run on a different machine

* added script

* update version

* starting docs

* update docs and scripts

* ngrok support

* use tcp

* moving webrtc outside bridge server. wop

* lazy commit

* lazy commit

* running code. webrtc not working

* lazy commit

* better logic for webrtc connection

* cleanup

* todo comment

* working webrtc

* removed logging

* fixing black

* fix eslint

* fix python version

* fix readme

* misc cleanup

* small docs fix

Co-authored-by: Ethan Weber <ethanweber@Ethans-MacBook-Pro.local>
2022-10-14 15:05:28 -07:00
Justin Kerr a4755a1349 Sample proposal networks on a schedule to speed training (#770) 2022-10-13 20:14:21 -07:00
Justin Kerr 7ebe1f88bb Add PyTorch jit-ing to the undistort computation for speed (#776) 2022-10-13 18:33:36 -07:00
Abhik Ahujaandmcallisterdavid 345ef84be6 Snap to cameras (#550)
Clicking on training cameras now snaps to them

Co-authored-by: mcallisterdavid <davidrmc2@gmail.com>
2022-10-12 20:42:22 -07:00
Matthew Tancik 5f2739e634 Fix tb and wandb crash (#769) 2022-10-12 19:28:58 -07:00
Matthew Tancik d24d82d261 Reduce memory usage of nerfacto model (#766)
* Reduce memory usage of nerfacto model

* Tweak config
2022-10-12 18:01:58 -07:00
Alexander Kristoffersen f273d3d9cb Bug fixes on Instant NGP dataparser (#760)
* fix missing attributes for focal length.

* fix scaling.

* dict to tuple

* docstring, error handling.
2022-10-12 10:56:51 -07:00