Commit Graph
105 Commits
Author SHA1 Message Date
Kamyar Salahi 19d996ef5e fixed bugs in the data processing pipeline 2022-11-04 10:13:48 -07:00
Kamyar Salahi 4120d7945d preliminary equirectangular commit 2022-11-03 19:14:15 -07:00
Justin Kerr d8265b4b21 Merge branch 'main' into justin/opensfm 2022-10-29 05:21:47 -07:00
Justin Kerr bea4f08d0a merge 2022-10-29 05:20:55 -07:00
Kevin Chen d6543a8a13 Limit number of images in viewer (#845) 2022-10-28 22:24:34 -07:00
dolhaszandadolhasz def6ba5c51 Fix semantic NeRF config bug (#838)
Fix semantic nerf config bug

Co-authored-by: adolhasz <adolhasz@matterport.com>
2022-10-27 08:44:34 +03:00
Kevin Chen 359f955f3f Fix skipping non-existent images (#832)
Fix skipping non-existant images
2022-10-26 23:27:08 +03:00
Kevin Chen cc49356d97 Normalize depth for packed samples (#824) 2022-10-25 23:49:31 +03:00
Kevin Chen d824040ade Fix pose translation when orientation_method=none (#823) 2022-10-21 16:39:02 -07:00
Matthew Tancik 4c62a05415 Fix camera rounding bug (#816)
fix rounding bug
2022-10-20 16:31:07 -07:00
Ethan Weber 6f4fb506e2 Multi-gpu improvements (#799)
* initial commit

* minor changes

* small changes

* ddp seems to be working

* remove commented out code
2022-10-20 01:11:40 -07:00
Matthew Tancik 863fc77ab5 Update viewer UI (#808) 2022-10-19 10:13:12 -07:00
Ethan WeberandMatthew Tancik 7a8f29f623 Add viewer version function (#801)
version function

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-10-19 08:54:27 -07:00
Abhik Ahuja 21eddc4b17 Add ability to load path from file (#804)
* Added button in camera panel to load camera path from file

* Loading camera paths not backwards compatible with old camera paths.
2022-10-18 23:59:55 -07:00
Matthew Tancik 9bed69601f Support python 3.7 (#802)
* Support python 3.7

* Update docs
2022-10-18 16:49:27 -07:00
Matthew Tancik 951d972716 Add more controls for orienting poses (#800) 2022-10-18 13:50:02 -07:00
Ruilong Li(李瑞龙) 52e2c61e6b General acceleration of nerfacto (#797)
* faster pdf compute

* fix
2022-10-17 17:05:34 -07:00
Matthew Tancik b50f10931f Speedup get_ray_sample (#794)
speedup ray sample
2022-10-17 09:17:29 -07:00
Ethan Weber c79de3af81 Quick fix to zmq ip address (#795)
quick fix to zmq host / ip address
2022-10-17 09:12:29 -07:00
David McAllister 97cec622d8 [VIEWER] Camera Select Bug Fixes (#791)
* Out of viewer click fixes

* Reset material color too

* Recursive visibility check

* Lint

* Semicolons
2022-10-16 18:58:58 -07:00
Matthew Tancik 419289ef5b Color outside of render view (#790) 2022-10-16 14:59:29 -07:00
Ethan Weber 555cec9387 Quick fix to ZMQ deadlock error (#784)
quick fix
2022-10-16 11:39:11 -07:00
Matthew Tancik b30b9ef45e Fix threading bug (#780)
* Fix threading bug

* fix
2022-10-15 21:38:54 -07:00
Brent YiandMatthew Tancik 192a7efcba Fix tab completion for PyPI installs, add py.typed (#777)
Add py.typed + tab completion scripts to package data

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-10-14 18:55:48 -07:00
Kyle Corbitt 006008b72f Respect custom timestamps passed to ns-train (#778)
When using `ns-train` as part of a pipeline, it's convenient for the output directory to be deterministic. This should be achievable by passing the `--timestamp` argument to `ns-train`, but that argument is currently being overwritten. This PR fixes the logic to respect a custom user-provided `--timestamp` value.
2022-10-14 18:55:01 -07:00
Ethan WeberandEthan Weber d71c05f256 Google Colab support with viewer (#747)
* allows bridge server to run on a different machine

* added script

* update version

* starting docs

* update docs and scripts

* ngrok support

* use tcp

* moving webrtc outside bridge server. wop

* lazy commit

* lazy commit

* running code. webrtc not working

* lazy commit

* better logic for webrtc connection

* cleanup

* todo comment

* working webrtc

* removed logging

* fixing black

* fix eslint

* fix python version

* fix readme

* misc cleanup

* small docs fix

Co-authored-by: Ethan Weber <ethanweber@Ethans-MacBook-Pro.local>
2022-10-14 15:05:28 -07:00
Justin Kerr a4755a1349 Sample proposal networks on a schedule to speed training (#770) 2022-10-13 20:14:21 -07:00
Justin Kerr 7ebe1f88bb Add PyTorch jit-ing to the undistort computation for speed (#776) 2022-10-13 18:33:36 -07:00
Abhik Ahujaandmcallisterdavid 345ef84be6 Snap to cameras (#550)
Clicking on training cameras now snaps to them

Co-authored-by: mcallisterdavid <davidrmc2@gmail.com>
2022-10-12 20:42:22 -07:00
Matthew Tancik 5f2739e634 Fix tb and wandb crash (#769) 2022-10-12 19:28:58 -07:00
Matthew Tancik d24d82d261 Reduce memory usage of nerfacto model (#766)
* Reduce memory usage of nerfacto model

* Tweak config
2022-10-12 18:01:58 -07:00
Alexander Kristoffersen f273d3d9cb Bug fixes on Instant NGP dataparser (#760)
* fix missing attributes for focal length.

* fix scaling.

* dict to tuple

* docstring, error handling.
2022-10-12 10:56:51 -07:00
2150bad0e4 Reducing flicker artifacts for nerfacto method (#750)
* pose opt default nerfacto.

* added SO3 cam pose optimization which is slightly faster (~2.2m/iter) than BARF

* added occupancy grid with placeholder until nerfacc is updated to query density from it

* added occupancy grid sampling as the level 0 in proposal hierarchy, relies on nerfacc 0.1.7 (on pypi)

* merge main

* merge main

* minor changes to sampling

* adjusted sample number

* refactor occ grid stuff, settle on decent params

* nograd proposal sampling

* param tweaks

* varying resolution proposal networks

* params

* merged main

* optimizer update

* remove occ grid

* remove double nerfacto samples

* set single jitter to true

* remove pdb

* more changes

* fix method defaults

* fix pylint

* remove occupancy fn

Co-authored-by: akristoffersen <akristoffersen@berkeley.edu>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2022-10-11 14:21:00 -07:00
Ethan Weber 23828b7ad8 Improving checkpoint logic (#757)
* working on checkpoint logic

* fixed checkpointing logic
2022-10-11 14:06:30 -07:00
Abhik Ahuja cb2107db02 Added up vector offset (#749)
* Added up vector offset

* Reset position when press space
2022-10-10 14:18:24 -07:00
evonneng 0506de65cd fixed --start-train flag (#741)
* wip; fixing --start-train flag

* fixed no rendering
2022-10-10 09:42:15 -07:00
Ruilong Li(李瑞龙) e94b093b57 bump nerfacc to 0.2.0. bug fix for depth vis. (#744)
* bump nerfacc to 0.2.0. bug fix for depth vis.

* skip emtpy region for nerfacc raymarching
2022-10-09 19:16:30 -07:00
Terrance Wang eeda90e697 adding keyboard camera control instructions to viewer (#735) 2022-10-09 19:18:29 -06:00
Ethan Weber b37eae5bb2 save renders to a folder and bump viewer version (#733)
save data to renders folder. bump viewer
2022-10-07 15:14:18 -07:00
Ethan Weber 26a41923e5 update camera opt defaults (#732) 2022-10-07 14:59:02 -07:00
Ethan Weber 45e5b528e5 fix optimizer dict (#729)
* bump version

* optimizer doc fix

* Update conf.py

* Update pyproject.toml
2022-10-07 11:42:36 -07:00
Ethan Weber ee94f23f83 turn on camera opt by default (#727)
* camera opt by default

* fix tests
2022-10-07 11:21:21 -07:00
cac177717f Pose optimization (#721)
* pose opt default nerfacto.

* added SO3 cam pose optimization which is slightly faster (~2.2m/iter) than BARF

* integrating record3d

* fix linting errors

* fix save checkpoint logic

* added record3d data

* workaround to avoid flag

* moved dict

* black

* record3d docs

* re-add typing to exp_map.

* Pose optimization refactor

* Fix camera optimizer param group logic

* Update docs + comments

* Update docs, shorten names

* Appease pylint

* repeat -> tile, apply missing name change

* Fix optimizer as scheduler bug

* Fix test

Co-authored-by: akristoffersen <akristoffersen@berkeley.edu>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
2022-10-07 10:11:33 -07:00
Ethan Weber 2531242d1d integrating record3d and fix checkpoint delete issue (#722)
* integrating record3d

* fix save checkpoint logic

* added record3d data
2022-10-07 00:34:51 -07:00
Brent Yi 05d264a335 Reduced tyro overhead + helptext formatting (#719)
* `ns-train` helptext formatting for tyro 0.3.23

* Remove unused import
2022-10-06 13:33:42 -07:00
Ethan Weber eaa16e535a max number of iterations logic (#699)
* update max iters

* deal with max iters
2022-10-06 13:07:37 -07:00
Matthew Tancik eff62f7c6c Don't apply near plane during eval (#716) 2022-10-06 12:22:27 -07:00
Matthew Tancik 9252a46273 Check ffmpeg before rendering video (#715)
* check ffmpeg before rendering video

* Fix imports
2022-10-06 09:41:36 -07:00
Brent Yi edbfccccfe Rename: dcargs -> tyro (#702)
Rename `dcargs` to `tyro`
2022-10-05 22:26:06 -07:00
Matthew Tancik 1bdfe749e0 Remove outdated viewer logging (#697)
remove outdated viewer logging
2022-10-05 13:57:33 -07:00