4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
Commit Graph

419 Commits

Author SHA1 Message Date
evonneng
b04cbdf380 debugged logic to make change camera interrupt faster 2022-07-07 23:38:42 +00:00
evonneng
31345faed5 clipping images before running metrics 2022-07-07 19:06:37 +00:00
evonneng
d0d2fbe4a0 Merge branch 'master' of github.com:pyradiance/radiance 2022-07-07 18:59:57 +00:00
evonneng
39b67e6fe9 update benchmarking; add clip to mipnerf lpips 2022-07-07 18:59:23 +00:00
Matt Tancik
31a465c62f Run_actions quit on failed action 2022-07-07 11:35:16 -07:00
Matt Tancik
0734dfc63c Add extra dim to bins 2022-07-07 10:34:27 -07:00
Ethan Weber
44c5e3264c
Documenting viewer and faster image sending (#86)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* name change

* starting viewer docs

* new workflow

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* homepage

* homepage

* / to ?

* more documentation

* fixed none error

* instant ngp fix

* faster image sending over tcp. instant ngp bin fix. lowest res when moving

* black

* requirements
2022-07-07 00:03:45 -07:00
Matthew Tancik
d0f0f8da2d
Add interval loss (#92)
Implement interval loss that was proposed in mipnerf-360.
2022-07-06 17:27:19 -07:00
evonneng
c2ca0f2958
finish rendering if at minimum (#91)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* interrupting function during rendering

* small linting fixes

* added logic for interrupting rendering + separted out visualizer logic from trainer

* finish rendering if at minimum

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-07-06 17:08:24 -07:00
Ethan Weber
56661b5d9a
Viewer Dynamic Resolution Scaling (DRS) (#87)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* interrupting function during rendering

* small linting fixes

* added logic for interrupting rendering + separted out visualizer logic from trainer

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-07-06 15:47:08 -07:00
Matt Tancik
bd78a68756 Update RaySamples to TensorDataclass 2022-07-06 12:01:09 -07:00
Matthew Tancik
59957fa202
Use tensordataclasses (#85)
+ Convert Frustum and RayBundle into TensorDataclasses.
+ Support TensorDataclass fields in TensorDataclasses
+ Support non batched types in TensorDataclass (The are iignored)
2022-07-05 18:32:43 -07:00
Ethan Weber
44e2d7494e
hydra version 1.2.0 (#83) 2022-07-05 15:10:06 -07:00
evonneng
39063b04fb
Webrtc cleanup (#84)
* deleted video_stream_old file

* removed old video stream file
2022-07-05 15:03:03 -07:00
Ethan Weber
bf13ed3cf3
Integrating WebRTC into viewer (#73)
* restructuring for webrtc integration

* some webrtc code but not working

* webrtc connects when muted

* the flag is real!

* updating camera in websocket bridge. moved webrtc to existing websocket connection instead of http request. need to change video track

* rudimentary adding real-time imaging

* added free TURN server so code works everywhere

* slow rendering works during training with the viewer

* fix tensor device and update default model save dir

* forgot to include trainer updates

* removing some code that isn't needed

* quick fix to bins. not the most accurate however

* cleaned up code and added some config logic

* black

* adding license

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-07-05 14:52:49 -07:00
Ethan Weber
e507c97e3e
instant ngp fix (#80) 2022-07-05 14:36:35 -07:00
Matt Tancik
ced02a00be Fix SSIM memory leak 2022-07-05 12:04:23 -07:00
Ethan Weber
fefbad2592
Fixed frustum device and updated model checkpoint defaults (#78)
* fix tensor device and update default model save dir

* removed viewer reference
2022-07-04 17:22:39 -07:00
Matt Tancik
711f69fe24 Add TensorDataclass 2022-07-04 16:19:48 -07:00
Matt Tancik
5a1c8a1c86 Remove point samples 2022-07-01 09:36:59 -07:00
Matt Tancik
191dfc6a34 minor 2022-06-30 18:27:38 -07:00
Matt Tancik
3f4f05b963 Update notebooks 2022-06-30 18:27:38 -07:00
Matt Tancik
c98a7d631a Add contracted rays vis 2022-06-30 18:00:55 -07:00
Matt Tancik
0fa9322f4c Merge branch 'master' of github.com:plenoptix/pyrad 2022-06-29 18:30:26 -07:00
Matthew Tancik
304a759e85
Tancik/scene contraction (#70)
Contract the scene to a sphere of radius 2. This is the same contraction used in MipNeRF 360.
Add mipnerf 360 graph and config. It currently doesn't contain the other advancements made in the paper (sample proposal network, regularizers)
2022-06-29 18:28:21 -07:00
Matt Tancik
a2e8013d68 Merge branch 'master' of github.com:plenoptix/pyrad 2022-06-29 11:48:09 -07:00
Matthew Tancik
2bc6d9cc63
Update docs (#65)
+ Clean up data setup docs
+ Clean up visualize data ipynb
+ Enable interactive ploty in docs
2022-06-29 11:47:55 -07:00
Matt Tancik
7cbc5ba003 Merge branch 'master' of github.com:plenoptix/pyrad 2022-06-29 10:06:52 -07:00
Matt Tancik
336d348345 Ignore ipynb in github line count 2022-06-28 17:11:02 -07:00
Matt Tancik
0c6b11b38a Ignore ipynb in github line count 2022-06-28 17:09:55 -07:00
Matt Tancik
640adf430e Update docs 2022-06-28 16:51:08 -07:00
Matt Tancik
d160fa87cb Correct poses 2022-06-28 10:51:35 -07:00
Matt Tancik
f71c2c21f2 Add mipnerf 360 data support 2022-06-28 10:51:35 -07:00
Matt Tancik
73a2449bae Fix hydra bug 2022-06-25 18:43:10 -07:00
evonneng
ee4e6b24f4
Added structured config support (#58)
* added typed config; idealy would convert graph to typed too....

* added graph as config
2022-06-17 08:46:03 -07:00
evonneng
d65b50a0e3
Removed hardcoding in benchmarking code (#59)
* updated benchmarking script

* removed annoying benchmarking hardcoding
2022-06-16 20:14:10 -07:00
Matt Tancik
65fe212d17 Add more samplers 2022-06-16 18:27:47 -07:00
Ethan Weber
025648e729 forgot to add a notebook 2022-06-16 20:54:55 +00:00
Ethan Weber
1e22984d87
Initial viewer (visualizer) code (#52)
* some initial code for viewer. copying from other repos

* adding electron support

* moving some test files around. need to rewrite these

* camera traj. test cases. starting to transmit images

* still working on vis

* reorganized viewer and figured out websocket sending from client. need to do with camera pose

* black

* temporarily ignore pylinting for viewer

* ignore viewer

* fixed array

* license and fixed ignore in pyproject.toml

* improved syntax
2022-06-16 12:11:40 -07:00
evonneng
91ef54963c
refactoring configs; pulled network out of graph; created trainer heirarchy (#51)
* changed config graph structure

* removed network udner graphs; added new heirarchy trainer

* fixed callback in occupancy graph

* lint

* changed register callback to setter method
2022-06-15 09:06:43 -07:00
Matt Tancik
41073540c1 Update contributing 2022-06-14 09:53:44 -07:00
evonneng
f67dca6f5b
refactor moving setup functions to associated classes; cleanup eval and benchmark scripts (#48)
* refactor code to move graph/dataset setup to respective files

* consolidated eval and benchmark script

* moved setup optimizers to its own thing
2022-06-13 19:05:07 -07:00
evonneng
ee60d5b9b5 Merge branch 'master' of github.com:pyradiance/radiance 2022-06-14 00:15:12 +00:00
evonneng
b2648c6522 updated benchmarking to match new config 2022-06-14 00:15:05 +00:00
Matt Tancik
4c85cba3ab Add notebooks to documentation 2022-06-13 16:48:42 -07:00
Matt Tancik
3921839d1a Update config 2022-06-13 13:39:49 -07:00
evonneng
fb63bb543f added psnr to the local writer prints of ngp 2022-06-11 21:29:16 +00:00
Matt Tancik
201f85a175 Update bins 2022-06-10 16:52:34 -07:00
evonneng
f2d2bde1ac
Cleaner timing function calls with wrapped logic (#39)
* cleanup timing for logger events

* cleaned up context manager timer

* fixed lint
2022-06-10 15:33:04 -07:00
Matt Tancik
37a3692b45 Update docstrings 2022-06-10 09:03:43 -07:00