Commit Graph
17 Commits
Author SHA1 Message Date
Ethan Weberandevonneng 56661b5d9a Viewer Dynamic Resolution Scaling (DRS) (#87)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* interrupting function during rendering

* small linting fixes

* added logic for interrupting rendering + separted out visualizer logic from trainer

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-07-06 15:47:08 -07:00
Matthew Tancik 59957fa202 Use tensordataclasses (#85)
+ Convert Frustum and RayBundle into TensorDataclasses.
+ Support TensorDataclass fields in TensorDataclasses
+ Support non batched types in TensorDataclass (The are iignored)
2022-07-05 18:32:43 -07:00
Ethan Weberandevonneng bf13ed3cf3 Integrating WebRTC into viewer (#73)
* restructuring for webrtc integration

* some webrtc code but not working

* webrtc connects when muted

* the flag is real!

* updating camera in websocket bridge. moved webrtc to existing websocket connection instead of http request. need to change video track

* rudimentary adding real-time imaging

* added free TURN server so code works everywhere

* slow rendering works during training with the viewer

* fix tensor device and update default model save dir

* forgot to include trainer updates

* removing some code that isn't needed

* quick fix to bins. not the most accurate however

* cleaned up code and added some config logic

* black

* adding license

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-07-05 14:52:49 -07:00
Matt Tancik 711f69fe24 Add TensorDataclass 2022-07-04 16:19:48 -07:00
evonneng ee4e6b24f4 Added structured config support (#58)
* added typed config; idealy would convert graph to typed too....

* added graph as config
2022-06-17 08:46:03 -07:00
Ethan Weber 1e22984d87 Initial viewer (visualizer) code (#52)
* some initial code for viewer. copying from other repos

* adding electron support

* moving some test files around. need to rewrite these

* camera traj. test cases. starting to transmit images

* still working on vis

* reorganized viewer and figured out websocket sending from client. need to do with camera pose

* black

* temporarily ignore pylinting for viewer

* ignore viewer

* fixed array

* license and fixed ignore in pyproject.toml

* improved syntax
2022-06-16 12:11:40 -07:00
evonneng 91ef54963c refactoring configs; pulled network out of graph; created trainer heirarchy (#51)
* changed config graph structure

* removed network udner graphs; added new heirarchy trainer

* fixed callback in occupancy graph

* lint

* changed register callback to setter method
2022-06-15 09:06:43 -07:00
evonneng f67dca6f5b refactor moving setup functions to associated classes; cleanup eval and benchmark scripts (#48)
* refactor code to move graph/dataset setup to respective files

* consolidated eval and benchmark script

* moved setup optimizers to its own thing
2022-06-13 19:05:07 -07:00
evonneng f2d2bde1ac Cleaner timing function calls with wrapped logic (#39)
* cleanup timing for logger events

* cleaned up context manager timer

* fixed lint
2022-06-10 15:33:04 -07:00
Matt Tancik cc4d3431b8 Add integrated positional encodings 2022-06-08 16:13:41 -07:00
evonneng 5433f831ac add licensing headers (#27)
* add licensing headers

* add licensing to run actions

* rerun headers file

* remove trailing white spaces
2022-06-08 13:31:13 -07:00
Matt Tancik f183e03517 Add gausian frustum calculations. 2022-06-08 11:50:42 -07:00
Ethan Weber 457788d689 dataloader logic, new folder structure, flatter configs (#26)
* renaming dataloader to data. adding some dataloader classes

* restructuring configs

* fixed instant ngp tcnn direction rescaling

* working through test cases

* black and lint and tests
2022-06-08 09:01:56 -07:00
evonneng 24c1c77ef1 added wandb support (#24) 2022-06-07 17:35:30 -07:00
evonneng e8118f0569 merge 2022-06-03 17:51:01 +00:00
Ethan Weber 146332cfb6 Refactoring (data loading, semantic-nerf/nerf-w fixes, ...) (#8)
* in progress. camera_indices broken

* faster dataloader. starting on pixel sampler logic

* imagesampler and pixelsampler

* lint and black

* continuing merge

* pytest working

* fixed docs

* docs

* minor changes
2022-06-02 14:58:46 -04:00
Matt Tancik 1a8ad9a763 Change name to pyrad 2022-05-31 14:15:06 -07:00