Commit Graph
49 Commits
Author SHA1 Message Date
evonneng b04cbdf380 debugged logic to make change camera interrupt faster 2022-07-07 23:38:42 +00:00
evonneng 31345faed5 clipping images before running metrics 2022-07-07 19:06:37 +00:00
evonneng d0d2fbe4a0 Merge branch 'master' of github.com:pyradiance/radiance 2022-07-07 18:59:57 +00:00
evonneng 39b67e6fe9 update benchmarking; add clip to mipnerf lpips 2022-07-07 18:59:23 +00:00
Matt Tancik 0734dfc63c Add extra dim to bins 2022-07-07 10:34:27 -07:00
Ethan Weber 44c5e3264c Documenting viewer and faster image sending (#86)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* name change

* starting viewer docs

* new workflow

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* homepage

* homepage

* / to ?

* more documentation

* fixed none error

* instant ngp fix

* faster image sending over tcp. instant ngp bin fix. lowest res when moving

* black

* requirements
2022-07-07 00:03:45 -07:00
Matthew Tancik d0f0f8da2d Add interval loss (#92)
Implement interval loss that was proposed in mipnerf-360.
2022-07-06 17:27:19 -07:00
evonnengandEthan Weber c2ca0f2958 finish rendering if at minimum (#91)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* interrupting function during rendering

* small linting fixes

* added logic for interrupting rendering + separted out visualizer logic from trainer

* finish rendering if at minimum

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-07-06 17:08:24 -07:00
Ethan Weberandevonneng 56661b5d9a Viewer Dynamic Resolution Scaling (DRS) (#87)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* interrupting function during rendering

* small linting fixes

* added logic for interrupting rendering + separted out visualizer logic from trainer

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-07-06 15:47:08 -07:00
Matt Tancik bd78a68756 Update RaySamples to TensorDataclass 2022-07-06 12:01:09 -07:00
Matthew Tancik 59957fa202 Use tensordataclasses (#85)
+ Convert Frustum and RayBundle into TensorDataclasses.
+ Support TensorDataclass fields in TensorDataclasses
+ Support non batched types in TensorDataclass (The are iignored)
2022-07-05 18:32:43 -07:00
evonneng 39063b04fb Webrtc cleanup (#84)
* deleted video_stream_old file

* removed old video stream file
2022-07-05 15:03:03 -07:00
Ethan Weberandevonneng bf13ed3cf3 Integrating WebRTC into viewer (#73)
* restructuring for webrtc integration

* some webrtc code but not working

* webrtc connects when muted

* the flag is real!

* updating camera in websocket bridge. moved webrtc to existing websocket connection instead of http request. need to change video track

* rudimentary adding real-time imaging

* added free TURN server so code works everywhere

* slow rendering works during training with the viewer

* fix tensor device and update default model save dir

* forgot to include trainer updates

* removing some code that isn't needed

* quick fix to bins. not the most accurate however

* cleaned up code and added some config logic

* black

* adding license

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-07-05 14:52:49 -07:00
Ethan Weber e507c97e3e instant ngp fix (#80) 2022-07-05 14:36:35 -07:00
Matt Tancik ced02a00be Fix SSIM memory leak 2022-07-05 12:04:23 -07:00
Ethan Weber fefbad2592 Fixed frustum device and updated model checkpoint defaults (#78)
* fix tensor device and update default model save dir

* removed viewer reference
2022-07-04 17:22:39 -07:00
Matt Tancik 711f69fe24 Add TensorDataclass 2022-07-04 16:19:48 -07:00
Matt Tancik 5a1c8a1c86 Remove point samples 2022-07-01 09:36:59 -07:00
Matt Tancik c98a7d631a Add contracted rays vis 2022-06-30 18:00:55 -07:00
Matthew Tancik 304a759e85 Tancik/scene contraction (#70)
Contract the scene to a sphere of radius 2. This is the same contraction used in MipNeRF 360.
Add mipnerf 360 graph and config. It currently doesn't contain the other advancements made in the paper (sample proposal network, regularizers)
2022-06-29 18:28:21 -07:00
Matt Tancik d160fa87cb Correct poses 2022-06-28 10:51:35 -07:00
Matt Tancik f71c2c21f2 Add mipnerf 360 data support 2022-06-28 10:51:35 -07:00
evonneng ee4e6b24f4 Added structured config support (#58)
* added typed config; idealy would convert graph to typed too....

* added graph as config
2022-06-17 08:46:03 -07:00
Matt Tancik 65fe212d17 Add more samplers 2022-06-16 18:27:47 -07:00
Ethan Weber 1e22984d87 Initial viewer (visualizer) code (#52)
* some initial code for viewer. copying from other repos

* adding electron support

* moving some test files around. need to rewrite these

* camera traj. test cases. starting to transmit images

* still working on vis

* reorganized viewer and figured out websocket sending from client. need to do with camera pose

* black

* temporarily ignore pylinting for viewer

* ignore viewer

* fixed array

* license and fixed ignore in pyproject.toml

* improved syntax
2022-06-16 12:11:40 -07:00
evonneng 91ef54963c refactoring configs; pulled network out of graph; created trainer heirarchy (#51)
* changed config graph structure

* removed network udner graphs; added new heirarchy trainer

* fixed callback in occupancy graph

* lint

* changed register callback to setter method
2022-06-15 09:06:43 -07:00
evonneng f67dca6f5b refactor moving setup functions to associated classes; cleanup eval and benchmark scripts (#48)
* refactor code to move graph/dataset setup to respective files

* consolidated eval and benchmark script

* moved setup optimizers to its own thing
2022-06-13 19:05:07 -07:00
evonneng fb63bb543f added psnr to the local writer prints of ngp 2022-06-11 21:29:16 +00:00
Matt Tancik 201f85a175 Update bins 2022-06-10 16:52:34 -07:00
evonneng f2d2bde1ac Cleaner timing function calls with wrapped logic (#39)
* cleanup timing for logger events

* cleaned up context manager timer

* fixed lint
2022-06-10 15:33:04 -07:00
Matt Tancik 37a3692b45 Update docstrings 2022-06-10 09:03:43 -07:00
Matt Tancik cc79708df7 Cleanup mipnerf implementation 2022-06-09 17:26:58 -07:00
Matt Tancik cc4d3431b8 Add integrated positional encodings 2022-06-08 16:13:41 -07:00
evonneng 5433f831ac add licensing headers (#27)
* add licensing headers

* add licensing to run actions

* rerun headers file

* remove trailing white spaces
2022-06-08 13:31:13 -07:00
Matt Tancik f183e03517 Add gausian frustum calculations. 2022-06-08 11:50:42 -07:00
Ethan Weber d16f87a957 fixing blender scene training with vanilla nerf 2022-06-08 18:00:51 +00:00
Ethan Weber 457788d689 dataloader logic, new folder structure, flatter configs (#26)
* renaming dataloader to data. adding some dataloader classes

* restructuring configs

* fixed instant ngp tcnn direction rescaling

* working through test cases

* black and lint and tests
2022-06-08 09:01:56 -07:00
evonneng 24c1c77ef1 added wandb support (#24) 2022-06-07 17:35:30 -07:00
Matt Tancik 9319e7d565 PDF sampling based on bins 2022-06-07 14:10:33 -07:00
Matt Tancik ef9a641625 Fix lint 2022-06-07 10:06:46 -07:00
Matt Tancik 8582238322 Update docs 2022-06-07 10:06:46 -07:00
Matt Tancik 1b20028ea3 Switch from point samples to frustum samples 2022-06-06 16:43:11 -07:00
Matt Tancik 609bf32d22 Rays use frustums 2022-06-06 16:43:11 -07:00
Matthew Tancik d38e852fe4 Update docs (#16) 2022-06-06 09:20:51 -07:00
evonneng e8118f0569 merge 2022-06-03 17:51:01 +00:00
Matt Tancik 736e72914a Fix registered value. 2022-06-02 12:10:42 -07:00
Ethan Weber 146332cfb6 Refactoring (data loading, semantic-nerf/nerf-w fixes, ...) (#8)
* in progress. camera_indices broken

* faster dataloader. starting on pixel sampler logic

* imagesampler and pixelsampler

* lint and black

* continuing merge

* pytest working

* fixed docs

* docs

* minor changes
2022-06-02 14:58:46 -04:00
Matt Tancik 266b470b83 Save RFF state to buffer 2022-06-02 09:44:50 -07:00
Matt Tancik 1a8ad9a763 Change name to pyrad 2022-05-31 14:15:06 -07:00