Commit Graph
29 Commits
Author SHA1 Message Date
Ruilong Li(李瑞龙) 12cd321e1a Update Instant-NGP & Density Grid with CUDA supports. Much faster and better PSNR. (#193) 2022-07-24 22:22:44 -07:00
Matthew Tancik 5cee32074a Add dcargs (#178)
* Add dcargs

* Add dcargs to run_actions
2022-07-19 18:23:40 -07:00
Ethan Weber 44c5e3264c Documenting viewer and faster image sending (#86)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* name change

* starting viewer docs

* new workflow

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* homepage

* homepage

* / to ?

* more documentation

* fixed none error

* instant ngp fix

* faster image sending over tcp. instant ngp bin fix. lowest res when moving

* black

* requirements
2022-07-07 00:03:45 -07:00
Ethan Weber 44e2d7494e hydra version 1.2.0 (#83) 2022-07-05 15:10:06 -07:00
Ethan Weberandevonneng bf13ed3cf3 Integrating WebRTC into viewer (#73)
* restructuring for webrtc integration

* some webrtc code but not working

* webrtc connects when muted

* the flag is real!

* updating camera in websocket bridge. moved webrtc to existing websocket connection instead of http request. need to change video track

* rudimentary adding real-time imaging

* added free TURN server so code works everywhere

* slow rendering works during training with the viewer

* fix tensor device and update default model save dir

* forgot to include trainer updates

* removing some code that isn't needed

* quick fix to bins. not the most accurate however

* cleaned up code and added some config logic

* black

* adding license

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-07-05 14:52:49 -07:00
Matthew Tancik 304a759e85 Tancik/scene contraction (#70)
Contract the scene to a sphere of radius 2. This is the same contraction used in MipNeRF 360.
Add mipnerf 360 graph and config. It currently doesn't contain the other advancements made in the paper (sample proposal network, regularizers)
2022-06-29 18:28:21 -07:00
Ethan Weber 1e22984d87 Initial viewer (visualizer) code (#52)
* some initial code for viewer. copying from other repos

* adding electron support

* moving some test files around. need to rewrite these

* camera traj. test cases. starting to transmit images

* still working on vis

* reorganized viewer and figured out websocket sending from client. need to do with camera pose

* black

* temporarily ignore pylinting for viewer

* ignore viewer

* fixed array

* license and fixed ignore in pyproject.toml

* improved syntax
2022-06-16 12:11:40 -07:00
evonneng 24c1c77ef1 added wandb support (#24) 2022-06-07 17:35:30 -07:00
Ethan Weber ebc64a13bf quick fixes to readme and reqs 2022-06-02 19:32:01 +00:00
Ethan Weber 146332cfb6 Refactoring (data loading, semantic-nerf/nerf-w fixes, ...) (#8)
* in progress. camera_indices broken

* faster dataloader. starting on pixel sampler logic

* imagesampler and pixelsampler

* lint and black

* continuing merge

* pytest working

* fixed docs

* docs

* minor changes
2022-06-02 14:58:46 -04:00
Matthew Tancik c67618e926 Basic sphinx documentation (#4)
Basic sphinx documentation
2022-05-31 17:11:23 -07:00
Matt Tancik beebefbc8c Fix packages 2022-05-31 14:34:41 -07:00
Matt Tancik 5f2e191c0e Add readthedocs support 2022-05-31 11:59:03 -07:00
Ethan Weber 96fda38a94 protobuf version (#110) 2022-05-30 10:31:49 -04:00
Matthew Tancik 443fdef553 Run black on ipynb (#80) 2022-05-18 09:36:38 -07:00
Ethan Weber fb440fedf3 Occupancy grid (#79)
* occupancy grid in progress

* visualizing occupancy grid. currently restructing field and renderer head outputs

* black and pylint. broke nerfw and semantic nerf but it's okay

* get_project_root
2022-05-17 19:09:25 -07:00
Ethan Weber 676beebb14 Setting near and far with scene bounds collider. Also LR schedules. (#74)
* some initial cuda code as I learn. using git to save progress.

* first cuda kernel for ray sampling that mostly works

* cleaning up code. working on lr. structs for scene bounds aabb

* added scene bounds collider code

* updated setup

* setup

* setup

* black

* including some files

* exporting env variable

* new file

* git workflows

* github actions

* github actions

* github actions

* removing env var
2022-05-16 14:03:19 -07:00
Matthew Tancik 2ebe34f01d Use torchmetrics (#68) 2022-05-10 17:06:49 -07:00
Matthew Tancik 29ba6d8abc Add ssim and update typechecks (#66)
* Add ssim and update typechecks

* update requirements

* Fix type error
2022-05-10 11:52:32 -07:00
Matt Tancik cf9c557b7b Add colormaps to logs 2022-05-06 18:07:12 -07:00
Ethan Weber 0b82c1188c Colmap type of dataset (from "friends" project) (#56)
* code to process the friends data. need to add masking

* code to process the friends data. need to add masking

* black

* trying to fix black

* black fixed

* updating black version
2022-05-05 08:45:30 -07:00
Ethan Weber 5099a4f7c5 resizing image 2022-04-22 18:19:39 +00:00
Matt Tancik a32c681a7a Rearrange nerf files 2022-04-21 14:51:51 -07:00
Ethan Weber 621a94e65c removing docker and fixing nfs issue 2022-04-17 16:36:09 +00:00
Ethan Weber e38040ee4d Image dataset implemented and ray generation working. (#23)
* working data loader code

* adding gitignore

* fixing linting errors

* set black line length in settings file

* update

* fixed filepath

* black format

* tqdm
2022-04-17 09:26:44 -07:00
Ethan Weber 0b7dfcdc5d Initial ray generation and dataset code (#12)
* ray generator and cameras structure progress

* test renames

* added pass

* conflicts

* fixing some black errors

* reformated files

* merged master and .gitignore

* fixing linting

* removing old folder

* removed return False

* pylint fixes

* update

* updates

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
2022-04-12 15:08:16 -07:00
Matt Tancik 87b57104a5 Add tests 2022-04-11 16:24:14 -07:00
Ethan Weber a9c0d5b97f hydra config and starting trainer class 2022-04-06 16:46:47 +00:00
Ethan Weber b63d5854a1 reworked structure to use packages 2022-04-02 20:07:41 +00:00