Commit Graph
39 Commits
Author SHA1 Message Date
Ethan Weber 21ebaceed1 fix viewer checkpointing (#511) 2022-09-21 17:56:18 -07:00
evonneng 38f83de64b removed post init method in config setup (#495)
* mrege

* nits
2022-09-20 14:56:48 -07:00
Matthew Tancik 046b5c216b Misc cleanup (#494)
* misc cleanup

* Fix dependencies
2022-09-20 09:14:37 -07:00
Ethan Weber 35c8d7e53c misc viewer fixes including when no samples in a chunk (#491)
viewer fixes
2022-09-19 18:36:26 -07:00
Matthew Tancik 8b388a3e5c Remove defaults from docstrings. (#480) 2022-09-19 10:04:25 -07:00
evonneng 4e7ef375a2 [wip] logging separated s.t. only one is enabled (#458)
* updated viewer/writer configs

* allow viewer + tb/wandb but with errors; moved localwriter to its own thing

* nits and all

* update test
2022-09-17 17:50:11 -07:00
Ethan Weber e22eab8c86 updating metrics logging (#460)
* integrated changes

* update

* stratified

* black

* bump version

* upgrade version

* improved wandb logging

* fix split for eval

* comments
2022-09-16 17:27:55 -07:00
evonneng 1d6592b760 viewer fix to be compatible with rgb vs rgb_fine/coarse (#439)
small viewer fixes
2022-09-15 10:01:25 -07:00
evonneng 5469f2e6b8 Attempt at making viewer robust to random errors (#429)
* catch more specific errors

* reduce complication; simple handle of oom error

* lints
2022-09-14 11:19:19 -07:00
Matthew Tancik 587e641884 Check camera timestamp (#431)
check camera timestamp
2022-09-14 00:09:47 -07:00
Ethan Weber 9bc39d895c Export camera path (#398)
* export button working

* view changes

* adding copy to clipboard feature

* camera choice dropdown

* going to add script saving next

* copy paste working. need to add aspect ratio

* aspect overlay kind of working

* lint

* aspect ratio fixed. version specified

* merge

* openrelay back
2022-09-13 11:33:58 -07:00
evonneng 4801a99b2a improve memory consumption by clearing cache + move image to cpu (#412)
* reduced mem on train; figuring out memory leak on visualizer

* steadily below 10G memory

* cpu loading image

* update docstrings

* added scrolling

* Revert "update docstrings"

This reverts commit a914387cf8.

* Revert "Revert "update docstrings""

This reverts commit 177c3dd6f1.

* Revert "added scrolling"

This reverts commit f37351ee7f.
2022-09-12 23:00:44 -07:00
evonneng e516e668b9 [wip] added throttle so viewer doesnt crash (#411)
* added throttle so viewer doesnt crash

* fix rendering bug

* lint
2022-09-12 18:32:09 -07:00
Matt Tancik b651a532bd Update viewer url 2022-09-12 11:46:51 -07:00
Matthew Tancik e394954c7c Add codec to webrtc (#399)
Add codec
2022-09-11 19:14:58 -07:00
Matthew Tancik 7a7a5e608a Dynamic resolution in viewer (#397)
Dynamic resolution
2022-09-11 18:31:54 -07:00
evonneng d50c71ac43 update docstrings and random cleanups (#387)
* fixing docstrings and small nits; up to fileds

* finished adding and fixing docstrings
2022-09-10 23:09:44 -07:00
Matthew Tancik 9292a02287 Small optimizations when working with images (#375)
* data optimization

* lint
2022-09-08 19:17:15 -07:00
evonneng e7cca834c8 added flag to view dataset from get-go (#366)
* added logic to comp rays/s on train and vis

* added test and fixed vis rays/sec

* added flag to just visualize dataset

* added new script for viewing only dataset
2022-09-08 13:29:17 -07:00
evonneng 7b6ed5496b added logic to comp rays/s on train and vis (#364)
* added logic to comp rays/s on train and vis

* added test and fixed vis rays/sec
2022-09-07 13:43:53 -07:00
Ethan Weber 7aa6ca9948 Kill the training script if the viewer ports are conflicting with other processes (#352)
kills program if conflicting ports for the viewer
2022-09-07 12:32:31 -07:00
Ethan Weber 512a51f714 Fixed friends dataset w/o caching (#365)
* fixing friends dataloading and nerfw running

* put dataset back to normal
2022-09-07 12:24:29 -07:00
Matt Tancik 5803fe5e19 Update printing 2022-09-07 11:58:45 -07:00
evonneng 56113e6c75 [WIP] dataloading cleanup (#332)
* testing; need to merge

* fixing wrong base file in models/base

* pushed input parser into datasets class to abstract away fetching data in dataloader

* slight name chage and all

* nits

* added dataparser

* added licnese
2022-09-06 13:54:35 -07:00
Ethan Weber 2cca012ad8 Clickable viewer deployment (#308)
* first commit for clickable web viewer

* pylint ignore

* functional clickable viewer with updated docs

* fixed logging
2022-08-29 22:50:57 -07:00
Matthew Tancik 04d0165a24 Camera Refactor (#301)
* Start camera refactor

* Training runs, but transforms incorrect

* Cameras render correctly in viewer.

* Fix eval

* cleanup

* cleanup
2022-08-29 13:09:02 -07:00
Ethan Weberandevonneng 7e9a56fac4 Config restructure (#283)
* starting docs for pipelines

* working on an example

* clearing output

* starting to implement config changes and add documentation

* wip: removed cicular imports; porting basic config into python; todo: get python setups workin

* circular imports again

* wip: pausing at dataloader sort of working

* break for today

* running vanilla

* wip need to get all the config docs working

* laptop about to die

* instant ngp working

* added all configs for all methods; not tested yet: [mipnerf360, nerfw, semantic_nerf]

* unpacking later

* done with pylinting

* mostly done. just need to do docs and one test

* added import order to docs

* fixing near/far plane and other config things

* making loggers also instantiable via configs

* docs

* lint

* making --help work with dcargs

* moving configs back into flat

* convert list to tuples; fixed post init function with mutable params

* lint

* made run_eval and benchmarking scripts compatible with new config/dcargs

* lint

* added option to load configs from presaved config

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-08-26 17:25:10 -07:00
Ethan Weber 55ebaaf1b5 Hosting the viewer & webrtc logging (#271)
* might fix the stun server issue

* still debugging webrtc

* another turn server

* working on github actions

* updating actions file

* fixing actions

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* updating viewer

* update docs
2022-08-14 00:15:34 -07:00
evonneng 2d3452e5a2 Adding colormap customization on viewer (#272)
* set up logic for colormap defined by user on viewer

* ooops typo

* nit

* done with defaults

* lint
2022-08-12 17:35:53 -07:00
evonneng 1499fd1cd7 added stats- ratio train:visualizer (#268)
added stats: ratio train:visualizer
2022-08-11 16:34:57 -07:00
Ethan WeberandJake Austin 0b042be956 Pipeline v2 (#258)
* Model class done, pipeline class still needs more visualization stuffs

* Renaming the BaseDataContainer to DataloaderOutputs and adding documentation

* Pushing more documentation, removing some trivial functions

* Updating dict typing

* Removing config dicts for collider

* Passing tests

* Pushing shell new dataloader

* Saving work, need to fix NGP model's get_loss_dict and Pipeline

* V1 of the ngp pipeline should be done. Need train script and debugging

* Updating with latest instant-ngp code

* Syntax updates from latest ngp graph code

* Linter, removing unneeded code in new NGP graph code

* Style

* Should be good now. Linter is happy and the code is verbatum current instant-ngp

* Everything done except novel view testing code

* Fixing some nitpicks

* Debugging dataloader

* merged master

* WOP. integrating pipeline with configs and notebook demo

* removing model folder

* a lot of name changing from Graph to Model

* in progress... changing trainer to use pipeline... broken right now

* pipeline code runs

* switched to val dataset

* makes run_eval.py work

* updated configs for pipeline change

* fixing test_run_train script

* fixing black and linting

* fix docs

* small updates to trainer

Co-authored-by: Jake Austin <jake-austin@berkeley.edu>
2022-08-10 14:59:45 -07:00
evonneng 29a6e02c07 added basic stats to viewer (#259) 2022-08-09 15:30:27 -07:00
evonneng 035c911574 throttling rendering resolution (#256) 2022-08-08 12:00:05 -07:00
Ethan Weber 73fedc7593 Viewer refactor with state sync (#212)
* initial commit for viewer refactor

* updating name change to nerfactory

* adding headers

* making the rendering fix which broke from a merge

* things are starting to work. removing old commands now

* removed prints

* cleanup

* updating state works now even for nested dictionaries

* updating state in redux. listening for state changes. trying to draw three.js now

* added drawing functionality. need to fix translation of frustums and image planes

* images and frustums drawn correctly

* fixing lint

* github actions

* back to npm

* fixing eslint

* remove package.json from root

* new favicon

* some viewer cleanup

* notebook

* fixed camera drawings speed to avoid redraw

* trying to get Leva to update

* quick fix

* synced config panel

* adding notebook

* fixing output print error
2022-08-02 16:02:07 -05:00
Matthew Tancik e35781fe85 Code cleanup (#234) 2022-07-31 18:22:57 -07:00
Ethan WeberandEthan Weber d13a766b9e Serializing JSON code for drawable objects (and some documentation) (#222)
* some comments and starting serializing comments. on plane w/o formatter

* fixing pylint and black

* removed changes in file

* revert file

* addressing comments

* remove abstract

Co-authored-by: Ethan Weber <ethanweber@Ethans-MacBook-Pro.local>
2022-07-28 13:55:58 -05:00
Matthew Tancik 512842938a Fix race condition in viewer (#209) 2022-07-26 17:27:48 -07:00
Ruilong Li(李瑞龙) 1cd697366e sorting imports on save; cleanup imports sorting; add isort check (#207) 2022-07-26 14:35:38 -07:00
Matthew Tancik 6dc704c551 Rename repo to nerfactory (#204)
* Rename to nerfactory

* Fix missing files
2022-07-25 13:52:20 -07:00