Commit Graph
148 Commits
Author SHA1 Message Date
Julian KnodtandMatthew Tancik 9ff167d705 Add temporal distortion and D-NeRF model (#825)
* Add D-NeRF temporal distortion and D-NeRF model

This allows for temporal distortion to be enabled on a variety of models through config
parameters, without an explicit model. Temporal distortion and MIP-NeRF are not currently
jointly runnable but can be changed in the future.

* Simplifying changes

* Simplifying changes

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-11-15 14:29:29 -08:00
Matthew Tancik ca69adaaec Add median depth calculation (#877)
* Add median depth calculation

* lint

* Fix test
2022-11-01 15:05:16 -07:00
Ethan Weber 6f4fb506e2 Multi-gpu improvements (#799)
* initial commit

* minor changes

* small changes

* ddp seems to be working

* remove commented out code
2022-10-20 01:11:40 -07:00
Matthew Tancik 654f070553 Remove mipnerf 360 (#659)
remove mipnerf 360
2022-10-04 16:29:11 -07:00
Matthew Tancik 6162f9d81f Tancik/remove valid mask (#655)
* Install updates

* Remove valid mask logic
2022-10-04 13:54:39 -07:00
Ethan Weber 0695879673 [docs] model to method naming (#652)
* renamed model to methods

* name change
2022-10-04 11:53:16 -07:00
Ethan Weber 05ba4b6b00 semantic nerfw (#640)
transients not working right now
2022-10-03 20:36:32 -07:00
Ethan Weber 5a76b955cd adding --data alias (#630)
* adding --data alias

* fix black
2022-10-03 12:02:10 -07:00
Ethan Weber 75866f3a8f use literal instead of list for --vis (#628)
use literal instead of list
2022-10-03 09:58:42 -07:00
Ethan Weber 8bbf578f10 viewer panels update (websocket and hide images) (#620)
websocket update
2022-10-02 18:41:37 -07:00
Ethan Weber c20fed83bb moving around files (#616)
moved around files
2022-10-02 16:54:34 -07:00
Ethan Weber 9d15ba6a2a viewer port cleanup (#615)
* cleaned up port logic

* bump viewer version
2022-10-02 13:58:51 -07:00
Matthew Tancik 5f2790246d Restructure tests (#611) 2022-10-02 10:51:30 -07:00
Matthew Tancik afda888591 tcnn encoding integration (#608)
* tcnn encoding integration

* Add tests, fix lint

* lin
2022-10-02 10:33:43 -07:00
Ethan Weber e13d401b16 restructure codebase pre release (#602)
* moving a lot

* building
2022-10-01 16:36:25 -07:00
Matthew Tancik 1bb0c88fb5 More renaming (#590) 2022-09-30 09:48:52 -07:00
Matthew Tancik 1f83ad03db Rename to nerfstudio (#589) 2022-09-29 23:42:15 -07:00
Matthew Tancik fae01d3ca6 Remove cuda from repo (#588)
Remove density grid and cuda
2022-09-29 19:00:36 -07:00
Matthew Tancik 5bc011e5fa NGP with contraction (#580) 2022-09-29 13:18:49 -07:00
Ethan Weber 43d588f35f specify a viewers list (#574)
* viewer list

* before master merge

* update script
2022-09-28 10:10:18 -07:00
Ethan Weber cf34ef4bd0 rename files and add project scripts (#566)
* scripts

* b

* fix file
2022-09-27 15:02:55 -07:00
Ethan Weber 383a6075cc [wip] proposal network sampler (#534)
* initial running code

* dozer and poster 6K experiments

* code reorganization

* removed print

* black
2022-09-25 16:56:29 -07:00
Ethan Weber 7b5a251a30 [wip] dynamic batch size for instant ngp (#501)
* starting dynamic batch size branch

* dynamic batch pipeline code
2022-09-21 14:07:04 -07:00
Ethan Weber 1d14263127 eval progress bar with more metrics (#499)
updated eval
2022-09-20 20:07:35 -07:00
evonneng 38f83de64b removed post init method in config setup (#495)
* mrege

* nits
2022-09-20 14:56:48 -07:00
evonneng c2a2b1de1e changed base method names (#483)
* changed base method names

* fixed tests
2022-09-19 12:43:33 -07:00
evonneng 4e7ef375a2 [wip] logging separated s.t. only one is enabled (#458)
* updated viewer/writer configs

* allow viewer + tb/wandb but with errors; moved localwriter to its own thing

* nits and all

* update test
2022-09-17 17:50:11 -07:00
Ethan Weber 8973039e65 misc cleanup (#432)
* misc cuda improvements. added cone angle as param

* wandb as default. better organization for experiments

* turn off tensorboard

* disable eval when using viewer

* remove comment

* launch.json
2022-09-15 00:16:41 -07:00
Matthew Tancik d839937376 Remove compound model from tests (#414) 2022-09-12 22:32:24 -07:00
Alexander Kristoffersen d3dc9c5011 Unified place for all pose util methods. (#371)
* init pose utils.

* more tests.

* pose utils applied throughout codebase.

* added normalization.
2022-09-09 16:10:04 -07:00
Ethan Weber 7aa6ca9948 Kill the training script if the viewer ports are conflicting with other processes (#352)
kills program if conflicting ports for the viewer
2022-09-07 12:32:31 -07:00
Jake Austin c033d1136e Ray bundle latents add (#292)
* Making TensorDataclass reshape nested dict attributes.
2022-09-06 14:22:19 -07:00
evonneng 56113e6c75 [WIP] dataloading cleanup (#332)
* testing; need to merge

* fixing wrong base file in models/base

* pushed input parser into datasets class to abstract away fetching data in dataloader

* slight name chage and all

* nits

* added dataparser

* added licnese
2022-09-06 13:54:35 -07:00
Matt Tancik 12786b0ef9 Fix pytest warnings 2022-09-06 08:36:36 -07:00
Matthew Tancik 361358c6e6 Use smaller images to speed up testing (#345) 2022-09-05 18:03:44 -07:00
Matthew Tancik b61fea8666 Remove downscaling from dataloading (#340) 2022-09-05 10:33:46 -07:00
evonneng b0f6d75cdf refactored dataset names + multi-gpu running (#321)
* refactored dataset names + multi-gpu running

* update comments + docs
2022-09-01 18:22:11 -07:00
Terrance WangandEthan Weber 8670f19d2d Terrance/tensorf (#218)
* added tensorf, updated requirements for windows

* cleaning up imports

* tensorf changes

* initial working version of tensorf

* added callback for feature upsampling

* modifying tests to match changes

* reverting requirements changes

* reverting unnecessary changes

* reverting unnecessary changes

* no more upsampling on step 0

* removed density field, fixed error msg

* modified callbacks and upsampling, reinitializing optimzer in training loop

* deleting tensorf_field file"

* checkpointing progress on restructuring callbacks

* updated callback logic for before and after train capabilities

* fixing upsampling stepping

* merging

* adding tensorf to config, fixing some bugs with new callback

* changed the way callbacks detected steps argument in callback func

* fixing typing

* adding pylint disable no self use to get_training_callbacks

* fixing config

* changing callback in vanilla nerf to allow for no density field

* cleanup

* removing config yaml

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-08-31 23:29:13 -07:00
Ethan Weber 2cca012ad8 Clickable viewer deployment (#308)
* first commit for clickable web viewer

* pylint ignore

* functional clickable viewer with updated docs

* fixed logging
2022-08-29 22:50:57 -07:00
Matthew Tancik 04d0165a24 Camera Refactor (#301)
* Start camera refactor

* Training runs, but transforms incorrect

* Cameras render correctly in viewer.

* Fix eval

* cleanup

* cleanup
2022-08-29 13:09:02 -07:00
Ethan Weberandevonneng 7e9a56fac4 Config restructure (#283)
* starting docs for pipelines

* working on an example

* clearing output

* starting to implement config changes and add documentation

* wip: removed cicular imports; porting basic config into python; todo: get python setups workin

* circular imports again

* wip: pausing at dataloader sort of working

* break for today

* running vanilla

* wip need to get all the config docs working

* laptop about to die

* instant ngp working

* added all configs for all methods; not tested yet: [mipnerf360, nerfw, semantic_nerf]

* unpacking later

* done with pylinting

* mostly done. just need to do docs and one test

* added import order to docs

* fixing near/far plane and other config things

* making loggers also instantiable via configs

* docs

* lint

* making --help work with dcargs

* moving configs back into flat

* convert list to tuples; fixed post init function with mutable params

* lint

* made run_eval and benchmarking scripts compatible with new config/dcargs

* lint

* added option to load configs from presaved config

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-08-26 17:25:10 -07:00
evonneng 1f1631cec6 removing callable modules from script/ 2022-08-15 21:31:43 +00:00
Ethan WeberandJake Austin 0b042be956 Pipeline v2 (#258)
* Model class done, pipeline class still needs more visualization stuffs

* Renaming the BaseDataContainer to DataloaderOutputs and adding documentation

* Pushing more documentation, removing some trivial functions

* Updating dict typing

* Removing config dicts for collider

* Passing tests

* Pushing shell new dataloader

* Saving work, need to fix NGP model's get_loss_dict and Pipeline

* V1 of the ngp pipeline should be done. Need train script and debugging

* Updating with latest instant-ngp code

* Syntax updates from latest ngp graph code

* Linter, removing unneeded code in new NGP graph code

* Style

* Should be good now. Linter is happy and the code is verbatum current instant-ngp

* Everything done except novel view testing code

* Fixing some nitpicks

* Debugging dataloader

* merged master

* WOP. integrating pipeline with configs and notebook demo

* removing model folder

* a lot of name changing from Graph to Model

* in progress... changing trainer to use pipeline... broken right now

* pipeline code runs

* switched to val dataset

* makes run_eval.py work

* updated configs for pipeline change

* fixing test_run_train script

* fixing black and linting

* fix docs

* small updates to trainer

Co-authored-by: Jake Austin <jake-austin@berkeley.edu>
2022-08-10 14:59:45 -07:00
Ethan Weber 73fedc7593 Viewer refactor with state sync (#212)
* initial commit for viewer refactor

* updating name change to nerfactory

* adding headers

* making the rendering fix which broke from a merge

* things are starting to work. removing old commands now

* removed prints

* cleanup

* updating state works now even for nested dictionaries

* updating state in redux. listening for state changes. trying to draw three.js now

* added drawing functionality. need to fix translation of frustums and image planes

* images and frustums drawn correctly

* fixing lint

* github actions

* back to npm

* fixing eslint

* remove package.json from root

* new favicon

* some viewer cleanup

* notebook

* fixed camera drawings speed to avoid redraw

* trying to get Leva to update

* quick fix

* synced config panel

* adding notebook

* fixing output print error
2022-08-02 16:02:07 -05:00
Matthew Tancik e35781fe85 Code cleanup (#234) 2022-07-31 18:22:57 -07:00
Matthew Tancik 58212543f5 Fix typing errors (#229) 2022-07-29 14:17:38 -07:00
Matthew Tancik a957e8c501 Move datasets to classes (#227) 2022-07-28 18:41:39 -07:00
Matthew Tancik 395b03f48c Add boolean visualization (#225) 2022-07-28 10:50:56 -07:00
Ruilong Li(李瑞龙) 1cd697366e sorting imports on save; cleanup imports sorting; add isort check (#207) 2022-07-26 14:35:38 -07:00
Matthew Tancik 6dc704c551 Rename repo to nerfactory (#204)
* Rename to nerfactory

* Fix missing files
2022-07-25 13:52:20 -07:00