4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
Commit Graph

133 Commits

Author SHA1 Message Date
Matthew Tancik
1bb0c88fb5
More renaming (#590) 2022-09-30 09:48:52 -07:00
Matthew Tancik
1f83ad03db
Rename to nerfstudio (#589) 2022-09-29 23:42:15 -07:00
Matthew Tancik
fae01d3ca6
Remove cuda from repo (#588)
Remove density grid and cuda
2022-09-29 19:00:36 -07:00
Matthew Tancik
5bc011e5fa
NGP with contraction (#580) 2022-09-29 13:18:49 -07:00
Ethan Weber
43d588f35f
specify a viewers list (#574)
* viewer list

* before master merge

* update script
2022-09-28 10:10:18 -07:00
Ethan Weber
cf34ef4bd0
rename files and add project scripts (#566)
* scripts

* b

* fix file
2022-09-27 15:02:55 -07:00
Ethan Weber
383a6075cc
[wip] proposal network sampler (#534)
* initial running code

* dozer and poster 6K experiments

* code reorganization

* removed print

* black
2022-09-25 16:56:29 -07:00
Ethan Weber
7b5a251a30
[wip] dynamic batch size for instant ngp (#501)
* starting dynamic batch size branch

* dynamic batch pipeline code
2022-09-21 14:07:04 -07:00
Ethan Weber
1d14263127
eval progress bar with more metrics (#499)
updated eval
2022-09-20 20:07:35 -07:00
evonneng
38f83de64b
removed post init method in config setup (#495)
* mrege

* nits
2022-09-20 14:56:48 -07:00
evonneng
c2a2b1de1e
changed base method names (#483)
* changed base method names

* fixed tests
2022-09-19 12:43:33 -07:00
evonneng
4e7ef375a2
[wip] logging separated s.t. only one is enabled (#458)
* updated viewer/writer configs

* allow viewer + tb/wandb but with errors; moved localwriter to its own thing

* nits and all

* update test
2022-09-17 17:50:11 -07:00
Ethan Weber
8973039e65
misc cleanup (#432)
* misc cuda improvements. added cone angle as param

* wandb as default. better organization for experiments

* turn off tensorboard

* disable eval when using viewer

* remove comment

* launch.json
2022-09-15 00:16:41 -07:00
Matthew Tancik
d839937376
Remove compound model from tests (#414) 2022-09-12 22:32:24 -07:00
Alexander Kristoffersen
d3dc9c5011
Unified place for all pose util methods. (#371)
* init pose utils.

* more tests.

* pose utils applied throughout codebase.

* added normalization.
2022-09-09 16:10:04 -07:00
Ethan Weber
7aa6ca9948
Kill the training script if the viewer ports are conflicting with other processes (#352)
kills program if conflicting ports for the viewer
2022-09-07 12:32:31 -07:00
Jake Austin
c033d1136e
Ray bundle latents add (#292)
* Making TensorDataclass reshape nested dict attributes.
2022-09-06 14:22:19 -07:00
evonneng
56113e6c75
[WIP] dataloading cleanup (#332)
* testing; need to merge

* fixing wrong base file in models/base

* pushed input parser into datasets class to abstract away fetching data in dataloader

* slight name chage and all

* nits

* added dataparser

* added licnese
2022-09-06 13:54:35 -07:00
Matt Tancik
12786b0ef9 Fix pytest warnings 2022-09-06 08:36:36 -07:00
Matthew Tancik
361358c6e6
Use smaller images to speed up testing (#345) 2022-09-05 18:03:44 -07:00
Matthew Tancik
b61fea8666
Remove downscaling from dataloading (#340) 2022-09-05 10:33:46 -07:00
evonneng
b0f6d75cdf
refactored dataset names + multi-gpu running (#321)
* refactored dataset names + multi-gpu running

* update comments + docs
2022-09-01 18:22:11 -07:00
Terrance Wang
8670f19d2d
Terrance/tensorf (#218)
* added tensorf, updated requirements for windows

* cleaning up imports

* tensorf changes

* initial working version of tensorf

* added callback for feature upsampling

* modifying tests to match changes

* reverting requirements changes

* reverting unnecessary changes

* reverting unnecessary changes

* no more upsampling on step 0

* removed density field, fixed error msg

* modified callbacks and upsampling, reinitializing optimzer in training loop

* deleting tensorf_field file"

* checkpointing progress on restructuring callbacks

* updated callback logic for before and after train capabilities

* fixing upsampling stepping

* merging

* adding tensorf to config, fixing some bugs with new callback

* changed the way callbacks detected steps argument in callback func

* fixing typing

* adding pylint disable no self use to get_training_callbacks

* fixing config

* changing callback in vanilla nerf to allow for no density field

* cleanup

* removing config yaml

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-08-31 23:29:13 -07:00
Ethan Weber
2cca012ad8
Clickable viewer deployment (#308)
* first commit for clickable web viewer

* pylint ignore

* functional clickable viewer with updated docs

* fixed logging
2022-08-29 22:50:57 -07:00
Matthew Tancik
04d0165a24
Camera Refactor (#301)
* Start camera refactor

* Training runs, but transforms incorrect

* Cameras render correctly in viewer.

* Fix eval

* cleanup

* cleanup
2022-08-29 13:09:02 -07:00
Ethan Weber
7e9a56fac4
Config restructure (#283)
* starting docs for pipelines

* working on an example

* clearing output

* starting to implement config changes and add documentation

* wip: removed cicular imports; porting basic config into python; todo: get python setups workin

* circular imports again

* wip: pausing at dataloader sort of working

* break for today

* running vanilla

* wip need to get all the config docs working

* laptop about to die

* instant ngp working

* added all configs for all methods; not tested yet: [mipnerf360, nerfw, semantic_nerf]

* unpacking later

* done with pylinting

* mostly done. just need to do docs and one test

* added import order to docs

* fixing near/far plane and other config things

* making loggers also instantiable via configs

* docs

* lint

* making --help work with dcargs

* moving configs back into flat

* convert list to tuples; fixed post init function with mutable params

* lint

* made run_eval and benchmarking scripts compatible with new config/dcargs

* lint

* added option to load configs from presaved config

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-08-26 17:25:10 -07:00
evonneng
1f1631cec6 removing callable modules from script/ 2022-08-15 21:31:43 +00:00
Ethan Weber
0b042be956
Pipeline v2 (#258)
* Model class done, pipeline class still needs more visualization stuffs

* Renaming the BaseDataContainer to DataloaderOutputs and adding documentation

* Pushing more documentation, removing some trivial functions

* Updating dict typing

* Removing config dicts for collider

* Passing tests

* Pushing shell new dataloader

* Saving work, need to fix NGP model's get_loss_dict and Pipeline

* V1 of the ngp pipeline should be done. Need train script and debugging

* Updating with latest instant-ngp code

* Syntax updates from latest ngp graph code

* Linter, removing unneeded code in new NGP graph code

* Style

* Should be good now. Linter is happy and the code is verbatum current instant-ngp

* Everything done except novel view testing code

* Fixing some nitpicks

* Debugging dataloader

* merged master

* WOP. integrating pipeline with configs and notebook demo

* removing model folder

* a lot of name changing from Graph to Model

* in progress... changing trainer to use pipeline... broken right now

* pipeline code runs

* switched to val dataset

* makes run_eval.py work

* updated configs for pipeline change

* fixing test_run_train script

* fixing black and linting

* fix docs

* small updates to trainer

Co-authored-by: Jake Austin <jake-austin@berkeley.edu>
2022-08-10 14:59:45 -07:00
Ethan Weber
73fedc7593
Viewer refactor with state sync (#212)
* initial commit for viewer refactor

* updating name change to nerfactory

* adding headers

* making the rendering fix which broke from a merge

* things are starting to work. removing old commands now

* removed prints

* cleanup

* updating state works now even for nested dictionaries

* updating state in redux. listening for state changes. trying to draw three.js now

* added drawing functionality. need to fix translation of frustums and image planes

* images and frustums drawn correctly

* fixing lint

* github actions

* back to npm

* fixing eslint

* remove package.json from root

* new favicon

* some viewer cleanup

* notebook

* fixed camera drawings speed to avoid redraw

* trying to get Leva to update

* quick fix

* synced config panel

* adding notebook

* fixing output print error
2022-08-02 16:02:07 -05:00
Matthew Tancik
e35781fe85
Code cleanup (#234) 2022-07-31 18:22:57 -07:00
Matthew Tancik
58212543f5
Fix typing errors (#229) 2022-07-29 14:17:38 -07:00
Matthew Tancik
a957e8c501
Move datasets to classes (#227) 2022-07-28 18:41:39 -07:00
Matthew Tancik
395b03f48c
Add boolean visualization (#225) 2022-07-28 10:50:56 -07:00
Ruilong Li(李瑞龙)
1cd697366e
sorting imports on save; cleanup imports sorting; add isort check (#207) 2022-07-26 14:35:38 -07:00
Matthew Tancik
6dc704c551
Rename repo to nerfactory (#204)
* Rename to nerfactory

* Fix missing files
2022-07-25 13:52:20 -07:00
Ruilong Li(李瑞龙)
12cd321e1a
Update Instant-NGP & Density Grid with CUDA supports. Much faster and better PSNR. (#193) 2022-07-24 22:22:44 -07:00
Matthew Tancik
441dcd5314
Add mix precision training (#172)
* Add mix precision training

* Disable mixed precision for cpu
2022-07-20 13:21:06 -07:00
Ethan Weber
05b92e228b
Fixing nerfw and adding to GH Actions (#167)
* added beta_min to nerfw, which I think is needed

* added camera interpolation path and restructured run_eval code

* adding to gitignore

* addressing github comments. mostly documentation

* fixing nerfw dataset for test cases
2022-07-19 16:21:54 -07:00
Ruilong Li
1f38240212 fix axis arg to dim for pytorch funcs 2022-07-13 20:31:38 +00:00
Ethan Weber
4ddd146633
Improving eval script with camera trajectory videos (#124)
* spiral traj working, specify version for hydra, better documentation

* cleaned up spiral trajectory a bit
2022-07-13 10:58:01 -07:00
evonneng
898d9384a5
added logic to check all graphs in testing (#111)
* added logic to check all graphs in testing

* fixed path to test dataset
2022-07-11 16:05:44 -07:00
Matthew Tancik
74280110ce
Remove redundant data (#103)
RaySamples contained fields for bin_starts and bin_ends. These are also stored in the frustums. This PR removes them from the RaySamples.
2022-07-07 18:07:34 -07:00
Ethan Weber
74ec84117e
cleaning up viewer code (#101) 2022-07-07 16:00:30 -07:00
Ethan Weber
44c5e3264c
Documenting viewer and faster image sending (#86)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* name change

* starting viewer docs

* new workflow

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* homepage

* homepage

* / to ?

* more documentation

* fixed none error

* instant ngp fix

* faster image sending over tcp. instant ngp bin fix. lowest res when moving

* black

* requirements
2022-07-07 00:03:45 -07:00
Matt Tancik
bd78a68756 Update RaySamples to TensorDataclass 2022-07-06 12:01:09 -07:00
Matthew Tancik
59957fa202
Use tensordataclasses (#85)
+ Convert Frustum and RayBundle into TensorDataclasses.
+ Support TensorDataclass fields in TensorDataclasses
+ Support non batched types in TensorDataclass (The are iignored)
2022-07-05 18:32:43 -07:00
Matt Tancik
711f69fe24 Add TensorDataclass 2022-07-04 16:19:48 -07:00
Matt Tancik
5a1c8a1c86 Remove point samples 2022-07-01 09:36:59 -07:00
Matt Tancik
65fe212d17 Add more samplers 2022-06-16 18:27:47 -07:00
Ethan Weber
1e22984d87
Initial viewer (visualizer) code (#52)
* some initial code for viewer. copying from other repos

* adding electron support

* moving some test files around. need to rewrite these

* camera traj. test cases. starting to transmit images

* still working on vis

* reorganized viewer and figured out websocket sending from client. need to do with camera pose

* black

* temporarily ignore pylinting for viewer

* ignore viewer

* fixed array

* license and fixed ignore in pyproject.toml

* improved syntax
2022-06-16 12:11:40 -07:00