4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 10:34:29 +08:00
Commit Graph

43 Commits

Author SHA1 Message Date
Matthew Tancik
0181ce71a9
Add appearance conditioning to proposal net (#544) 2022-09-26 13:41:17 -07:00
Ethan Weber
383a6075cc
[wip] proposal network sampler (#534)
* initial running code

* dozer and poster 6K experiments

* code reorganization

* removed print

* black
2022-09-25 16:56:29 -07:00
Matthew Tancik
aea0cfc253
Add dynamic batching to compound model (#535) 2022-09-24 21:40:23 -07:00
Matthew Tancik
1044defd1b
Remove occluded samples during training. (#530)
remove occluded samples during training.
2022-09-23 16:24:32 -07:00
Alexander Kristoffersen
a1152be22b
Small device bug in mipnerf (#506)
device bug in mipnerf.
2022-09-21 16:35:41 -07:00
Ethan Weber
7b5a251a30
[wip] dynamic batch size for instant ngp (#501)
* starting dynamic batch size branch

* dynamic batch pipeline code
2022-09-21 14:07:04 -07:00
Ethan Weber
1d14263127
eval progress bar with more metrics (#499)
updated eval
2022-09-20 20:07:35 -07:00
Ethan Weber
35c8d7e53c
misc viewer fixes including when no samples in a chunk (#491)
viewer fixes
2022-09-19 18:36:26 -07:00
Matthew Tancik
a43776d76d
Speedup eval and training with better data management (#492)
move to tensors to gpu earlier
2022-09-19 18:36:12 -07:00
Matthew Tancik
96e1f2a698
Disable occlusion sampling and speed up eval (#488)
disable occlusion sampling and speed up eval
2022-09-19 17:38:47 -07:00
Ethan Weber
4250161922
moving timing around (#487)
* moved timing functions around

* lint
2022-09-19 15:58:40 -07:00
Matthew Tancik
8b388a3e5c
Remove defaults from docstrings. (#480) 2022-09-19 10:04:25 -07:00
Jake Austin
96d4974d73
Cleaning Model() function signatures (#433)
Removing different model.forward() functions, eliminating overloading, making it easier to understand
2022-09-19 02:44:20 -07:00
Matthew Tancik
2be4625b4f
Migrate compound model to nerfacc (#474) 2022-09-18 14:14:30 -07:00
Matthew Tancik
32943caf5b
Update to nerfacc 0.0.8 (#471) 2022-09-18 13:21:50 -07:00
Matthew Tancik
18d3281538
Align nerfacc renderers with nerfactory (#464)
add cuda support to renderers
2022-09-17 19:07:05 -07:00
Matthew Tancik
fe66547f24
Cleanup nerfacc integration (#463)
* cleanup nerfacc implementation

* typing
2022-09-17 18:17:58 -07:00
Matthew Tancik
a79ef3fb11
Breaking up nerfacc (#462)
* Breaking up nerfacc

* add background color
2022-09-17 17:33:54 -07:00
Ethan Weber
e22eab8c86
updating metrics logging (#460)
* integrated changes

* update

* stratified

* black

* bump version

* upgrade version

* improved wandb logging

* fix split for eval

* comments
2022-09-16 17:27:55 -07:00
Terrance Wang
84024a4e73
compound model (wip) (#427)
* compound model now uses compound field, passing num_images in the config, working on passing image indices through ngp sampler

* renaming cuda func, adding torch compound support

* removing unused imports

* getting num images from dataloader instead of config

* fixing pylint and adding todo

* undoing base config change

* adding cone angle and near plane to compound model config
2022-09-16 14:38:25 -07:00
Matthew Tancik
2495cfe1ee
Add nerfacc raymarching (#455)
* Add nerfacc raymarching

* Docstring update
2022-09-16 12:24:02 -07:00
Ethan Weber
5ccb8277d1
nerfacc integration (#447)
* integrated changes

* update

* stratified

* black

* bump version

* upgrade version
2022-09-16 09:51:19 -07:00
Matthew Tancik
695d9a1777
Add near plane to NGP sampler (#443) 2022-09-15 17:42:42 -07:00
Ethan Weber
8973039e65
misc cleanup (#432)
* misc cuda improvements. added cone angle as param

* wandb as default. better organization for experiments

* turn off tensorboard

* disable eval when using viewer

* remove comment

* launch.json
2022-09-15 00:16:41 -07:00
evonneng
4801a99b2a
improve memory consumption by clearing cache + move image to cpu (#412)
* reduced mem on train; figuring out memory leak on visualizer

* steadily below 10G memory

* cpu loading image

* update docstrings

* added scrolling

* Revert "update docstrings"

This reverts commit a914387cf8.

* Revert "Revert "update docstrings""

This reverts commit 177c3dd6f1.

* Revert "added scrolling"

This reverts commit f37351ee7f.
2022-09-12 23:00:44 -07:00
Terrance Wang
47ea7b5b72
Terrance/combined model (#402)
* adding spatial distortion to instantngp field

* adding scene contraction to instant ngp

* rename compound, fixing configs

* adding nerfw conditioning

* added appearance embeddings, scene contraction disabled

* adding docstrings
2022-09-12 21:49:19 -07:00
evonneng
d50c71ac43
update docstrings and random cleanups (#387)
* fixing docstrings and small nits; up to fileds

* finished adding and fixing docstrings
2022-09-10 23:09:44 -07:00
Ethan Weber
512a51f714
Fixed friends dataset w/o caching (#365)
* fixing friends dataloading and nerfw running

* put dataset back to normal
2022-09-07 12:24:29 -07:00
evonneng
fcba56b9b6
merge populate functions (#353) 2022-09-06 16:44:34 -07:00
evonneng
56113e6c75
[WIP] dataloading cleanup (#332)
* testing; need to merge

* fixing wrong base file in models/base

* pushed input parser into datasets class to abstract away fetching data in dataloader

* slight name chage and all

* nits

* added dataparser

* added licnese
2022-09-06 13:54:35 -07:00
evonneng
b0f6d75cdf
refactored dataset names + multi-gpu running (#321)
* refactored dataset names + multi-gpu running

* update comments + docs
2022-09-01 18:22:11 -07:00
Matthew Tancik
f910836b8c
Cleanup (#325)
cleanup
2022-09-01 12:36:54 -07:00
Terrance Wang
9b0cf2ab16
Terrance/instant ngp bug (#324)
* adding after iter callbacks in training loop

* moved callback

* fixed network name

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-09-01 12:11:28 -07:00
Terrance Wang
8670f19d2d
Terrance/tensorf (#218)
* added tensorf, updated requirements for windows

* cleaning up imports

* tensorf changes

* initial working version of tensorf

* added callback for feature upsampling

* modifying tests to match changes

* reverting requirements changes

* reverting unnecessary changes

* reverting unnecessary changes

* no more upsampling on step 0

* removed density field, fixed error msg

* modified callbacks and upsampling, reinitializing optimzer in training loop

* deleting tensorf_field file"

* checkpointing progress on restructuring callbacks

* updated callback logic for before and after train capabilities

* fixing upsampling stepping

* merging

* adding tensorf to config, fixing some bugs with new callback

* changed the way callbacks detected steps argument in callback func

* fixing typing

* adding pylint disable no self use to get_training_callbacks

* fixing config

* changing callback in vanilla nerf to allow for no density field

* cleanup

* removing config yaml

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2022-08-31 23:29:13 -07:00
evonneng
edf9f59940
moved num samples to instant ngp config (#304) 2022-08-29 15:50:59 -07:00
Matthew Tancik
04d0165a24
Camera Refactor (#301)
* Start camera refactor

* Training runs, but transforms incorrect

* Cameras render correctly in viewer.

* Fix eval

* cleanup

* cleanup
2022-08-29 13:09:02 -07:00
Ethan Weber
7e9a56fac4
Config restructure (#283)
* starting docs for pipelines

* working on an example

* clearing output

* starting to implement config changes and add documentation

* wip: removed cicular imports; porting basic config into python; todo: get python setups workin

* circular imports again

* wip: pausing at dataloader sort of working

* break for today

* running vanilla

* wip need to get all the config docs working

* laptop about to die

* instant ngp working

* added all configs for all methods; not tested yet: [mipnerf360, nerfw, semantic_nerf]

* unpacking later

* done with pylinting

* mostly done. just need to do docs and one test

* added import order to docs

* fixing near/far plane and other config things

* making loggers also instantiable via configs

* docs

* lint

* making --help work with dcargs

* moving configs back into flat

* convert list to tuples; fixed post init function with mutable params

* lint

* made run_eval and benchmarking scripts compatible with new config/dcargs

* lint

* added option to load configs from presaved config

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-08-26 17:25:10 -07:00
Matthew Tancik
86ea6de059
Fix type errors (#296) 2022-08-25 08:48:25 -07:00
Alexander Kristoffersen
261f1f3344
Double Scaling Bug Fix (#282)
remove duplicate scaling.
2022-08-16 13:25:41 -07:00
Jake Austin
cdacfdaf2e
Pushing more documentation (#276)
* Pushing more documentation

* Adding max length option to IterableWrapper, fixing nitpicks

* Removing use of word dummy from dataclass
2022-08-16 11:35:51 -07:00
evonneng
2d3452e5a2
Adding colormap customization on viewer (#272)
* set up logic for colormap defined by user on viewer

* ooops typo

* nit

* done with defaults

* lint
2022-08-12 17:35:53 -07:00
Ethan Weber
841e03a9a3
Default to train dataset when eval isn't specified in config (#265)
default to train dataset when eval isn't in config
2022-08-10 15:29:56 -07:00
Ethan Weber
0b042be956
Pipeline v2 (#258)
* Model class done, pipeline class still needs more visualization stuffs

* Renaming the BaseDataContainer to DataloaderOutputs and adding documentation

* Pushing more documentation, removing some trivial functions

* Updating dict typing

* Removing config dicts for collider

* Passing tests

* Pushing shell new dataloader

* Saving work, need to fix NGP model's get_loss_dict and Pipeline

* V1 of the ngp pipeline should be done. Need train script and debugging

* Updating with latest instant-ngp code

* Syntax updates from latest ngp graph code

* Linter, removing unneeded code in new NGP graph code

* Style

* Should be good now. Linter is happy and the code is verbatum current instant-ngp

* Everything done except novel view testing code

* Fixing some nitpicks

* Debugging dataloader

* merged master

* WOP. integrating pipeline with configs and notebook demo

* removing model folder

* a lot of name changing from Graph to Model

* in progress... changing trainer to use pipeline... broken right now

* pipeline code runs

* switched to val dataset

* makes run_eval.py work

* updated configs for pipeline change

* fixing test_run_train script

* fixing black and linting

* fix docs

* small updates to trainer

Co-authored-by: Jake Austin <jake-austin@berkeley.edu>
2022-08-10 14:59:45 -07:00