4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 10:34:29 +08:00
Commit Graph

198 Commits

Author SHA1 Message Date
Alexander Kristoffersen
b471736a61
iPhone (Record3D) Dataset (#235)
* init branch commit.

* intrinsics done.

* created dataset for record3d.

* clean up and documentation.

* cleanup.

* fixed orientation.
2022-08-16 23:24:49 -07:00
evonneng
1f1631cec6 removing callable modules from script/ 2022-08-15 21:31:43 +00:00
evonneng
efd5d39652
updating scripts; compatible with pipeline refactor (#278) 2022-08-15 13:26:37 -07:00
Ethan Weber
55ebaaf1b5
Hosting the viewer & webrtc logging (#271)
* might fix the stun server issue

* still debugging webrtc

* another turn server

* working on github actions

* updating actions file

* fixing actions

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* updating viewer

* update docs
2022-08-14 00:15:34 -07:00
evonneng
8e32e7863e
fixed broken ga; unable to import scripts/ (#274)
added init to scripts/
2022-08-12 09:23:51 -07:00
Ethan Weber
0b042be956
Pipeline v2 (#258)
* Model class done, pipeline class still needs more visualization stuffs

* Renaming the BaseDataContainer to DataloaderOutputs and adding documentation

* Pushing more documentation, removing some trivial functions

* Updating dict typing

* Removing config dicts for collider

* Passing tests

* Pushing shell new dataloader

* Saving work, need to fix NGP model's get_loss_dict and Pipeline

* V1 of the ngp pipeline should be done. Need train script and debugging

* Updating with latest instant-ngp code

* Syntax updates from latest ngp graph code

* Linter, removing unneeded code in new NGP graph code

* Style

* Should be good now. Linter is happy and the code is verbatum current instant-ngp

* Everything done except novel view testing code

* Fixing some nitpicks

* Debugging dataloader

* merged master

* WOP. integrating pipeline with configs and notebook demo

* removing model folder

* a lot of name changing from Graph to Model

* in progress... changing trainer to use pipeline... broken right now

* pipeline code runs

* switched to val dataset

* makes run_eval.py work

* updated configs for pipeline change

* fixing test_run_train script

* fixing black and linting

* fix docs

* small updates to trainer

Co-authored-by: Jake Austin <jake-austin@berkeley.edu>
2022-08-10 14:59:45 -07:00
evonneng
0d6060e0f0
Sync run_eval with benchmarking script (#260)
* added new .sh script for eval; removed old python script

* fixed changing dataset

* done refactoring eval script
2022-08-09 18:23:01 -07:00
evonneng
6281896e1d
fixed profiler bug with variable options (#254) 2022-08-08 09:53:12 -07:00
evonneng
c5acc9cc88
bug: using all data for eval now 2022-08-03 09:32:02 -07:00
Ethan Weber
73fedc7593
Viewer refactor with state sync (#212)
* initial commit for viewer refactor

* updating name change to nerfactory

* adding headers

* making the rendering fix which broke from a merge

* things are starting to work. removing old commands now

* removed prints

* cleanup

* updating state works now even for nested dictionaries

* updating state in redux. listening for state changes. trying to draw three.js now

* added drawing functionality. need to fix translation of frustums and image planes

* images and frustums drawn correctly

* fixing lint

* github actions

* back to npm

* fixing eslint

* remove package.json from root

* new favicon

* some viewer cleanup

* notebook

* fixed camera drawings speed to avoid redraw

* trying to get Leva to update

* quick fix

* synced config panel

* adding notebook

* fixing output print error
2022-08-02 16:02:07 -05:00
Matthew Tancik
966374474d
Update docs (#244)
* Update docs

* black
2022-08-02 13:51:45 -07:00
evonneng
2c40c1b2bc
Eng/better benchmarking (#240)
* add print

* updated benchmark for more fine-grain options
2022-08-01 23:14:01 -07:00
Matthew Tancik
e35781fe85
Code cleanup (#234) 2022-07-31 18:22:57 -07:00
Matthew Tancik
a957e8c501
Move datasets to classes (#227) 2022-07-28 18:41:39 -07:00
Ruilong Li(李瑞龙)
31c813e0df
fix so that benchmarking load the latest experiment (#220) 2022-07-27 15:56:24 -07:00
Matthew Tancik
828365ad30
Update documentation guides (#208) 2022-07-26 16:07:45 -07:00
Ruilong Li(李瑞龙)
1cd697366e
sorting imports on save; cleanup imports sorting; add isort check (#207) 2022-07-26 14:35:38 -07:00
Matthew Tancik
6050dfb6e3
Update to myst_nb (#206)
* Update to myst_nb

* Fix action

* Remove action for now
2022-07-25 19:22:39 -07:00
evonneng
899d990387 lint 2022-07-25 21:28:29 +00:00
evonneng
d09d22ea5e Merge branch 'master' of github.com:pyradiance/radiance 2022-07-25 21:22:43 +00:00
evonneng
24ab477b45 fixed dataset loading in benchmark 2022-07-25 21:22:29 +00:00
Matthew Tancik
6dc704c551
Rename repo to nerfactory (#204)
* Rename to nerfactory

* Fix missing files
2022-07-25 13:52:20 -07:00
Abhik Ahuja
31b52ae186
Merge pull request #190 from plenoptix/origamiman72/rays-formatting
Changed Rays / Sec formatting
2022-07-24 02:19:45 -07:00
Ethan Weber
6cfccab336
fixing eval dataloader indices issue (#196)
* added some logic for the indices when none

* forgot to comment out code

* fix linting

* fixed typing
2022-07-22 16:29:14 -07:00
origamiman72
66d23199ff Added human readable formatting 2022-07-21 21:47:05 -07:00
origamiman72
8cfe141fd7 Changed Rays / Sec formatting 2022-07-20 17:52:36 -07:00
Matthew Tancik
5cee32074a
Add dcargs (#178)
* Add dcargs

* Add dcargs to run_actions
2022-07-19 18:23:40 -07:00
Ethan Weber
05b92e228b
Fixing nerfw and adding to GH Actions (#167)
* added beta_min to nerfw, which I think is needed

* added camera interpolation path and restructured run_eval code

* adding to gitignore

* addressing github comments. mostly documentation

* fixing nerfw dataset for test cases
2022-07-19 16:21:54 -07:00
Matt Tancik
f77d1fc110 Update docstrings and add missing types 2022-07-19 16:12:05 -07:00
evonneng
b725d5dafa removed viewer from benchmarking 2022-07-19 01:29:09 +00:00
evonneng
3df29717dd
added avg total fps (#170)
* added fps as benchmarking stats

* update total avg for fps/rays/s
2022-07-18 12:56:32 -07:00
Matthew Tancik
33eff4d0fc
run_actions propagate docs error (#163)
* run_actions propagate docs error
2022-07-16 16:23:36 -07:00
evonneng
cc9a438057
added fps as benchmarking stats (#142) 2022-07-14 17:04:47 -07:00
Matthew Tancik
e0fb77bf1a
Tancik/lint and format scripts (#140)
* Lint and formatter to include scripts folder
2022-07-14 11:12:23 -07:00
Ethan Weber
4ddd146633
Improving eval script with camera trajectory videos (#124)
* spiral traj working, specify version for hydra, better documentation

* cleaned up spiral trajectory a bit
2022-07-13 10:58:01 -07:00
Matthew Tancik
9efcfad4f3
Add extra checks for license (#120)
Add extra checks for license
2022-07-12 16:49:04 -07:00
Brent Yi
14d030ff6f
Various minor fixes for typos and types (#105)
* minor fixes for typos and types

* run isort
2022-07-07 23:31:56 -07:00
Ethan Weber
74ec84117e
cleaning up viewer code (#101) 2022-07-07 16:00:30 -07:00
evonneng
d0d2fbe4a0 Merge branch 'master' of github.com:pyradiance/radiance 2022-07-07 18:59:57 +00:00
evonneng
39b67e6fe9 update benchmarking; add clip to mipnerf lpips 2022-07-07 18:59:23 +00:00
Matt Tancik
31a465c62f Run_actions quit on failed action 2022-07-07 11:35:16 -07:00
Ethan Weber
44c5e3264c
Documenting viewer and faster image sending (#86)
* updated three.js version. only send camera information when it moves

* changing code back to updating camera constantly because packets seem to be lost

* name change

* starting viewer docs

* new workflow

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* homepage

* homepage

* / to ?

* more documentation

* fixed none error

* instant ngp fix

* faster image sending over tcp. instant ngp bin fix. lowest res when moving

* black

* requirements
2022-07-07 00:03:45 -07:00
evonneng
ee4e6b24f4
Added structured config support (#58)
* added typed config; idealy would convert graph to typed too....

* added graph as config
2022-06-17 08:46:03 -07:00
evonneng
d65b50a0e3
Removed hardcoding in benchmarking code (#59)
* updated benchmarking script

* removed annoying benchmarking hardcoding
2022-06-16 20:14:10 -07:00
evonneng
91ef54963c
refactoring configs; pulled network out of graph; created trainer heirarchy (#51)
* changed config graph structure

* removed network udner graphs; added new heirarchy trainer

* fixed callback in occupancy graph

* lint

* changed register callback to setter method
2022-06-15 09:06:43 -07:00
evonneng
f67dca6f5b
refactor moving setup functions to associated classes; cleanup eval and benchmark scripts (#48)
* refactor code to move graph/dataset setup to respective files

* consolidated eval and benchmark script

* moved setup optimizers to its own thing
2022-06-13 19:05:07 -07:00
evonneng
b2648c6522 updated benchmarking to match new config 2022-06-14 00:15:05 +00:00
evonneng
bed39763a1
updated benchmarking script (#32) 2022-06-08 17:39:15 -07:00
evonneng
5433f831ac
add licensing headers (#27)
* add licensing headers

* add licensing to run actions

* rerun headers file

* remove trailing white spaces
2022-06-08 13:31:13 -07:00
Ethan Weber
d16f87a957 fixing blender scene training with vanilla nerf 2022-06-08 18:00:51 +00:00
Ethan Weber
457788d689
dataloader logic, new folder structure, flatter configs (#26)
* renaming dataloader to data. adding some dataloader classes

* restructuring configs

* fixed instant ngp tcnn direction rescaling

* working through test cases

* black and lint and tests
2022-06-08 09:01:56 -07:00
evonneng
9fa87173fd added make file run in debug 2022-06-07 03:04:00 +00:00
evonneng
e8118f0569 merge 2022-06-03 17:51:01 +00:00
evonneng
394b1748ea update readmes 2022-06-03 17:49:27 +00:00
Ethan Weber
146332cfb6
Refactoring (data loading, semantic-nerf/nerf-w fixes, ...) (#8)
* in progress. camera_indices broken

* faster dataloader. starting on pixel sampler logic

* imagesampler and pixelsampler

* lint and black

* continuing merge

* pytest working

* fixed docs

* docs

* minor changes
2022-06-02 14:58:46 -04:00
evonneng
3e86682f69 merge 2022-05-31 22:10:29 +00:00
evonneng
19109270fe update getting around readme 2022-05-31 21:50:26 +00:00
Matt Tancik
1a8ad9a763 Change name to pyrad 2022-05-31 14:15:06 -07:00
evonneng
84d01ddd25
add print to beginning of train (#114)
* added print unrolled config to beginning of train
2022-05-30 11:42:58 -07:00
evonneng
fbcf3cb831
Eng/better configs (#113)
* update possible config setup

* finished porting remaning configs

* fix bugs

* change mattprot to radiance in config
2022-05-30 10:47:49 -07:00
Matt Tancik
b26408eb7a Adios mattport 2022-05-30 09:24:12 -07:00
evonneng
9d2b34ab60
Added auto find gpu; added method name to arg list (#111)
* update benchmarking for better practice

* fixed logic for finding/distributing across GPUS

* added method to argument list
2022-05-30 09:01:52 -07:00
evonneng
5e9d064db6
update benchmarking for better practice (#107) 2022-05-24 12:37:45 -07:00
Ethan Weber
7d8beaaed4
Tiny-cuda-nn and fixed logic for instant-ngp (#102)
* correcting implementation for instant ngp

* instant ngp with tcnn

* black and pylint

* merged master
2022-05-23 12:05:41 -07:00
evonneng
1f719b49c0 Merge branch 'master' of github.com:ethanweber/mattport 2022-05-18 22:33:13 +00:00
evonneng
c19deabc2e benchmarking details; todo: might need to move this out 2022-05-18 22:33:06 +00:00
Matthew Tancik
443fdef553
Run black on ipynb (#80) 2022-05-18 09:36:38 -07:00
Ethan Weber
676beebb14
Setting near and far with scene bounds collider. Also LR schedules. (#74)
* some initial cuda code as I learn. using git to save progress.

* first cuda kernel for ray sampling that mostly works

* cleaning up code. working on lr. structs for scene bounds aabb

* added scene bounds collider code

* updated setup

* setup

* setup

* black

* including some files

* exporting env variable

* new file

* git workflows

* github actions

* github actions

* github actions

* removing env var
2022-05-16 14:03:19 -07:00
Ethan Weber
1c1a58c4e5
nerf-w and semantic-nerf initial implementations (#73)
* initial nerfw code

* nerfw should be implmented correctly now

* semantic nerf in progress. data loader is too slow and not clean right now

* added implementation of semantic nerf

* mend
2022-05-13 17:44:16 -07:00
evonneng
6a70eaa40a fixed up benchmarking test script more versatile 2022-05-12 17:32:53 +00:00
evonneng
fda2d448c4 done adding test benchmark script 2022-05-12 00:45:20 +00:00
evonneng
a15185ea47 fixed train iteration to much longer 2022-05-11 19:22:20 +00:00
evonneng
58cdcc2b41 update model saving 2022-05-11 18:27:42 +00:00
evonneng
9671ec3c33 update readme 2022-05-11 17:59:35 +00:00
evonneng
a498a6cc64
Standardized logging code to all global var; writers now accessible from all files (#62)
* added skeleton for terminal logger

* done skeleton terminal writer logic... todo: actual calls to the write classes

* moved lambda to top function

* added logic to support timing

* prettier printing

* prettier printing

* lint

* separated out timing and other stats variables. printing in dict format

* keeping logging history and wiping rest

* updated logic to calculate total times instead of average times

* made stats tracker configurable

* moved stats tracker and profiler to own class file; implemented basic functionality for profiler

* lint removing duplicate function

* update readme; moved around config variables

* profiler prints on sig kill

* merge

* standardized all logging to global variables
2022-05-06 21:55:33 -07:00
evonneng
3a35bcda91
adding scripts for easy local run (#59) 2022-05-05 13:48:34 -07:00
Ethan Weber
0b82c1188c
Colmap type of dataset (from "friends" project) (#56)
* code to process the friends data. need to add masking

* code to process the friends data. need to add masking

* black

* trying to fix black

* black fixed

* updating black version
2022-05-05 08:45:30 -07:00
Ethan Weber
023e6a3f92 merging masters new config 2022-04-29 22:29:43 +00:00
Ethan Weber
387ad93027 merging 2022-04-29 22:10:36 +00:00
evonneng
a93dace958
modularizing hydra config and setting defaults (#46)
* lint

* reconfigured modules in yaml
2022-04-29 14:39:43 -07:00
Ethan Weber
7b118750ec merged master into this 2022-04-29 21:37:10 +00:00
Ethan Weber
6b17ad51c6 cpu support and multi gpu progress 2022-04-29 21:29:13 +00:00
evonneng
86b1011ae1
Printing profile on sig kill. (#44)
* added skeleton for terminal logger

* done skeleton terminal writer logic... todo: actual calls to the write classes

* moved lambda to top function

* added logic to support timing

* prettier printing

* prettier printing

* lint

* separated out timing and other stats variables. printing in dict format

* keeping logging history and wiping rest

* updated logic to calculate total times instead of average times

* made stats tracker configurable

* moved stats tracker and profiler to own class file; implemented basic functionality for profiler

* lint removing duplicate function

* update readme; moved around config variables

* profiler prints on sig kill
2022-04-29 11:10:34 -07:00
Ethan Weber
dd6f79fc40 using test images. including some local data. black on save. disabled warnings for pytest 2022-04-29 16:23:05 +00:00
Ethan Weber
cf7034f0d1 added test set (using training data for now) 2022-04-22 03:45:06 +00:00
Ethan Weber
b6f878f227 merge 2022-04-21 20:29:43 +00:00
evonneng
4d1a6b2dbd
cleanup and added logic to train for load/save checkpoints (#32)
* added checkpointing logic

* small nits

* check DDP running correctly

* cleanup and added logic to train for load/save checkpoints

* lint
2022-04-21 11:39:44 -07:00
Ethan Weber
be6fbe799e most code for nerf running 2022-04-19 22:32:10 +00:00
evonneng
b8e2713643 Changed Graph to nn.ModuleDict; Added DDP logic to seup_graph; locallyrunning DDP 2022-04-15 23:35:00 +00:00
evonneng
62d4218421 updated logic within Trainer class to allow for multiprocess training 2022-04-15 21:53:35 +00:00
evonneng
ac3e7515ef done adding main logic in run_train_nerf to initialize processes with more robust handling of DDP 2022-04-15 21:33:50 +00:00
evonneng
7dc9d445b2 added basic distributed logic for trainer 2022-04-15 01:04:17 +00:00
Ethan Weber
0b7dfcdc5d
Initial ray generation and dataset code (#12)
* ray generator and cameras structure progress

* test renames

* added pass

* conflicts

* fixing some black errors

* reformated files

* merged master and .gitignore

* fixing linting

* removing old folder

* removed return False

* pylint fixes

* update

* updates

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
2022-04-12 15:08:16 -07:00
Ethan Weber
5691d00d42 fixed most linting errors 2022-04-07 20:22:48 +00:00
Ethan Weber
a7167f890e brainstorming trainer code but broken 2022-04-06 22:45:53 +00:00
Ethan Weber
a9c0d5b97f hydra config and starting trainer class 2022-04-06 16:46:47 +00:00
Ethan Weber
b63d5854a1 reworked structure to use packages 2022-04-02 20:07:41 +00:00
Ethan Weber
6aae70df32 first commit 2022-03-29 17:26:54 +00:00