4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 18:44:21 +08:00
Commit Graph

240 Commits

Author SHA1 Message Date
Arjun Sharda
eae6bcb627
docs(scripts/eval.py) Update comments (#841)
Update eval.py
2022-10-27 20:01:30 +03:00
Alexander Kristoffersen
18a6a71a1a
Pathlib Python 3.7 Compatibility Fix (#831)
small fix.
2022-10-25 10:01:39 -07:00
Brent Yi
ae55559c32
Fix completion install script for bash (#830)
* Fix completion install script for bash

* Update install.py
2022-10-25 22:44:44 +08:00
Terrance Wang
3652d3112f
removing quotes on ffmpeg command (#822) 2022-10-22 20:06:25 -07:00
Julian Knodt
135ecf5ab8
Add D-NeRF dataset download (#815)
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2022-10-21 14:29:20 -07:00
Ethan Weber
6f4fb506e2
Multi-gpu improvements (#799)
* initial commit

* minor changes

* small changes

* ddp seems to be working

* remove commented out code
2022-10-20 01:11:40 -07:00
Matthew Tancik
9bed69601f
Support python 3.7 (#802)
* Support python 3.7

* Update docs
2022-10-18 16:49:27 -07:00
Matthew Tancik
8dedbe8787
Update insta360 docs (#793) 2022-10-16 18:05:23 -07:00
Matthew Tancik
8a461924f1
Refine intrinsics with COLMAP (#785)
Refine intrinsics with colmap
2022-10-16 12:53:11 -07:00
Matthew Tancik
ec901c893d
Add support for insta360 data (#781)
* Add support for insta360 data

* Update docs

* Revert unrelated changes

* remove cropping on normal videos

* Address comments
2022-10-15 22:25:21 -07:00
Ethan Weber
d71c05f256
Google Colab support with viewer (#747)
* allows bridge server to run on a different machine

* added script

* update version

* starting docs

* update docs and scripts

* ngrok support

* use tcp

* moving webrtc outside bridge server. wop

* lazy commit

* lazy commit

* running code. webrtc not working

* lazy commit

* better logic for webrtc connection

* cleanup

* todo comment

* working webrtc

* removed logging

* fixing black

* fix eslint

* fix python version

* fix readme

* misc cleanup

* small docs fix

Co-authored-by: Ethan Weber <ethanweber@Ethans-MacBook-Pro.local>
2022-10-14 15:05:28 -07:00
Ethan Weber
2150bad0e4
Reducing flicker artifacts for nerfacto method (#750)
* pose opt default nerfacto.

* added SO3 cam pose optimization which is slightly faster (~2.2m/iter) than BARF

* added occupancy grid with placeholder until nerfacc is updated to query density from it

* added occupancy grid sampling as the level 0 in proposal hierarchy, relies on nerfacc 0.1.7 (on pypi)

* merge main

* merge main

* minor changes to sampling

* adjusted sample number

* refactor occ grid stuff, settle on decent params

* nograd proposal sampling

* param tweaks

* varying resolution proposal networks

* params

* merged main

* optimizer update

* remove occ grid

* remove double nerfacto samples

* set single jitter to true

* remove pdb

* more changes

* fix method defaults

* fix pylint

* remove occupancy fn

Co-authored-by: akristoffersen <akristoffersen@berkeley.edu>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
2022-10-11 14:21:00 -07:00
Ethan Weber
569a698d4e
Improve process data with filename filters and saving mp4s (#756)
* Updated Discord link

* ns-process-data to grab only jpg and png

* Updated alert for an incorrect folder

* minor format updates

* black

Co-authored-by: Nik Ska <dokluch@gmail.com>
2022-10-11 10:29:29 -07:00
Brent Yi
7390e5c026
Fix view_dataset.py (#626)
* Fix view_dataset.py

* Update view_dataset.py
2022-10-08 22:17:19 -06:00
Ethan Weber
b37eae5bb2
save renders to a folder and bump viewer version (#733)
save data to renders folder. bump viewer
2022-10-07 15:14:18 -07:00
Ethan Weber
26a41923e5
update camera opt defaults (#732) 2022-10-07 14:59:02 -07:00
Ethan Weber
2531242d1d
integrating record3d and fix checkpoint delete issue (#722)
* integrating record3d

* fix save checkpoint logic

* added record3d data
2022-10-07 00:34:51 -07:00
Brent Yi
05d264a335
Reduced tyro overhead + helptext formatting (#719)
* `ns-train` helptext formatting for tyro 0.3.23

* Remove unused import
2022-10-06 13:33:42 -07:00
Matthew Tancik
9252a46273
Check ffmpeg before rendering video (#715)
* check ffmpeg before rendering video

* Fix imports
2022-10-06 09:41:36 -07:00
Brent Yi
edbfccccfe
Rename: dcargs -> tyro (#702)
Rename `dcargs` to `tyro`
2022-10-05 22:26:06 -07:00
Ethan Weber
b8f85fb603
doubling nerfacto samples on eval (#675)
doubling samples and eval num ray options
2022-10-04 22:57:24 -07:00
Matthew Tancik
e01206f728
Update cli docs (#674) 2022-10-04 22:11:02 -07:00
Ethan Weber
49b3acd11a
docs update (#669) 2022-10-04 21:26:21 -07:00
Matthew Tancik
ce8985aeb6
cli improvements to download script (#668) 2022-10-04 21:00:21 -07:00
Ethan Weber
6d918e0c76
add desolation scene (#666) 2022-10-04 17:48:37 -07:00
Matthew Tancik
0b3909918a
Update cli docs (#663) 2022-10-04 17:43:03 -07:00
David McAllister
4f5cc28b8d
Data download script fix (#646)
* Fixed case where no data has been downloaded

* Directory deletion
2022-10-04 12:59:06 -07:00
Ethan Weber
0695879673
[docs] model to method naming (#652)
* renamed model to methods

* name change
2022-10-04 11:53:16 -07:00
Ethan Weber
8fb0a5eec3
adding more datasets (#645)
* adding more data

* fix name

* add more captures
2022-10-04 10:36:12 -07:00
evonneng
af58b32cc8
restructuring debugging tools doc (#647)
* not done; restrucutre debugging part;

* 1) fixed all developer guides 2) fixed first_nerf error 3) moved run_actions

* removed md
2022-10-04 09:43:11 -07:00
evonneng
5c3e1e8bb7
split scripts into 2 eval/render (#637)
* done splitting script

* udpate docs

* woops forgot to add function

* update camera panel command
2022-10-03 22:08:21 -07:00
evonneng
2de5afae0c
updated benchmark scripts (#639) 2022-10-03 21:42:31 -07:00
evonneng
968959bdc9
quickstart updates + (other nits+links added to repo) (#633)
* small changes

* rewrite quickstart + readme

* fixed all licensing headers

* nits
2022-10-03 16:01:16 -07:00
Ethan Weber
5a76b955cd
adding --data alias (#630)
* adding --data alias

* fix black
2022-10-03 12:02:10 -07:00
David McAllister
cfff2bb65d
Quickstart Guide Fixes (#531)
* key fixes

* Update README.md

* Update run_eval.py

* Better error reporting

* lint

* Removed rgb fine change

* Readme updates

* Justify center
2022-10-02 23:10:03 -07:00
Matthew Tancik
37907698f2
update cli docs for process-data (#617)
* update cli docs for process-data

* Update recs

* fix toml
2022-10-02 18:09:57 -07:00
Ethan Weber
c20fed83bb
moving around files (#616)
moved around files
2022-10-02 16:54:34 -07:00
Ethan Weber
6315df1fd2
don't download to /tmp (#612) 2022-10-02 12:13:46 -07:00
Matthew Tancik
afda888591
tcnn encoding integration (#608)
* tcnn encoding integration

* Add tests, fix lint

* lin
2022-10-02 10:33:43 -07:00
Ethan Weber
e13d401b16
restructure codebase pre release (#602)
* moving a lot

* building
2022-10-01 16:36:25 -07:00
Matthew Tancik
531361a6aa
Remove remaining nerfactory (#598)
* Remove remaining nerfactory

* Lint
2022-10-01 12:28:15 -07:00
Matthew Tancik
1b9f42384e
Fix package cli auto-completions (#596) 2022-10-01 10:55:49 -07:00
Ethan Weber
3e61e315bb
updated download script (#592)
* updated download script

* rename

* remove omegaconf
2022-09-30 11:29:57 -07:00
Matthew Tancik
1bb0c88fb5
More renaming (#590) 2022-09-30 09:48:52 -07:00
Matthew Tancik
1f83ad03db
Rename to nerfstudio (#589) 2022-09-29 23:42:15 -07:00
Matthew Tancik
5924802f5c
Tune proposal net eval (#585) 2022-09-29 18:26:43 -07:00
Terrance Wang
f0adbba91f
adding nerfactory data download option (#565)
* adding nerfactory data download option

* adding docstring

* adding google file id dict
2022-09-28 16:10:19 -07:00
Brent Yi
e8a5941b24
Don't require model type for view_dataset.py (#568) 2022-09-28 12:25:10 -07:00
Ethan Weber
43d588f35f
specify a viewers list (#574)
* viewer list

* before master merge

* update script
2022-09-28 10:10:18 -07:00
Brent Yi
7f38490ec0
Install completions for entrypoints, misc config tweaks (#569)
* Install completions for entrypoints, misc config tweaks

* Bump dcargs
2022-09-27 22:23:22 -07:00
Ethan Weber
cf34ef4bd0
rename files and add project scripts (#566)
* scripts

* b

* fix file
2022-09-27 15:02:55 -07:00
Ethan Weber
1f484661f2
zmq_url to zmq_port (#563)
* zmq_url to port

* lazy commit
2022-09-27 14:02:03 -07:00
Matthew Tancik
d6139f25d4
Increase jpg quality for downscaled images (#556) 2022-09-27 09:49:46 -07:00
Matthew Tancik
e4982f7ed1
Update colmap options (#536)
* Add vocab tree option to data parser

* update import
2022-09-24 23:35:21 -07:00
Ethan Weber
21ebaceed1
fix viewer checkpointing (#511) 2022-09-21 17:56:18 -07:00
Ethan Weber
7b5a251a30
[wip] dynamic batch size for instant ngp (#501)
* starting dynamic batch size branch

* dynamic batch pipeline code
2022-09-21 14:07:04 -07:00
evonneng
0c43e7c4b2
updated event writing logic/moved save and print to after config set (#502)
* (1) if wandb/tb enabled always eval; (2) move printing of config to after all variables set

* (3) save config after everything is set

* dont change config; just disable eval with decorator
2022-09-21 13:40:56 -07:00
Ethan Weber
1d14263127
eval progress bar with more metrics (#499)
updated eval
2022-09-20 20:07:35 -07:00
evonneng
38f83de64b
removed post init method in config setup (#495)
* mrege

* nits
2022-09-20 14:56:48 -07:00
Matthew Tancik
046b5c216b
Misc cleanup (#494)
* misc cleanup

* Fix dependencies
2022-09-20 09:14:37 -07:00
Matthew Tancik
8b388a3e5c
Remove defaults from docstrings. (#480) 2022-09-19 10:04:25 -07:00
Brent Yi
acd126c1ef
Set dcargs accent color (#465)
* Set dcargs accent color

* Bump required dcargs version

* color -> colour

* Bump dcargs to 0.3.6
2022-09-19 00:28:06 -07:00
Ethan Weber
821333811b
update num_downscales default to 3 (2x, 4x, 8x) (#466)
update num_downscales default
2022-09-18 17:43:15 -07:00
evonneng
4e7ef375a2
[wip] logging separated s.t. only one is enabled (#458)
* updated viewer/writer configs

* allow viewer + tb/wandb but with errors; moved localwriter to its own thing

* nits and all

* update test
2022-09-17 17:50:11 -07:00
Ethan Weber
e22eab8c86
updating metrics logging (#460)
* integrated changes

* update

* stratified

* black

* bump version

* upgrade version

* improved wandb logging

* fix split for eval

* comments
2022-09-16 17:27:55 -07:00
Ethan Weber
8973039e65
misc cleanup (#432)
* misc cuda improvements. added cone angle as param

* wandb as default. better organization for experiments

* turn off tensorboard

* disable eval when using viewer

* remove comment

* launch.json
2022-09-15 00:16:41 -07:00
Matt Tancik
65ab15b5ce Update error handling in data processing script 2022-09-14 08:59:22 -07:00
Matthew Tancik
1d7051e4fe
Add rich printing to eval (#425) 2022-09-13 23:48:21 -07:00
Brent Yi
86a805c88c
Experimental autocompletion setup scripts (#378)
* Working completion scripts

* generate.py => install.py

* Uninstall for completions, docs/README updates

* Tune emojis, improve concurrency for completion install

* wip

* Cleanup

* Permissions, shebang checks
2022-09-13 12:44:27 -07:00
Brent Yi
61022f7dbe
Shorten dataparser subcommand (#420)
* Shorten dataparser subcommand

* Rename
2022-09-13 12:20:52 -07:00
Ethan Weber
9bc39d895c
Export camera path (#398)
* export button working

* view changes

* adding copy to clipboard feature

* camera choice dropdown

* going to add script saving next

* copy paste working. need to add aspect ratio

* aspect overlay kind of working

* lint

* aspect ratio fixed. version specified

* merge

* openrelay back
2022-09-13 11:33:58 -07:00
evonneng
416669d808
added basic download script (#410)
* basic script to download dataset

* update docs
2022-09-12 16:11:14 -07:00
Terrance Wang
f34a27511f
strip whitespace from ffprobe output (#386) 2022-09-10 15:37:23 -07:00
Matthew Tancik
6b2485d166
Cleanup logging (#379)
clean up logging
2022-09-09 10:26:45 -07:00
Brent Yi
12958ce1c3
(Minor) Remove cli_from_base_configs from view_dataset.py (#376)
Remove cli_from_base_configs from view_dataset.py
2022-09-08 19:48:09 -07:00
Brent Yi
97b77c6c5f
Bump dcargs, base config simplification (#368)
Updates for dcargs v0.3.0
2022-09-08 19:22:47 -07:00
Matthew Tancik
3ae6502116
Improve windows support (#374) 2022-09-08 15:56:38 -07:00
evonneng
e7cca834c8
added flag to view dataset from get-go (#366)
* added logic to comp rays/s on train and vis

* added test and fixed vis rays/sec

* added flag to just visualize dataset

* added new script for viewing only dataset
2022-09-08 13:29:17 -07:00
Matthew Tancik
e319b8210a
Add fisheye support to data processing (#369)
add fisheye support to data processing
2022-09-07 18:43:44 -07:00
Matthew Tancik
42711497ab
Support images in data preprocess (#363)
* support images in data preprocess

* typo
2022-09-07 11:59:40 -07:00
evonneng
56113e6c75
[WIP] dataloading cleanup (#332)
* testing; need to merge

* fixing wrong base file in models/base

* pushed input parser into datasets class to abstract away fetching data in dataloader

* slight name chage and all

* nits

* added dataparser

* added licnese
2022-09-06 13:54:35 -07:00
Matthew Tancik
397828f880
Pretty print configs (#343) 2022-09-05 17:56:17 -07:00
Matthew Tancik
c0ec352480
Update logging for process_data script (#341)
Printing not verbose by default
2022-09-05 14:24:53 -07:00
Matthew Tancik
b61fea8666
Remove downscaling from dataloading (#340) 2022-09-05 10:33:46 -07:00
Matthew Tancik
2ca0695fef
Add colmap preprocessing script (#338)
* Add colmap preprocessing script

* Fix lint, add dataparser
2022-09-04 17:39:30 -07:00
evonneng
b0f6d75cdf
refactored dataset names + multi-gpu running (#321)
* refactored dataset names + multi-gpu running

* update comments + docs
2022-09-01 18:22:11 -07:00
Matthew Tancik
2a94afd9ec
Correct notebook tag logic (#317) 2022-08-31 09:38:21 -07:00
evonneng
e96f7c0617
added logic for printing things (#309)
* added logic for printing things

* dynamic viewer url
2022-08-30 11:04:42 -07:00
Ethan Weber
2cca012ad8
Clickable viewer deployment (#308)
* first commit for clickable web viewer

* pylint ignore

* functional clickable viewer with updated docs

* fixed logging
2022-08-29 22:50:57 -07:00
Brent Yi
fe5f46c0aa
Config suggestions (#300)
* Config suggestions

* Add some TODO notes
2022-08-29 17:07:33 -07:00
Matthew Tancik
04d0165a24
Camera Refactor (#301)
* Start camera refactor

* Training runs, but transforms incorrect

* Cameras render correctly in viewer.

* Fix eval

* cleanup

* cleanup
2022-08-29 13:09:02 -07:00
Ethan Weber
7e9a56fac4
Config restructure (#283)
* starting docs for pipelines

* working on an example

* clearing output

* starting to implement config changes and add documentation

* wip: removed cicular imports; porting basic config into python; todo: get python setups workin

* circular imports again

* wip: pausing at dataloader sort of working

* break for today

* running vanilla

* wip need to get all the config docs working

* laptop about to die

* instant ngp working

* added all configs for all methods; not tested yet: [mipnerf360, nerfw, semantic_nerf]

* unpacking later

* done with pylinting

* mostly done. just need to do docs and one test

* added import order to docs

* fixing near/far plane and other config things

* making loggers also instantiable via configs

* docs

* lint

* making --help work with dcargs

* moving configs back into flat

* convert list to tuples; fixed post init function with mutable params

* lint

* made run_eval and benchmarking scripts compatible with new config/dcargs

* lint

* added option to load configs from presaved config

Co-authored-by: evonneng <evonne_ng@berkeley.edu>
2022-08-26 17:25:10 -07:00
Alexander Kristoffersen
b471736a61
iPhone (Record3D) Dataset (#235)
* init branch commit.

* intrinsics done.

* created dataset for record3d.

* clean up and documentation.

* cleanup.

* fixed orientation.
2022-08-16 23:24:49 -07:00
evonneng
1f1631cec6 removing callable modules from script/ 2022-08-15 21:31:43 +00:00
evonneng
efd5d39652
updating scripts; compatible with pipeline refactor (#278) 2022-08-15 13:26:37 -07:00
Ethan Weber
55ebaaf1b5
Hosting the viewer & webrtc logging (#271)
* might fix the stun server issue

* still debugging webrtc

* another turn server

* working on github actions

* updating actions file

* fixing actions

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* ga

* updating viewer

* update docs
2022-08-14 00:15:34 -07:00
evonneng
8e32e7863e
fixed broken ga; unable to import scripts/ (#274)
added init to scripts/
2022-08-12 09:23:51 -07:00
Ethan Weber
0b042be956
Pipeline v2 (#258)
* Model class done, pipeline class still needs more visualization stuffs

* Renaming the BaseDataContainer to DataloaderOutputs and adding documentation

* Pushing more documentation, removing some trivial functions

* Updating dict typing

* Removing config dicts for collider

* Passing tests

* Pushing shell new dataloader

* Saving work, need to fix NGP model's get_loss_dict and Pipeline

* V1 of the ngp pipeline should be done. Need train script and debugging

* Updating with latest instant-ngp code

* Syntax updates from latest ngp graph code

* Linter, removing unneeded code in new NGP graph code

* Style

* Should be good now. Linter is happy and the code is verbatum current instant-ngp

* Everything done except novel view testing code

* Fixing some nitpicks

* Debugging dataloader

* merged master

* WOP. integrating pipeline with configs and notebook demo

* removing model folder

* a lot of name changing from Graph to Model

* in progress... changing trainer to use pipeline... broken right now

* pipeline code runs

* switched to val dataset

* makes run_eval.py work

* updated configs for pipeline change

* fixing test_run_train script

* fixing black and linting

* fix docs

* small updates to trainer

Co-authored-by: Jake Austin <jake-austin@berkeley.edu>
2022-08-10 14:59:45 -07:00
evonneng
0d6060e0f0
Sync run_eval with benchmarking script (#260)
* added new .sh script for eval; removed old python script

* fixed changing dataset

* done refactoring eval script
2022-08-09 18:23:01 -07:00
evonneng
6281896e1d
fixed profiler bug with variable options (#254) 2022-08-08 09:53:12 -07:00