An even larger version of nerfacto with scaled hashgrid resolution, MLP sizes, batch sizes, appearance embeddings, proposal sampler resolution, and more.
Also includes some minor tweaks to nerfacto-big configs
* started a package to easily swap out tcnn for pytorch
* trains with pytorch and not tcnn
* cleaned up imports
* making it easy to install on mac
* removed/reverted files
* merged main
* reverted changes
* updating config
* starting to add nerfacto to tests
* fixxing default value
* fixed default implementation
* defaults to torch if tcnn and not installed
* update log
* add comment
* resolved pr comments
* fix
* update default
---------
Co-authored-by: Ethan Weber <ethanweber@eecs-128-32-175-250.dhcp.berkeley.edu>
* knocking out a couple
* Fix more errors
* Add pyright
* Remove some unnecessary cv2 type ignores, warning on missing imports
(for missing tinycudann)
* Minor annotation fixes
* Update docs
* Drop `None` from temporal distortion output
---------
Co-authored-by: Brent Yi <yibrenth@gmail.com>
* `isort` -> `ruff`
* `pylint` -> `ruff`
* Remove line
* More minor cleanup
* Better documentation for rules we are enabling
* Fix gitignore, run black
* vscode settings
---------
Co-authored-by: Matt Tancik <mattt4001@gmail.com>
* implementing l1 and tv reg in the original tensorf paper
* added documentation for tv loss
* added test for tv loss
* fix formating
* fix formatting
---------
Co-authored-by: Yan Xiao <yax010@ucsd.edu>
* Bump minimum Python version to 3.8
* typing_extensions.Literal -> typing.Literal
* ns-dev-test
* typing_extensions.get_args => typing.get_args
* Format with older version of black
* Bump `black`
* Run black
* profiling
* set pose_optimizer to None if it's mode is "off"
* radial_and_tangential_undistort in nerfacc
* fix camera distortions
* update to nerfacc 0.5.1. Upgrade instant-ngp model.
* revert nerfacc to 0.5.1
* format
* allows to fall back to the pytorch undistortion
* format
* fix linting
* fix test
* fix test
* fix nerfplayer-ngp
* enable_collider=False for NGP
* nerfplayer verified.
* zero cone_angle for ngp bounded
* fix format
* fix pylint
* add neus_facto method
* fix missing pixsfm from video process
* fix dev errors and small typos
---------
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
* add initial method configs and data manager
* add neus scheduler
* add initial surface model and neus
* add Neus ray sampler
* add sdf field
* move scale/shift calc to math utils
* add debug and fix sdf_dataset typo
* update vscode neus debug
* fix dataset and get initial working version
* add magic number from original repo
* black fixes
* clean up get weights/transmittance from alphas
* clean up typos in sdf datamanager
* type annotations on neus scheduler and remove unused params
* clean up and annotate sdf field along w/ other fixes
* more clean up
* remove unnessary directions norm
* resolve comments
* update neus scheduler to follow refactor
* fix linter errors
* fix some typos
* remove get_weights_from_alpha
* more comment fixes
* more linter error fixes
* clean up and add comments
* more little fixes for types/comments
* more comments
* rename NeuS Scheduler to DelayedScheduler
* rename DelayedScheduler to CosineDecayScheduler
* added volinga model to NeRFStudio
* Removed unused dependencies
* Modified dockerfile to match main
* Corrected typo in core_code_checks.yml
* Corrected typo in core_code_checks.yml
* updated test with Volinga
* Added conversion to NVOL documentation
* [WIP] Refactor documentation and removing Volinga config
* Volinga use existing NerfactoModelConfig
* Added Unreal Engine documentation to extensions
* removed unused field class import
* Updated docs
* Documentation ready
* Update Dockerfile
---------
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
* fix semseg vis
* semantic configs
* change defaults
* Fix type
* format
* fix imports
* suggested fix for issue 1465
* fix docstring placement; avoid log spam and runtime errors
`nerfstudio\models\semantic_nerfw.py:81: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
self.colormap = torch.tensor(self.semantics.colors).to(self.device)`
* hide semantics output choice, since it kills the viewer
* revert some changes
* caps
* move both image and mask to GPU to avoid runtime error
as suggested in https://github.com/nerfstudio-project/nerfstudio/issues/1465#issuecomment-1441117562
---------
Co-authored-by: machenmusik <machenmusik@users.noreply.github.com>
* Allow black/white background color in Nerfacto
* Use white background in Nerfacto Blender Benchmark
* Fixed unused import
* Updated index for license headers script
* setting tensorf default from wandb to viewer
* adding functionality to adjust model depending on the step of the checkpoint that is loaded
* cleaning code
* bug fix
* fixing style
* fixed an exception bug in case of num_samples is 0
fixed an exception bug when num samples is 0 ,
"IndexError tensors used as indices must be long, byte or bool tensors"
change type to long ( was float32)
* implemented crop box in gui. For now works on instant-ngp-bounded
* fixed import bugs
* update aabb every time and not only on training
* prevent crash when chosing accomulation and crop box
* Checkbox
* max_box is bounded by scevne box in the gui
* implemented altenative intesection to nerfacc
* convert str to bool correctly
* fixed isort bug
* fixed isort bug2
* update viewer version
* remove json bug
* Update UI
* Force black background
* Fix formatting
Co-authored-by: dror <you@example.com>
Co-authored-by: Matt Tancik <tancik@berkeley.edu>
Co-authored-by: Matthew Tancik <mattt4001@gmail.com>
* inerted a new model configuration instant-ngp-bounded
* added more remarks and small fixes
* went back to old near plane
* added the oprtion to get a file as well as directory in nerfstudio data parser
* pretify prev commit
* review fixes
* more clear explanation in README.md
* reverted readme changes
* fixed merge bug
* review changes. update config.data docs support for json files inputs
Co-authored-by: dror <you@example.com>
* staring normals PR
* code runs but visualization looks bad
* Camera and world coordinate conventions (#889)
* documented coordinate conventions without a figure for now
* another sentence
* update frames docs
* explain intrinsics and extrinsics
* more comments
* fix build
* Start viewer with more accurate speed calculation (#899)
Start viewer with more accurate speed calc
* Minor doc updates (#903)
* fix conflicts
* code runs but visualization looks bad
* normals implemented and vis fixed. still debugging quality
* minor name change
* comment
* fix black
* lint
* predicting normals
* adding detach
* predicted normals
* improved normals prediction performance
* cleaning code
* cleaning code
* cleaning code
* adding type to function param
* fixing tensorf forward func
* reverting tensorf changes
* fix style with tensorf field
* adding normals check to tensorffield
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
Co-authored-by: terrance <terrance.3512@gmail.com>
Justin
LSong
Jonáš Kulhánek
Ethan WeberandEthan Weber
Milan van Wouden
Matthew TancikandBrent Yi
Yan XiaoandYan Xiao
Ruilong Li(李瑞龙)
Yuantao Chen
Pablo VelaandEthan Weber
David McAllisterandMatthew Tancik
Georgy Ponimatkin
Fernando Rivas-ManzanequeandMatthew Tancik
Nikhil Mohanandmachenmusik
Jake AustinandMatthew Tancik
Sacha Lewin
NCJ
Yiming Zhou
Jeffrey Hu
Terrance Wang
JamesPerlman
matsurenandMatthew Tancik
Michal Pandy
Zak Murezandzmurez