4
0
mirror of https://github.com/nerfstudio-project/nerfstudio.git synced 2026-11-11 02:24:38 +08:00
Commit Graph

279 Commits

Author SHA1 Message Date
Justin Kerr
0ee63cb581
Expose viewer controls to pipeline (#1804)
* Increase max_res of first proposal network

* start on ViewerCamera

* crop controls exposed

* lint

* fix viewer crash when invisible element has its value set

* fov, look_at, and camera type

* stuff

* set update interval correctly in cameracontrols, smooth transitions work now

* demo with depth zooming

* depth min

* WIP adding click message

* put the clock back in viewerwindow

* use setlookat when pos and target are defined at the same time

* remove demo from nerfacto

* Add click commands as rays (origin, direction)

* short doc

* Fix double event for doubleclick

* add ViewerClick, cleanup docs

* add docs

* cleanup

* remove scripts

* remove nerfacto changes

* js compile things

* update viewer version

* fix mutable state thing

* docs improvements

* add kwarg value for enableTransition

* fix

* lint

* path in sync-defs

* Misc doc edits requested in pr

* Add click description

* WIP remove redefinition of banner_height, refer to SCSS vars

* add docstring

* radix

* radix

* speed

---------

Co-authored-by: Chung Min Kim <chungmin99@gmail.com>
2023-05-18 17:36:00 -07:00
Jonáš Kulhánek
9584fa9b39
Add pre-commit (#1949)
* Add pre-commit

* Add pre-commit to docs

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2023-05-18 07:13:58 -07:00
Matthew Tancik
2b0831b6d4
Final typing fixes + add Pyright to CI (#1944)
* knocking out a couple

* Fix more errors

* Add pyright

* Remove some unnecessary cv2 type ignores, warning on missing imports
(for missing tinycudann)

* Minor annotation fixes

* Update docs

* Drop `None` from temporal distortion output

---------

Co-authored-by: Brent Yi <yibrenth@gmail.com>
2023-05-18 02:25:34 -07:00
Jonáš Kulhánek
e898f562e6
Switching to Torch 2.0 by default. (#1922)
* Update requirements for torch 2.0

* Update docs

* Fix missing _LRScheduler import

* Fix pylint issues

* Update docs, drop 1.13

* Fix pip postfix version

* fix docs

* Allow python 1.13 (for now)

* Minor fix for torch.compile

* Switch to torch.compile

* ruff

* Fix test

---------

Co-authored-by: Matt Tancik <mattt4001@gmail.com>
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-05-17 16:03:17 -07:00
Giodiro
be291970db
Documentation for k-planes add-on (#1935)
* Add documentation for kplanes add-on

* Fix all integration spots with nerfstudio

---------

Co-authored-by: gmeanti <giacomo.meanti@gmail.com>
2023-05-17 11:48:08 -07:00
Brent Yi
d542646c72
Switch to ruff (#1939)
* `isort` -> `ruff`

* `pylint` -> `ruff`

* Remove line

* More minor cleanup

* Better documentation for rules we are enabling

* Fix gitignore, run black

* vscode settings

---------

Co-authored-by: Matt Tancik <mattt4001@gmail.com>
2023-05-17 10:08:14 -07:00
Brent Yi
6ba2a18b2b
torchtyping => jaxtyping (#1838)
* Run `ruff --fix`

* Add jaxtyping migration script

* Run migration scripts + ruff + black

* Merge remote-tracking branch 'origin/main' into brent/jaxtyping

* black

* Fix lint

* fix lint

* Cleanup and more specific types

* Fixed annotation errors

* Fix more errors

* Fix annotation

* Delete _torchtyping_to_jaxtyping.py

---------

Co-authored-by: Matt Tancik <mattt4001@gmail.com>
2023-05-16 15:57:47 -07:00
Jonáš Kulhánek
9b6290ea43
Discover external methods from CLI (#1934)
* Discover external methods from CLI

* Fix external method registration

* External method add docstrings

* Update docs: register custom method in external_methods.py
2023-05-16 22:15:47 +02:00
Matthew Tancik
6c3106004d
Update contributing docs (#1926) 2023-05-16 00:06:43 -07:00
Matt Tancik
9932b0fecf fix doc error 2023-05-15 15:01:39 -07:00
J.Y
7851dfa9db
Fix bug related to distributed data parallel training (#1856)
* Fix bug related to distributed data parallel training

* fix format by black

* Add nerfacto-big multi-gpu commands

* cleaned up docs

* reverted default dataset to poster

---------

Co-authored-by: Ethan Weber <eweb0124@gmail.com>
2023-05-15 14:23:29 -07:00
Matthew Tancik
415a037880
Update method docs (#1925)
* Update method docs

* Cleanup
2023-05-15 13:47:40 -07:00
wuzirui
bc110d7bd9
extract dataparser configs to a stand-alone file, support custom dataparsers (#1909)
* extract dataparser configs to a stand-alone file, support custom dataparsers

* add license

* fix pylint issues

* fix type error issue

* update naming; add documentations;

* print f string

* fix pylint issue

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-05-12 15:11:46 -07:00
Ayaan Haque
fe4586839a
Add INGP Docs (#1774)
* initial draft

* updates

* added details on sampling

* updates

* final notes

---------

Co-authored-by: Ruilong Li(李瑞龙) <ruilongli94@gmail.com>
2023-05-12 14:51:00 -07:00
Matthew Tancik
72a14b0b22
Move scripts folder into nerfstudio (#1897)
move scripts folder into nerfstudio
2023-05-09 16:44:21 -07:00
Matthew Tancik
df514b121c
Update docs for ns-viewer (#1892) 2023-05-09 10:07:11 -07:00
Brent Yi
63c6303736
Bump minimum Python version to 3.8 (#1876)
* Bump minimum Python version to 3.8

* typing_extensions.Literal -> typing.Literal

* ns-dev-test

* typing_extensions.get_args => typing.get_args

* Format with older version of black

* Bump `black`

* Run black
2023-05-06 13:29:48 -07:00
Jonáš Kulhánek
1147fe4d5c
Make VanillaDataManager generic (#1868)
* Make VanillaDataManager generic

* Remove removed classes from docs

* Simplify generic datamanager

* Simplify code

* Add serialization tests
2023-05-06 09:54:52 -07:00
Jonáš Kulhánek
971c9eb307
Enable method config registration from env variable (#1869) 2023-05-04 20:53:52 +02:00
Jonáš Kulhánek
61bad4dab3
Fix flag name in tetra-nerf (#1870)
Fix flag name for tetra-nerf
2023-05-04 09:22:32 -07:00
Jonáš Kulhánek
686e995dd6
Tetra-NeRF docs - fix versions and table formatting. (#1864)
* Add Tetra-NeRF to the docs

* Fix versions in tetranerf docs
2023-05-03 14:50:30 -07:00
Jonáš Kulhánek
f4064aa593
Add Tetra-NeRF to the docs (#1862)
* Add Tetra-NeRF to the docs

* Add memory requirements + different model configurations
2023-05-03 22:18:07 +02:00
Matthew Tancik
610fe8bbd4
Update logging docs (#1863) 2023-05-03 10:00:46 -07:00
Milan van Wouden
28c84d116b
Fix typos in Ray Samplers docs (#1851) 2023-05-02 09:29:47 -07:00
Frédéric Devernay
9a0ecb6fd7
Support equirectangular sensor with metashape (#1841)
* Document how to use equirectangular sensor with metashape

* equirectangular sensor is actually supported by nerfstudio!

* Update custom_dataset.md

* equirectangular: fix COLMAP workflow

* metashape_utils.py: black

---------

Co-authored-by: Frédéric Devernay <f-dy@users.noreply.github.com>
2023-05-01 14:44:00 -07:00
Matthew Tancik
9a61851bcf
Update lerf docs (#1782) 2023-04-20 10:06:13 -07:00
Rohan Mathur
bf3ae6ac5c
Added docs wording change and also --crop-bottom (#1767)
* added docs wording change and also --crop-bottom

* fixed linting
2023-04-20 09:58:02 -07:00
Chung Min Kim
1d92cea2e3
Add documentation for LERF (#1771)
* Initial docs for lerf

* Add memory requirements for lerf-big and lerf

* Include LERF paper dataset info, include bibtex
2023-04-19 14:40:10 -07:00
Brent Yi
63919c0db2
Docs fixes for viewer elements (#1770) 2023-04-18 19:15:29 -07:00
Jonáš Kulhánek
ea14152ae6
Add PyTorch profiler to support tracing of forward/backward calls (#1761)
* Add PyTorch profiler support

* Add support for wrapped code, fix linting errors

* Update docs
2023-04-18 20:29:09 +02:00
cvachha
7c4e139f2e
Adding Blender tutorial video and documentation on NeRF in NeRF composite (#1745)
* Added Blender tutorial video and documentation on NeRF in NeRF compositing

Updated Blender Add-on documentation to include a video tutorial and added documentation on compositing NeRF objects in NeRF scenes.

* Updating Blender documentation

Removing additional images and resizing images on the documentation.
2023-04-16 10:13:15 -07:00
LownyCGI
16725ae8fa
Update sdfstudio.md (#1744)
Add supported method
2023-04-15 09:16:39 -07:00
Brent Yi
2ddb2631b5
Improve viewer element types (#1743) 2023-04-15 01:14:38 -07:00
Matthew Tancik
a9eea19880
Update method docs (#1742)
* Update method docs

* typo
2023-04-14 15:02:45 -07:00
Brent Yi
6a7c8820b8
Viewer backend refactor (#1702)
* Copy in `viser` communication infrastructure

* Update background image

* Add build directory to fix viser HTTP server
May want to remove these later

* Copy in `viser` communication infrastructure

* Update background image

* Pass dataset vis using viser

* initial impl of ViewerParameter

* idk what i did but brent and matt know

* Suppress eslint typescript warnings

* implement ViewerElement base class, then ViewerButton, ViewerSlider, etc

* client -> server message setup

* multi folder stuff

* Stream controls over viser

* import

* add types to viewer_param.py

* Move another message to viser

* Update folder color

* Use non throttled messages

* multiple folders works

* Cleanup, more porting

* starting impl of control panel in viser

* More porting

* scenebox to viser

* Cleanup

* Fix render updates

* More cleanup, docs, typing

* start control_panel.py

* set_hidden logic but not merged in

* control_panel replicates behavior of existing control panel (visually), except for setting the list of output options. not yet integrated with viewer_utils.py for logic flow. also implemented set_disabled and set_hidden in javscript/ViewerElement side

* Remove some original leva components

* add some train util logic, attempt set_value, doesn't work on javascript side fully yet (value updates but not slider visually

* bye zmq

* missing call to decoder

* 'gui_set' works properly, control panel now replicates behavior of original

* remove print

* Fix status viewer message

* More cleanup

* support set_options in dropdown

* hiding buttons works correctly

* fix set_options, switch from cur_value to get_value()

* Fix slowdown

* output options

* colormap logic converted

* add handle to cb_hook

* fix some lambda bugs

* cleanup

* Save checkpoint logic readded

* Cleanup and minor fixes

* snappier ui

* Refactoring

* Fix state update bugs

* Bug fixes

* Write less to redux

* added comments to reducer code

* Render state machine (#1727)

* state machine works, but train step throttling not implemented

* more step logic, cleanup

* remove random try catcH

* mutex logic for render

* Update lock logic

* types and docs

* added some state machine logic to help rerenders

* merge

---------

Co-authored-by: Justin <justin.g.kerr@gmail.com>

* Refactor and cleanup

* More cleanup and docs

* docstring to gui_utils

* docstrings, rename viewer_param.py to viewer_elements.py

* Fix viewer, remove bridge stuff

* Render on connect

* Fix lint errors

* More eslint fixes

* render_freq logic

* better rerender logic for crop

* More cleanup

* Purge

* Cleanup

* Lint fixes

* Fix cache

* better parsing logic

* Fix infinite test

* More cleanup

* typo

* Update webdocs

* Update docs

* rerender on custom hooks

* add more docs

* Use shared utilities in `viser.infra`

* rework callback to use elements instead of handles

* Fix ESlint errors

* change naming of handle to element, add setter for value

* cleanup

---------

Co-authored-by: Matt Tancik <mattt4001@gmail.com>
Co-authored-by: Justin <justin.g.kerr@gmail.com>
Co-authored-by: Ethan Weber <eweb0124@gmail.com>
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-04-14 14:53:10 -07:00
Matthew Tancik
e5e67a7a5a
Update blender web docs (#1740)
Update blender docs
2023-04-14 11:42:19 -07:00
Ayaan Haque
b85cb9f979
update in2n docs based (#1721)
* base changes

* done for now, just need assets

* fix

* add few changes

* remove unused files

* fixse
2023-04-11 13:05:51 -07:00
Matthew Tancik
2c6a328780
Add instruct-nerf2nerf to docs (#1711)
* base changes

* done for now, just need assets

* fix

* Update docs

---------

Co-authored-by: ayaanzhaque <ayaanzhaque@gmail.com>
2023-04-10 11:26:21 -07:00
Matthew Tancik
2e777e4577
Update dataparser docs (#1698)
* Update dataparser docs

* Add missing files
2023-04-04 18:30:52 -07:00
Matthew Tancik
7126334976
Docs for adding new methods (#1697) 2023-04-04 12:49:15 -07:00
Matthew Tancik
4e6c52c8fd
Update sphinx docs (#1695) 2023-04-04 11:08:09 -07:00
Alex-Zhang
b0dca720a8
Update installation.md (#1675)
* Update installation.md

install ninja to speed up installation of tinycuda-nn

* Update installation.md

* update readme and installation
2023-03-31 16:00:53 -07:00
Matthew Tancik
2b8140b583
Add SDFStudio links (#1653)
Add sdf studio links
2023-03-23 15:43:34 -07:00
Rohan Mathur
ea9a066f8f
Removed deprecated insta360 (#1621)
* removed insta360 and also updated equirect images docs to include cropping

* removed unused import

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-03-17 12:54:45 -07:00
Matthew Tancik
f58aa9348e
Prevent colmap from opening (#1627) 2023-03-17 11:03:13 -07:00
Julian Rendell
fac13d0bab
Adding explicit pytorch version for Cuda 11.7 installs (#1611)
Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-03-15 20:56:34 -07:00
Matthew Tancik
1b18b44d81
Update 360 docs (#1593)
* Update 360 docs

* Update custom_dataset.md

* Update custom_dataset.md
2023-03-12 11:14:58 -07:00
Matthew Tancik
63af268495
Remove webrtc (#1579)
* Remove webrtc

* cleanup

* lint

* cleanup

* Lower quailty

* Update viewer version

* Update docs

* remove cryptography req
2023-03-10 12:00:35 -08:00
Frédéric Devernay
a277cd4886
camera_utils: add "vertical" orientation and "focus" center methods (#1543)
* camera_utils: add "vertical" orientation and "focus" center methods

* camera_utils: -Z is the look-at direction

* Update nerfstudio_dataparser.py

* missing import

* fix pylint issues

* camera_utils: handle degenerate case for "vertical" orientation method

* camera_utils: split focus_of_attention computation

---------

Co-authored-by: Frédéric Devernay <f-dy@users.noreply.github.com>
2023-03-10 11:22:21 -08:00
Rohan Mathur
403ab26f0c
Changed percent-crop to crop-factor so it's less confusing (#1575)
* changed percent-crop arg to crop-factor so it's more clear that it's a float

* added error if crop values are less than 0 or more than 1

* added value hint and changed error to console thing

* added imports

* fixed linter issues

* refixed linter issues
2023-03-09 12:23:50 -08:00