Commit Graph
1720 Commits
Author SHA1 Message Date
mcallisterdavid 9c4261b2b7 Revert prompt 2023-06-07 07:38:13 +00:00
mcallisterdavid e081264dd7 Small fixes 2023-06-07 07:33:27 +00:00
mcallisterdavid 6f409bb648 Loss added, does not converge 2023-06-07 05:54:19 +00:00
terrance 13ad46bcf0 lint 2023-06-05 21:30:15 +00:00
Terrance Wang 34da8b0618 Merge branch 'main' into generative 2023-06-03 12:17:58 -07:00
terrance 78725bcb34 update fields to use tcnn 2023-06-03 04:41:17 +00:00
henrypearce4D 293d8f3811 Update metashape_utils.py (#2011)
Changed the ValueError message when using a camera.xml that contains multiple sensors. Per-frame intrinsics can be defined, the previous message said that they were not supported.
2023-06-01 23:44:08 -07:00
terrance ec80295a5d resolve tyro warning 2023-06-01 18:31:41 +00:00
Terrance Wang c7e92920f3 Merge branch 'main' into generative 2023-06-01 10:18:33 -07:00
Alexander Kristoffersen 24d02515a9 Colab update to Python 3.10 (#2017)
* updated colab to 310

* update to py310
2023-05-30 17:03:18 -07:00
Jonáš Kulhánek a0d5307dd7 [WIP] Fix model loading collate_fn non-static (#1990)
* Fix model loading collate_fn non-static

* Fix serialization

* Add tests to reproduce the error

* Comment the change to let the tests fail

* Finish changes
2023-05-29 00:56:41 -07:00
Mingwu ZhengandMatthew Tancik ba08a8f530 Add Metadata Handling to Cameras Collation Function (#2001)
* Add metadata collate for cameras

* checks passed

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-05-27 21:00:40 +00:00
Matthew Tancik 6902c91e34 Merge branch 'main' into generative 2023-05-27 13:40:00 -07:00
Brent Yi 4d71cd2e95 Bump tyro (#2008) 2023-05-27 19:49:11 +00:00
Cyrus Vachha 6993f75dc8 Render Omni-directional stereo video (360 3D VR) (#1986)
* Render Omni-directional stereo (360 3D VR)

Adding the omni-directional stereo camera model to render 3D 360 video and images for VR. This includes the camera models for the left and right eyes and additions to the render script to stack the left and right renders for the final render.
I have also updated the documentation on the custom_dataset page to have information on ODS but let me know if there is a better place to put it.

* Updated ODS camera model and render paths

Updates based on suggested code changes including adding a helper function for ODS and improving path creation.
I also added a part where if a user tries to render a video with an output path that doesn't have an extension it will automatically add .mp4 to the end. Otherwise this usually results in an error when there is no file extension when rendering a video.

* Updated formatting for render and cam path scripts

Updated python formatting for render and camera_paths script

* Adding type checking for ODS function and reformatting camera type code

Added the type checking and doc string for the ODS camera rays function and reformatted the cam_type ray if statements.
2023-05-26 18:01:13 -07:00
Matthew Tancik addf477e8c add controls to the beta viewer (#2005)
* add controls to the beta viewer

* Remove misc file

* works now
2023-05-26 15:15:36 -07:00
terrance 18be9fa764 remove old comments 2023-05-26 22:02:58 +00:00
Jonáš Kulhánek 9643c1ece2 Fixes wandb runs resuming using WANDB_RUN_ID (#2004) 2023-05-26 10:29:26 +02:00
terrance bfe2a89c40 add Tensor to randomcamerasdatamanager 2023-05-25 22:04:34 +00:00
Ethan WeberandEthan Weber bb6925bac6 Ability to use vanilla pytorch instead of tcnn for Nerfacto (#1936)
* started a package to easily swap out tcnn for pytorch

* trains with pytorch and not tcnn

* cleaned up imports

* making it easy to install on mac

* removed/reverted files

* merged main

* reverted changes

* updating config

* starting to add nerfacto to tests

* fixxing default value

* fixed default implementation

* defaults to torch if tcnn and not installed

* update log

* add comment

* resolved pr comments

* fix

* update default

---------

Co-authored-by: Ethan Weber <ethanweber@eecs-128-32-175-250.dhcp.berkeley.edu>
2023-05-25 14:55:42 -07:00
terrance bc2ee574da changing datamanager check in trainer, add typing in random cameras datamanager 2023-05-25 21:53:33 +00:00
terrance 89731110d4 fix test import 2023-05-25 21:36:27 +00:00
terrance a130a1121d fix test import 2023-05-25 21:28:47 +00:00
terrance 3c357b2653 rename dreamfusion datamanager to random camras datamanager, check datamanager typing in pipeline and trainer 2023-05-25 21:18:46 +00:00
terrance ddfe207918 typing + linting 2023-05-25 20:17:14 +00:00
terrance d1c34c04a0 revert nerfacto config change 2023-05-25 19:01:50 +00:00
terrance f32308ddf5 merging 2023-05-25 18:57:55 +00:00
terrance 3e5e1aa618 merging + setting proposal net scheduler 2023-05-25 18:55:24 +00:00
terrance e343ea0b07 merge w main 2023-05-25 17:34:19 +00:00
terrance 9055fcc3ce merging grad scaler pipeline addition 2023-05-25 17:32:50 +00:00
Terrance Wang ba44d7fbda Merge branch 'main' into generative 2023-05-25 10:26:16 -07:00
Matthew Tancik 400ab5a313 Fix exponential decay warmup (#2002)
Fix exponendial decay warmup
2023-05-25 10:07:22 -07:00
terrance b1c1fa083b undo config and merge in deepfloyd from main 2023-05-25 16:38:52 +00:00
Terrance WangandMatthew Tancik a8bce87ada pass grad scaler from trainer to pipeline (#1996)
* pass grad sclaer from trainer to pipeline

* lint

* add grad scaler to arg doc

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-05-25 09:27:58 -07:00
f9a88c5aa2 add deepfloyd model (#1993)
* add deepfloyd model

* black

* lint

* linting

* cast sds gradient to tensor

* change generator type to optional

* lint

* Type fixes

* add typing to sds

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
Co-authored-by: Matt Tancik <mattt4001@gmail.com>
2023-05-25 00:14:04 -07:00
Ethan Weber e94d9031ab SIGGRAPH 2023 Citation Update (#1997)
* siggraph 2023 update

* update citation

* update citation
2023-05-24 18:16:01 -07:00
Matthew Tancik 45395efa1c Fix viewer decorator (#1995) 2023-05-24 14:46:43 -07:00
Saurav Maheshkar 46bc8fe7cc style(ruff): provide better integration with ruff vscode extension (#1994)
* style(ruff): use default python setttings

* style(ruff): add ruff extension to `devcontainer.json`
2023-05-24 12:22:02 -07:00
Matthew Tancik 76165fcd02 Fix custom dataparser docs (#1991)
Update new_methods.md
2023-05-24 11:18:35 -07:00
terrance cb10a77cae move no input data flag from pipeline to datamanager 2023-05-24 18:03:46 +00:00
Lukas Hoellein eaa4f91913 Fix Viewer Recursion: StackOverflow in Server Setup (#1987)
fix viewer recursion
2023-05-24 10:03:50 -07:00
Sophus 3a31da36f7 fix visualize encoding bug (#1984) 2023-05-24 10:01:22 -07:00
dependabot[bot] 160abde6ad Bump socket.io-parser from 4.2.1 to 4.2.3 in /nerfstudio/viewer/app (#1983)
Bumps [socket.io-parser](https://github.com/socketio/socket.io-parser) from 4.2.1 to 4.2.3.
- [Release notes](https://github.com/socketio/socket.io-parser/releases)
- [Changelog](https://github.com/socketio/socket.io-parser/blob/main/CHANGELOG.md)
- [Commits](https://github.com/socketio/socket.io-parser/compare/4.2.1...4.2.3)

---
updated-dependencies:
- dependency-name: socket.io-parser
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-23 20:08:50 -07:00
Matias TurkulainenandMatthew Tancik 33d95f3e71 Added at_train_end logic to base pipeline (#1932)
* process additional images

* added on_train_end to base pipeline

* added on_train_end to base pipeline

* remove on_train_end from Base Model and Base Datamanager

* Add new callback type OnTrainEndCallback

* return empty list as default

* add on_train_end to trainingcallbacklocation enum

* make step var into union of int and None

* after train end callback

* Delete unnecessary file

* Delete unnecessary file

* Delete unnecessary file

---------

Co-authored-by: Matthew Tancik <tancik@berkeley.edu>
2023-05-23 16:03:55 -07:00
Jonáš Kulhánek 61e48108df Add warnings for (slower) Torch 1.x and Windows not supporting torch.compile (#1982)
Add warning for torch 1.x and windows
2023-05-23 15:18:53 -07:00
Matthew Tancik efd83abb6d Basic viser frontend (#1973)
* Use viser frontend

* Rendering but poses incorrect

* Fix cameras
2023-05-23 12:21:38 -07:00
terrance de51b12524 changing pipeline flag 2023-05-23 18:05:32 +00:00
terrance 89a745dc74 remove old scripts files, rename generative pipeline flag to no_input_data, revert to default histogram padding in proposal sampler 2023-05-23 17:53:31 +00:00
Milan van Wouden d413ca4204 fix large number of typos in repository (#1977)
* fix large number of typos in repository

* fix typos in tests
2023-05-23 10:41:49 -07:00
Daniel Crispell ccdcc3951e generalize mask collation to other image-like data (#1959) 2023-05-22 18:10:39 -07:00