* added skeleton for terminal logger * done skeleton terminal writer logic... todo: actual calls to the write classes * moved lambda to top function * added logic to support timing * prettier printing * prettier printing * lint * separated out timing and other stats variables. printing in dict format * keeping logging history and wiping rest * updated logic to calculate total times instead of average times * made stats tracker configurable * moved stats tracker and profiler to own class file; implemented basic functionality for profiler * lint removing duplicate function * update readme; moved around config variables * profiler prints on sig kill |
||
|---|---|---|
| .github/workflows | ||
| .vscode | ||
| configs | ||
| data/blender/lego_test | ||
| environment | ||
| external | ||
| mattport | ||
| notebooks | ||
| scripts | ||
| tests | ||
| viewer | ||
| .gitignore | ||
| .gitmodules | ||
| pyproject.toml | ||
| README.md | ||
| setup.py | ||
MattPort
Quickstart
Installation: Setup the environment
# Clone the repo
git clone --recurse-submodules git@github.com:ethanweber/mattport.git
# Create the python environment
conda create --name mattport python=3.8.13
conda activate mattport
pip install -r environment/requirements.txt
# Install mattport as a library
python setup.py develop
# Running the test cases
pytest tests
Getting the data
Download the original NeRF dataset and put it in the following format.
- data/
- blender/
- fern/
- lego/
Training a model
# Run with the default config
python scripts/run_train.py
# Run with config changes
python scripts/run_train.py machine_config.num_gpus=1
Logging and profiling features
We provide many logging functionalities for timing and/or tracking losses during training. All of these loggers are configurable via configs/logging_configs.yml
-
Writer: Logs losses and generated images during training to a specified output stream. Specify the type of writer (Tensorboard, local directory, Weights and Biases), and how often to log in the config.
-
StatsTracker: Computes select statistics and prints to the terminal for local debugging. Specify the kinds of statistics to be logged, how often to log, and the maximum history buffer size in the config.
-
Profiler: Computes the average total time of execution for any function with the
@profiler.time_functiondecorator. Prints out the full profile at the termination of training or the program.
Setting up Jupyter
python -m jupyter lab build
bash environments/run_jupyter.sh
Tooling
We use autoenv to make setting up the environment and environment variables easier. This will run the .envrc file upon entering the /path/to/mattport folder. It will also remove the set environment parameters upon leaving.
# Install direnv.
sudo apt install direnv
# Add the following line to the bottom of your ~/.bashrc file.
eval "$(direnv hook bash)"
# Populate your .envrc with commands you want to run. Then, run the following to allow updates.
cd /path/to/mattport
direnv allow .