Week 2: Experiment tracking and testing

• Lecture: link
• Seminar: see the example_project directory
• Homework: see homework/README.md

Further reading

• Tools for experiment tracking: Aim, Comet, Neptune, Sacred, Weights and Biases, ClearML
• DVC and Pachyderm for artifact versioning
• Hydra documentation
• Omegaconf for simpler configuration management
• Unittest built-in module
• Doctest built-in module (useful for testing docstrings!)
• Pytest repository
• Pytest plugins: pytest-xdist for parallel execution, pytest-cov for coverage reports.
• Hypothesis quick start guide and integration with pytest
• Full Stack Deep Learning "Troubleshooting & Testing" lecture
• Made With ML MLOps Course, "Testing Machine Learning Systems: Code, Data and Models"