Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve Integration Tests #311

Open
LarsKue opened this issue Feb 12, 2025 · 2 comments
Open

Improve Integration Tests #311

LarsKue opened this issue Feb 12, 2025 · 2 comments
Labels
unit tests A new set of tests needs to be added.
Milestone
BayesFlow 2.0

Comments

@LarsKue
Copy link
Contributor

LarsKue commented Feb 12, 2025 •
edited
Loading

Our integration tests have so far only been running on Two Moons, which is a niche scenario with no summary network. Ideally, we should have an array of scenarios that we can run integration tests on, in an efficient manner. This would include, for example:

  • A scenario with and without a summary network
  • Different data shapes
  • Online and offline training, as well as training in rounds
  • All different kinds of approximator tasks, e.g. Model Comparison, Point Estimation, ...
  • Varying sets of metrics and networks
  • Running our example Jupyter Notebooks
@LarsKue LarsKue added the unit tests A new set of tests needs to be added. label Feb 12, 2025
@LarsKue LarsKue added this to the BayesFlow 2.0 milestone Feb 12, 2025
@LarsKue
Copy link
Contributor Author

LarsKue commented Feb 12, 2025

Related to #254

@stefanradev93
Copy link
Contributor

Agreed. We can run these CIs with tiny networks between changes in minor versions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
unit tests A new set of tests needs to be added.
Projects
bayesflow development
Status: Future
Milestone
BayesFlow 2.0
Development

No branches or pull requests
2 participants
@stefanradev93 @LarsKue