Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add basic autotests setup #5

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add basic autotests setup #5

wants to merge 1 commit into from

Conversation

m-hurlow
Copy link
Collaborator

This integrates the autotests library into new Python eval functions by default, allowing documentation examples to be automatically built from integration tests.

Changes:

  • Added a dependency on autotests in requirements.txt.
  • Added an empty eval_tests.yaml.
  • Put the auto_test decorator on the class in evaluation_tests.py so that any tests in eval_tests.yaml will be run.
  • Made a note in the README that eval_tests.yaml should be updated with tests as the function is developed.

@m-hurlow
Copy link
Collaborator Author

P.S. I also think that this repo should be migrated to use the new eval function architecture based on Shimmy (hence the review from Andreas). I don't have the time to do this now, so maybe this could be considered later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant