-
Notifications
You must be signed in to change notification settings - Fork 1
PBM use pytest shard for parallelization #442
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
Introduce pytest-shard to split the test suite across multiple CI jobs, enabling parallel execution and faster end-to-end runs.
- Add pytest-shard to the test container image.
- Update the GitHub Actions workflow to run tests in 5 shards instead of keyword-filtered groups.
- Add markers (@pytest.mark.skip, @pytest.mark.jenkins) and minor test renames/cleanup.
Reviewed Changes
Copilot reviewed 12 out of 13 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
| pbm-functional/pytest/test_timeseries.py | Add skip markers, rename tests, and remove an unused assignment to streamline test execution under sharding. |
| pbm-functional/pytest/test_sharded_chunks.py | Add jenkins marker to scope long-running tests. |
| pbm-functional/pytest/test_drop_pitr.py | Add skip marker and rename a test. |
| pbm-functional/pytest/test_PBM-1497.py | Add jenkins marker to a long-running test. |
| pbm-functional/pytest/test_PBM-1355.py | Add skip and jenkins markers; adjust test names. |
| pbm-functional/pytest/test_PBM-1265.py | Add skip marker and rename a test. |
| pbm-functional/pytest/test_PBM-1252.py | Add jenkins marker to a long-running test. |
| pbm-functional/pytest/test_PBM-1223.py | Add jenkins marker to a parameterized test. |
| pbm-functional/pytest/test_PBM-1090.py | Add jenkins marker for CI scoping. |
| pbm-functional/pytest/test_PBM-1058_upgrade.py | Add skip marker and rename a test. |
| pbm-functional/pytest/Dockerfile-testinfra | Install pytest-shard in the test container to enable sharded runs. |
| .github/workflows/PBM-FULL.yml | Switch from keyword-filtered runs to shard-based parallel runs across 5 jobs. |
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
…easons for skipping the tests, drop 6.0 support
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
Copilot reviewed 13 out of 14 changed files in this pull request and generated 1 comment.
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
Shards tests based on a hash of their test name enabling easy parallelism across machines