Skip to content

CI: split test job into parallel query-engine and reporting shards - #70

Merged
tombonfert merged 1 commit into
mainfrom
split-test-pipeline-by-component
Jul 30, 2026
Merged

CI: split test job into parallel query-engine and reporting shards#70
tombonfert merged 1 commit into
mainfrom
split-test-pipeline-by-component

Conversation

@tombonfert

Copy link
Copy Markdown
Collaborator

Summary

Splits the single test job in acceptance.yml into a parallel matrix over
component: [query_engine, reporting], so the two halves of the suite run
concurrently on separate runners instead of back-to-back. The shared
not-a-forklint gate is unchanged.

  • Makefile: test target takes an optional TEST_PATH (defaults to
    tests/); CI passes each component's path. Coverage still measured against
    all of src/.
  • acceptance.yml: test becomes a fail-fast: false matrix; each shard
    uploads coverage under a Codecov flag. Replaces the old single-value
    python-version matrix.
  • codecov.yml: declares query_engine / reporting flags with
    carryforward so per-shard uploads merge into the combined total.

Verified the partition is exact (780 + 598 = 1378 tests, no overlap) and that
a sharded make test still emits coverage.xml.

Test Plan

  • Unit tests added/updated
  • Manual testing completed
  • Documentation updated (if applicable)

Checklist

  • Code follows project style guidelines
  • Self-review completed
  • No new linter warnings introduced

@tombonfert
tombonfert requested a review from a team as a code owner July 30, 2026 13:38
@codecov

codecov Bot commented Jul 30, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 88.45%. Comparing base (f654d22) to head (a644d2c).

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #70      +/-   ##
==========================================
- Coverage   88.72%   88.45%   -0.27%     
==========================================
  Files          59       59              
  Lines        4826     4826              
  Branches      552      552              
==========================================
- Hits         4282     4269      -13     
- Misses        445      455      +10     
- Partials       99      102       +3     
Flag Coverage Δ
query_engine 84.04% <ø> (?)
reporting 94.31% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.
see 5 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@tombonfert
tombonfert merged commit 459acdf into main Jul 30, 2026
6 checks passed
@tombonfert
tombonfert deleted the split-test-pipeline-by-component branch July 30, 2026 14:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant