Skip to content

docs(autotrain): continuous loop dc8878 — 5 screening cycles (non-positive) - #1485

Merged
Tyler-R-Kendrick merged 5 commits into
mainfrom
claude/great-dirac-eqtgto
Aug 8, 2026
Merged

docs(autotrain): continuous loop dc8878 — 5 screening cycles (non-positive)#1485
Tyler-R-Kendrick merged 5 commits into
mainfrom
claude/great-dirac-eqtgto

Conversation

@Tyler-R-Kendrick

@Tyler-R-Kendrick Tyler-R-Kendrick commented Aug 8, 2026

Copy link
Copy Markdown
Owner

Summary

Runs 5 supervised cycles of the autotrain continuous screening loop
(loop-id continuous-openui-scheduled-dc8878, fixture wf_smoke_v2,
smoke.structural_similarity primary metric) per the autotrain /
sdlc autotrain-iteration-delivery contract. Each cycle self-healed a
stale origin/main ancestry check and, once, a bare document
version-stamp gap, then closed out with committed evidence.

  • continuous-loop-20260808-...-c1 — bounds vs control screen, fixture
    ship-gate reject (structural_similarity=0.0575, insufficient n).
  • ...-c2 — measurement incomplete (decode_timeout_count=3 on both
    arms); infrastructure diagnosis, replay recommended before a new
    hypothesis.
  • ...-c3 — bounds vs control screen, null primary-metric delta
    (structural_similarity=0.1908 unchanged), fixture ship-gate reject.
  • ...-c4 — component-plan arm measurement incomplete; control arm
    completed but still gate-rejected (inconclusive).
  • ...-c5 — canvas vs control screen, fixture ship-gate reject
    (insufficient n).

Why no stacked positive-result PR

Per autotrain-iteration-delivery.md, a stack layer opens only for
a positive result (primary-metric win, ship-quality win, or proven
executable unblock). All 5 cycles here are fixture insufficient_n,
null primary-metric deltas, or measurement-incomplete timeouts —
explicitly not positive. This PR carries the iron-law documentation
and local incremental commits only; no autotrain/<loop-id>-L0N-*
stack layer was opened. The training loop continues from this commit on
the next scheduled iteration.

Changes

  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c{1..5}-results.{md,json}
    measured-results evidence for each cycle (iron law).
  • docs/MODEL_CARD.md, README.md — honesty-stub continuous autotrain
    notes recording fixture/scratch checkpoint provenance for each cycle
    (explicitly not a ship promotion).
  • src/slm_training/resources/versions.json — matching no-bump:
    history entries for harness.experiments.slm228_spectral_disposition
    (its watch list includes README/MODEL_CARD; these are behavior-neutral
    docs-only touches).

Test plan

  • python -m scripts.verify_version_stamps --check passes on every
    commit (enforced by the repo's commit hook).
  • documenting-experiment-results iron law satisfied for all 5
    cycles (JSON + markdown under docs/design/).
  • No model/harness code changed in this PR — no additional test
    suite required beyond the version-stamp/registry checks that ran
    on commit.

Generated by Claude Code

Summary by CodeRabbit

  • Documentation
    • Added dated screening records for five continuous-training cycles.
    • Documented checkpoint provenance, measurement status, candidate and control metrics, failure reasons, and fixture limitations.
    • Clarified that all evaluations are scratch or fixture evidence only and do not represent release promotions.
    • Recorded that the evaluated behavior remains unchanged across the documented cycles.

@vercel

vercel Bot commented Aug 8, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
slm-training Ready Ready Preview Aug 8, 2026 3:13pm

Request Review

@coderabbitai

coderabbitai Bot commented Aug 8, 2026

Copy link
Copy Markdown

Review Change Stack

Warning

Review limit reached

@Tyler-R-Kendrick, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 44 minutes

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: a349b64c-7c27-4d05-baef-b555d557d4c8

📥 Commits

Reviewing files that changed from the base of the PR and between b2033ef and 90f0cdb.

📒 Files selected for processing (3)
  • README.md
  • docs/MODEL_CARD.md
  • src/slm_training/resources/versions.json
📝 Walkthrough

Walkthrough

Added five continuous autotrain screening cycles for campaigns c1–c5. Each cycle includes JSON and Markdown fixture results, campaign documentation, checkpoint provenance, and an explicit non-ship status.

Changes

Continuous autotrain screening

Layer / File(s) Summary
Cycle screening result records
docs/design/continuous-loop-...-c1-results.*, docs/design/continuous-loop-...-c2-results.*, docs/design/continuous-loop-...-c3-results.*, docs/design/continuous-loop-...-c4-results.*, docs/design/continuous-loop-...-c5-results.*
Added JSON and Markdown records for cycles c1–c5. The records contain metrics, measurement status, fixture evidence, failure reasons, and non-ship outcomes.
Campaign and version provenance
README.md, docs/MODEL_CARD.md, src/slm_training/resources/versions.json
Added campaign checkpoint notes and five version-history entries dated 2026-08-08. The entries record non-positive outcomes and unchanged SLM-228 behavior.

Estimated code review effort: 2 (Simple) | ~10 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly summarizes the documentation of five non-positive continuous autotrain screening cycles.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch claude/great-dirac-eqtgto

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
README.md (1)

796-825: 📐 Maintainability & Code Quality | 🔵 Trivial | ⚡ Quick win

Disambiguate the repeated ## Continuous autotrain note (2026-08-08) headings. Both files add five sections dated 2026-08-08, one per campaign (c1-c5), all sharing the exact same heading text. markdownlint-cli2 flags this as MD024 (no-duplicate-heading) in both files.

  • README.md#L796-L825: append the campaign suffix to each heading, for example ## Continuous autotrain note (2026-08-08, c1) through c5.
  • docs/MODEL_CARD.md#L1452-L1481: apply the same heading suffix pattern so headings stay unique and distinguishable by campaign.
📝 Proposed fix (repeat for c2-c5 in both files)
-## Continuous autotrain note (2026-08-08)
+## Continuous autotrain note (2026-08-08, c1)
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@README.md` around lines 796 - 825, Disambiguate the repeated “Continuous
autotrain note (2026-08-08)” headings by appending each campaign suffix,
changing c1 through c5 to headings ending “, c1” through “, c5”. Apply this to
every corresponding heading in README.md (lines 796-825) and docs/MODEL_CARD.md
(lines 1452-1481), leaving the campaign and checkpoint content unchanged.

Source: Linters/SAST tools

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In `@README.md`:
- Around line 796-825: Disambiguate the repeated “Continuous autotrain note
(2026-08-08)” headings by appending each campaign suffix, changing c1 through c5
to headings ending “, c1” through “, c5”. Apply this to every corresponding
heading in README.md (lines 796-825) and docs/MODEL_CARD.md (lines 1452-1481),
leaving the campaign and checkpoint content unchanged.

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 08f3b2db-1972-478a-9ffe-a082806cf8a8

📥 Commits

Reviewing files that changed from the base of the PR and between 092a98a and b2033ef.

📒 Files selected for processing (13)
  • README.md
  • docs/MODEL_CARD.md
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c1-results.json
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c1-results.md
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c2-results.json
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c2-results.md
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c3-results.json
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c3-results.md
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c4-results.json
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c4-results.md
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c5-results.json
  • docs/design/continuous-loop-20260808-continuous-openui-schedu-32a7e28a-c5-results.md
  • src/slm_training/resources/versions.json

autotrain added 5 commits August 8, 2026 10:13
…uous-loop-20260808-continuous-openui-schedu-32a7e28a-c1 closeout
…uous-loop-20260808-continuous-openui-schedu-32a7e28a-c2 closeout
…uous-loop-20260808-continuous-openui-schedu-32a7e28a-c3 closeout
…uous-loop-20260808-continuous-openui-schedu-32a7e28a-c4 closeout
…uous-loop-20260808-continuous-openui-schedu-32a7e28a-c5 closeout
@Tyler-R-Kendrick
Tyler-R-Kendrick force-pushed the claude/great-dirac-eqtgto branch from b2033ef to 90f0cdb Compare August 8, 2026 15:13
@Tyler-R-Kendrick
Tyler-R-Kendrick merged commit 554b9b8 into main Aug 8, 2026
1 of 2 checks passed
@Tyler-R-Kendrick
Tyler-R-Kendrick deleted the claude/great-dirac-eqtgto branch August 8, 2026 15:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant