Skip to content

[deep-report] Add guard against placeholder/test content in agentic workflow report outputs (Typist #57682) #57700

Description

@github-actions

Description

The "Typist - Go Type Analysis" scheduled workflow run (run 33502376664, completed successfully, 2026-09-01T11:25Z) created discussion #57682 titled "test title" with body content that is clearly placeholder/smoke-test text — "line one", "line two — em dash and ' curly quote", "line three "double quotes" here" — instead of an actual Go type-consistency analysis. This content does not appear anywhere in the workflow's own prompt (.github/workflows/typist.md), so the agent generated this filler itself rather than performing its intended task, and the run's success conclusion masked the fact that no real analysis was produced.

Every prior Typist run (discussions #53651, #55369, #55753, #56016, #56632, etc.) has produced substantive Go type-drift findings, making this a one-off anomaly rather than the workflow's normal behavior — but it slipped through as a real published discussion with no guard to catch it.

Expected Impact

Prevents low-quality/placeholder content from being published as real Discussions, and surfaces (via a failed run instead of a silent success) when an agentic workflow drifts off-task so it can be investigated before it recurs on other report workflows.

Suggested Agent

New Agent — a lightweight output-sanity check (e.g. reject create_discussion bodies under some minimum structure/length, or containing generic placeholder markers) could be added to the shared safe-outputs validation path used by all report workflows, not just Typist.

Estimated Effort

Quick (< 1 hour) for a minimal placeholder-content guard; Medium (1-4 hours) if wired generically into the shared safe-outputs validator.

Data Source

DeepReport Intelligence Briefing — 2026-09-01 (window since briefing #57635), discussion #57682.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • api.anthropic.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "api.anthropic.com"

See Network Configuration for more information.

Generated by 🔬 Deep Report · claude · agent · 143.5 AIC · ⌖ 14.4 AIC · ⊞ 12.4K ·

  • expires on Sep 3, 2026, 4:47 AM UTC-08:00

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions