Skip to content

test(audit): add end-to-end audit integration coverage - #1821

Draft
jamesadevine with Copilot wants to merge 5 commits into
mainfrom
copilot/add-e2e-integration-suites-for-audit
Draft

test(audit): add end-to-end audit integration coverage#1821
jamesadevine with Copilot wants to merge 5 commits into
mainfrom
copilot/add-e2e-integration-suites-for-audit

Conversation

Copilot AI commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Summary

Audit analyzers could silently miss evidence when PipelineArtifact archives repeated the artifact name as their top-level directory.

  • Artifact handling
    • Normalize flat and repeated-root archives identically.
    • Isolate filtered artifact storage and analysis from full-run caches.
    • Preserve unrelated evidence when optional aw_info metadata is malformed.
  • Integration coverage
    • Exercise console/JSON audit, trace, and MCP-author entry points against deterministic fake ADO archives.
    • Cover filtering, cache refresh, malformed inputs, redaction, timeline correlation, and analyzer output.
  • Live contract
    • Audit a completed candidate smoke child and require agent, detection, and safe-output artifact families.

Test plan

  • cargo test --test audit_it
  • cargo test --bin ado-aw audit::
  • cargo clippy --all-targets --all-features -- -D warnings

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
2 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI and others added 4 commits August 5, 2026 21:05
Co-authored-by: jamesadevine <4742697+jamesadevine@users.noreply.github.com>
Co-authored-by: jamesadevine <4742697+jamesadevine@users.noreply.github.com>
Co-authored-by: jamesadevine <4742697+jamesadevine@users.noreply.github.com>
Co-authored-by: jamesadevine <4742697+jamesadevine@users.noreply.github.com>
Copilot AI changed the title [WIP] Add end-to-end integration suites for audit and debug commands test(audit): add end-to-end audit integration coverage Aug 5, 2026
Copilot AI requested a review from jamesadevine August 5, 2026 21:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test(audit): add end-to-end integration suites for audit and debug commands

2 participants