Skip to content

fix(openai): trace computer use and access programs - #876

Merged
Abhijeet Prasad (AbhiPrasad) merged 2 commits into
mainfrom
abhi/trace-openai-access-4d2d8129
Oct 7, 2026
Merged

Abhijeet Prasad (AbhiPrasad) merged 2 commits into
mainfrom
abhi/trace-openai-access-4d2d8129

Conversation

@AbhiPrasad

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) commented Oct 5, 2026 •

Copy link
Copy Markdown
Member

Summary

  • Trace Agents computer-use, browser-authentication, and approval-result items in tool spans.
  • Convert screenshot data URLs from computer-use outputs into Braintrust attachments.
  • Capture Responses access_programs in request and response metadata, with defensive reads for older OpenAI pins.

Fixes #869

Live traces

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 5, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-05T17:37:12.823586Z 8fe9673 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: bd8744bff5

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "Codex (@codex) address that feedback".

Comment on lines +1189 to +1191
"browser_authentication_request": ("request_id",),
"computer_use_approval_request": ("request_id",),
"computer_use_approval_request_result": ("request_id",),

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Preserve the approval payloads in tool spans

When computer use requests browser authentication, the actual computer_use_approval_request item carries a request object and the corresponding result carries a credential-free response describing submit/cancel and the selected option. These allowlists retain only request_id, while _agent_tool_span_output has no output keys for either type, so the emitted spans discard both the form being requested and the user's admitted response. Include request/response in the appropriate span data and cover the real item shapes with a cassette-backed test.

AGENTS.md reference: AGENTS.md:L176-L182

Useful? React with 👍 / 👎.

@AbhiPrasad
Abhijeet Prasad (AbhiPrasad) merged commit a0b4866 into main Oct 7, 2026
83 checks passed
@AbhiPrasad
Abhijeet Prasad (AbhiPrasad) deleted the abhi/trace-openai-access-4d2d8129 branch October 7, 2026 17:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

OpenAI: trace computer-use Agents session items and capture Responses access_programs

2 participants