Skip to content

perf: skip discarded trace payload construction - #7155

Merged
chenghao-mou merged 4 commits into
mainfrom
chenghao/perf/AGT-3452-skip-trace-payload-construction
Sep 9, 2026
Merged

perf: skip discarded trace payload construction#7155
chenghao-mou merged 4 commits into
mainfrom
chenghao/perf/AGT-3452-skip-trace-payload-construction

Conversation

@chenghao-mou

Copy link
Copy Markdown
Member

Tracing builds large chat and GenAI payloads before OpenTelemetry decides to discard them. Check span recording and content capture first, while retaining legacy chat context, recorded content, and non-content metrics.

A 1,000-message sampled-out llm_node drops from 4.1 ms to 84 µs locally.

Addresses AGT-3452

Initial prompt and agent context

Model: GPT-5.6

can you investigate linear AGT 3452?

sounds good, let's fix that with a draft PR first.

Check span recording and content capture before building telemetry payloads.
@chenghao-mou
chenghao-mou marked this pull request as ready for review September 7, 2026 10:34
@chenghao-mou
chenghao-mou requested a review from a team as a code owner September 7, 2026 10:34
devin-ai-integration[bot]

This comment was marked as resolved.

devin-ai-integration[bot]

This comment was marked as resolved.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 1 new potential issue.

Devin Review

Comment thread livekit-agents/livekit/agents/llm/llm.py
@chenghao-mou
chenghao-mou merged commit 3334771 into main Sep 9, 2026
24 checks passed
@chenghao-mou
chenghao-mou deleted the chenghao/perf/AGT-3452-skip-trace-payload-construction branch September 9, 2026 10:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants