Skip to content

perf: Optimize ingest delivery for logs - #850

Merged
Abhijeet Prasad (AbhiPrasad) merged 3 commits into
mainfrom
micro-optimizations
Oct 5, 2026
Merged

Abhijeet Prasad (AbhiPrasad) merged 3 commits into
mainfrom
micro-optimizations

Conversation

@ankrgyl

@ankrgyl Ankur Goyal (ankrgyl) commented Oct 5, 2026 •

Copy link
Copy Markdown
Contributor

We waste CPU in some places and can make ingest 2-3x cheaper.

Local pyperf benchmarks on CPython 3.14.7; times are means in microseconds.

Operation Before (µs) After (µs) Speedup
Queue: 1,000 inserts 248.24 82.48 3.01×
Attachment discovery: small payload 1.69 0.96 1.77×
Attachment discovery: medium payload 14.95 7.62 1.96×
Attachment discovery: large payload 129.77 56.98 2.28×
Batching: 200 items, count limit 14.22 10.12 1.41×
Batching: 200 items, byte limit 21.49 12.61 1.70×
Batching: 200 items, both limits 22.20 14.06 1.58×

These measure SDK CPU overhead.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 5, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ⚠️ Failed 2026-10-05T06:20:49.426399Z 0001b69 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@AbhiPrasad

Copy link
Copy Markdown
Member

will take this PR over, have some small adjustments to make before merging

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) changed the title Optimize some stuff in ingest perf: Optimize ingest delivery for logs Oct 5, 2026
@AbhiPrasad
Abhijeet Prasad (AbhiPrasad) merged commit c53feb0 into main Oct 5, 2026
83 checks passed
@AbhiPrasad
Abhijeet Prasad (AbhiPrasad) deleted the micro-optimizations branch October 5, 2026 15:04
@AbhiPrasad

Copy link
Copy Markdown
Member

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants