Skip to content

fix(pflash): batch automatic FlowKV compression - #612

Merged
davide221 merged 3 commits into
mainfrom
fix/flowkv-auto-batch
Aug 15, 2026
Merged

fix(pflash): batch automatic FlowKV compression#612
davide221 merged 3 commits into
mainfrom
fix/flowkv-auto-batch

Conversation

@davide221

@davide221 davide221 commented Aug 15, 2026

Copy link
Copy Markdown
Contributor

Summary

  • route multi-turn --prefill-compression auto requests through FlowKV without requiring the unrelated disk-cache compression flag
  • activate from aggregate aged-history tokens and select --prefill-curve from the full context length
  • batch eligible aged messages inside one target/draft parking window, while preserving per-request fallback behavior for other backends
  • include the keep ratio in the frozen-content cache key and clarify the CLI/docs behavior

Verification

  • built dflash_server and test_server_unit from a clean origin/main worktree on RTX 5090
  • focused regressions: 2 passed, 0 failed
  • Lucebox server smoke: HTTP 200, expected OK, 25,097 prompt tokens reduced to 2,313 effective tokens in 5.43 s
  • server logs confirm one target/draft park, one PFlash drafter load, and one restore for eight aged messages

Existing test failure

The full GPU unit binary reports 359/360. The untouched DS4 test fractional_route_quota_rounds_over_the_batch also failed before this patch; the focused PFlash/FlowKV tests pass.

Review in cubic

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 8 files

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

Comment thread server/src/server/http_server.cpp Outdated
Comment thread server/src/server/http_server.cpp Outdated
Comment thread server/test/test_server_unit.cpp Outdated
@davide221
davide221 merged commit 12a0fd9 into main Aug 15, 2026
4 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant