Repository navigation
perf: keep low-concurrency exporters fast and edge parent lookups near - #314
Merged
Merged
Conversation
An 8-vCPU benchmark of v2026.10.4-alpha showed traces falling from 194k to 76k spans/s across repetitions, and sustained mixed ingest reaching only 246k items/s. - While compaction debt is high, a group commit now closes after 20 ms without a new request, as well as at the 250 ms deadline or its row, request and byte bounds. A trace exporter keeps one export in flight, so a fixed 250 ms wait capped it at four exports per second. Closed-loop submitters now keep 94-99% of their unpressured throughput. A paced stream still writes about 13 times fewer batches under pressure. - Edge passes look up parents within five minutes of the affected buckets first. The one-hour lookup runs only for traces with a child whose parent was not found nearby, and is skipped when there are none. With 60 minutes of dense history, a pass takes 349 ms instead of 726 ms. Output is unchanged. Claude-Session: https://claude.ai/code/session_01XA52nWyQ3R5f5kK8kjpAQW
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
An 8-vCPU benchmark of v2026.10.4-alpha (Fanout and telemetrygen on separate ccx33s) passed all gates and kept compaction ahead. But traces fell from 194k to 76k spans/s across repetitions, and sustained mixed ingest reached only 246k items/s. This PR fixes the two causes.
Writer:
Edge rollup:
Local measurements:
Test plan
just checkjust test-racehttps://claude.ai/code/session_01XA52nWyQ3R5f5kK8kjpAQW