Repository navigation
feat(kv): add Fluxon KV integration for SGLang - #42
Merged
Merged
Conversation
ActivePeter
force-pushed
the
sglang-fluxon-kv-integration
branch
from
October 23, 2026 06:00
5b44ff9 to
7b99935
Compare
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 23, 2026 06:43 — with 
GitHub Actions
Failure
GitHub Actions
Failure
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 23, 2026 06:46 — with
GitHub Actions
Failure
GitHub Actions
Failure
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 23, 2026 08:37 — with
GitHub Actions
Failure
GitHub Actions
Failure
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 23, 2026 08:38 — with
GitHub Actions
Failure
GitHub Actions
Failure
Align the bundled GPU communication SDK and consumer with schema 8 / ABI 10 so process logging and runtime requests use the same protocol. Include the CUDA runtime libraries and remove local build paths from the SDK artifact. Preserve GPU readiness retries by matching the typed transfer error. Install libnvidia-compute-580 and check libcuda loading in all three CI jobs. Validated SDK ABI checks, process logging, and external client CPU CRUD. The GPU SDK also passed logging and CPU CRUD in an Ubuntu 24.04 container with no NVIDIA devices and only the userspace driver dependencies.
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 23, 2026 16:16 — with
GitHub Actions
Failure
GitHub Actions
Failure
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 23, 2026 16:32 — with
GitHub Actions
Failure
GitHub Actions
Failure
…acts Route native writes through Owner allocation while retaining Master key reservations, lease publication, overwrite ordering and shutdown cleanup. Preserve the SGLang fast paths and enable ordinary CPU Owner configs. Close asynchronous Get targets by exact generation when Delete invalidates them, retain active holders, and bound GetDone admission and discovery. Restore native Get retries for stale source plans without retrying completed batch items or suppressing other errors. Restore the upstream CPU storage rounds and update Owner reclaim coverage, including SSD reload, stale routes, cancellation and concurrent overwrites. Validation: 396 KV tests passed; memory, SSD and memory+SSD CPU integration rounds passed. GPU/RDMA and full SGLang experiments were not rerun.
Pass create-only PUT options through Python and PyO3, including batch paths. Retain the host framework for each P2P dispatch and reject callbacks after its release. Wait for asynchronous holder release before checking GET/DELETE slot reclamation. Prefer the linked SDK over wheel copies when running Cargo tests.
Use accepted Owner allocator reports for public and exported segment capacity. Preserve generation-fenced tomb cleanup. Release transfer-engine dependencies before P2P and cluster handles, and retain each release operation until completion so close and canceled-close retries cannot leak IPC subscribers. Synchronize the MQ capacity test with the asynchronous prefix index before probing backpressure.
Treat IPC PID records already removed by another startup cleaner as complete, while preserving other I/O errors and live-process identity checks. Rebuild the full GPU communication core from the same source snapshot; retain ABI 10, schema 8, GPU/UVM behavior, and the existing native dependencies.
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 25, 2026 14:54 — with
GitHub Actions
Failure
GitHub Actions
Failure
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 25, 2026 18:50 — with
GitHub Actions
Failure
GitHub Actions
Failure
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 25, 2026 19:26 — with
GitHub Actions
Failure
GitHub Actions
Failure
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 26, 2026 05:20 — with
GitHub Actions
Failure
GitHub Actions
Failure
ActivePeter
had a problem deploying
to
OPENAI_API_KEY
October 26, 2026 15:37 — with
GitHub Actions
Failure
GitHub Actions
Failure
This branch had an error being deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.