Skip to content

[kafka] Establish compatibility framework - #4186

Draft
gyang94 wants to merge 1 commit into
apache:mainfrom
gyang94:codex/kafka-pr1-compatibility-framework
Draft

[kafka] Establish compatibility framework#4186
gyang94 wants to merge 1 commit into
apache:mainfrom
gyang94:codex/kafka-pr1-compatibility-framework

Conversation

@gyang94

@gyang94 gyang94 commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Purpose

Linked issue: #4185

This is PR 1 of 4 for the Basic Produce compatibility milestone. It establishes the protocol and module foundations required by the later Produce PRs without introducing the Produce implementation itself.

Brief change log

  • Add the Kafka protocol plugin and request/response dispatch framework.
  • Add API version negotiation and typed API registration.
  • Add topic-to-table mapping plus metadata and topic administration backends.
  • Add the Kafka compatibility module to the build and document the proposed architecture.

Tests

  • Added unit coverage for API registration and dispatch.
  • Added unit coverage for Kafka topic mapping.
  • Reactor build, Checkstyle, Spotless, and RAT validation passed while rebuilding the stack.

API and Format

This adds internal Kafka compatibility interfaces and wiring. It does not change the existing Fluss public API or storage format.

Documentation

Adds the Kafka protocol compatibility framework proposal.

Stack

  • PR 1/4 — this PR
  • PR 2 — basic Produce compatibility
  • PR 3 — SASL/PLAIN authentication
  • PR 4 — schema-aware Produce transcoding

Generative AI disclosure: Codex (GPT-5.6) assisted with implementation and commit organization. Human review is required before merge.

Introduce request dispatch, ApiVersions, metadata discovery, and topic lifecycle operations as the reviewable foundation for subsequent Produce support.

Co-Authored-By: Codex <noreply@openai.com>

AI-Model: gpt-5.6-sol

AI-Contributed/Feature: 2698/2698

AI-Contributed/UT: 1160/1160
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant