Skip to content

chore(docs): add KEP - Kubeflow PipelineClient support for kubeflow-mcp-server - #84

Closed
modichika wants to merge 2 commits into
kubeflow:mainfrom
modichika:docs/kubeflow_pipeline_support
Closed

modichika wants to merge 2 commits into
kubeflow:mainfrom
modichika:docs/kubeflow_pipeline_support

Conversation

@modichika

@modichika modichika commented Jul 15, 2026 •

Copy link
Copy Markdown
Member

Summary

This KEP proposes the implementation of an agentic kfp-generator skill within the kubeflow-mcp-server. This tool allows AI agents to translate natural language user prompts into functional Kubeflow Pipeline (KFP) v2 Python code.
It adds a kubeflow pipelines skills where an agent takes a prompt from a user(developer, data scientist, etc..), writes the Python code, tests the compilation, catches any errors, and feeds them back into itself until it successfully generates a valid pipeline file.
it introduces an agentic skill, that will help users to get a verified, evaluated pipeline(YAML files) with natural language.

It is Co-authored-by: @droctothorpe

Motivations

Why this KEP is needed?

  • writing kubeflow pipelines python file or YAML file is notoriously difficult, and data scientists often miss the syntax needed to write the pipeline files like YAML.

  • an agentic AI skill that will automate this process, will come in handy and useful removing the friction of writing bolierplate codes.

What we built?

  • Built the Self-Correction Loop: Set up the feedback mechanism (Prompt → Code → Catch Error → Fix) so it runs non-interactively without needing human input.

  • Added Demo Prompts: Tested the agent against the specific scenarios we wanted for a solid demo, including the Iris classifier and MNIST datasets, churn_prediction, image_anamoly_detection, time_series_forecasting.

Details

  • design : module structure, tables
  • mitigations, and the testing plan , is in the KEP doc.

Status

Open for review from maintainers before implementation.

Related Issue

Fixes kubeflow/pipelines#13423

Checklist

  • I have read the CONTRIBUTING guide
  • Tests pass locally (make test-python)
  • Linting passes (make verify)
  • Documentation updated (if applicable)
  • My commits are signed off (git commit -s)

cc: @jaiakash , @abhijeet-dhumal , @andreyvelich

Signed-off-by: modichika <shristimodi95@gmail.com>
Copilot AI review requested due to automatic review settings July 15, 2026 14:06
@google-oss-prow

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign kramaranya for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@github-actions

Copy link
Copy Markdown
Contributor

🎉 Welcome to the Kubeflow MCP Server! 🎉

Thanks for opening your first PR! We're happy to have you as part of our community 🚀

Here's what happens next:

  • If you haven't already, please check out our Contributing Guide for repo-specific guidelines and the Kubeflow Contributor Guide for general community standards
  • Our team will review your PR soon! cc @kubeflow/kubeflow-sdk-team

Join the community:

Feel free to ask questions in the comments if you need any help or clarification!
Thanks again for contributing to Kubeflow! 🙏

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Proposes a kfp-generator skill for generating and validating KFP v2 pipelines through the Kubeflow MCP server.

Changes:

  • Defines generation, compilation, and correction workflows.
  • Proposes module architecture, validation tests, and governance.
  • Documents risks, mitigations, and future caching.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread docs/proposals/KEP.md
Comment thread docs/proposals/KEP.md Outdated
Comment thread docs/proposals/KEP.md
Comment thread docs/proposals/KEP.md


### Goals
* **Agentic Interface**: Expose pipeline generation as an MCP tool skill (`kfp-generator`) to empower orchestrator agents, with natural language our users can get a well-tested compiled .YAML file.
Comment thread docs/proposals/KEP.md Outdated
Comment thread docs/proposals/KEP.md Outdated
Comment thread docs/proposals/KEP.md Outdated
Comment thread docs/proposals/KEP.md
Comment on lines +171 to +172
### UNIT-TEST
* name_of_the_demo (churn_prediction, Iris classifications, MNIST datasets, image_anamoly_detection, time_series_forecasting):
Comment thread docs/proposals/KEP.md Outdated
Comment thread docs/proposals/KEP.md Outdated
Signed-off-by: modichika <shristimodi95@gmail.com>
@modichika

modichika commented Jul 16, 2026 •

Copy link
Copy Markdown
Member Author

Closing this PR for now, reference for future works once PipelineClients gets added in kubeflow/sdk here's the ongoing pr:
kubeflow/sdk#591

@modichika modichika closed this Jul 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[feature] kfp skills

2 participants