Repository navigation
Conversation
Signed-off-by: modichika <shristimodi95@gmail.com>
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
🎉 Welcome to the Kubeflow MCP Server! 🎉 Thanks for opening your first PR! We're happy to have you as part of our community 🚀 Here's what happens next:
Join the community:
Feel free to ask questions in the comments if you need any help or clarification! |
There was a problem hiding this comment.
Pull request overview
Proposes a kfp-generator skill for generating and validating KFP v2 pipelines through the Kubeflow MCP server.
Changes:
- Defines generation, compilation, and correction workflows.
- Proposes module architecture, validation tests, and governance.
- Documents risks, mitigations, and future caching.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
|
|
||
|
|
||
| ### Goals | ||
| * **Agentic Interface**: Expose pipeline generation as an MCP tool skill (`kfp-generator`) to empower orchestrator agents, with natural language our users can get a well-tested compiled .YAML file. |
| ### UNIT-TEST | ||
| * name_of_the_demo (churn_prediction, Iris classifications, MNIST datasets, image_anamoly_detection, time_series_forecasting): |
Signed-off-by: modichika <shristimodi95@gmail.com>
|
Closing this PR for now, reference for future works once PipelineClients gets added in kubeflow/sdk here's the ongoing pr: |
Summary
This KEP proposes the implementation of an agentic
kfp-generatorskill within thekubeflow-mcp-server. This tool allows AI agents to translate natural language user prompts into functional Kubeflow Pipeline (KFP) v2 Python code.It adds a kubeflow pipelines skills where an agent takes a prompt from a user(developer, data scientist, etc..), writes the Python code, tests the compilation, catches any errors, and feeds them back into itself until it successfully generates a valid pipeline file.
it introduces an agentic skill, that will help users to get a verified, evaluated pipeline(YAML files) with natural language.
It is Co-authored-by: @droctothorpe
Motivations
Why this KEP is needed?
writing kubeflow pipelines python file or YAML file is notoriously difficult, and data scientists often miss the syntax needed to write the pipeline files like YAML.
an agentic AI skill that will automate this process, will come in handy and useful removing the friction of writing bolierplate codes.
What we built?
Built the Self-Correction Loop: Set up the feedback mechanism (Prompt → Code → Catch Error → Fix) so it runs non-interactively without needing human input.
Added Demo Prompts: Tested the agent against the specific scenarios we wanted for a solid demo, including the Iris classifier and MNIST datasets, churn_prediction, image_anamoly_detection, time_series_forecasting.
Details
Status
Open for review from maintainers before implementation.
Related Issue
Fixes kubeflow/pipelines#13423
Checklist
make test-python)make verify)git commit -s)cc: @jaiakash , @abhijeet-dhumal , @andreyvelich