Repository navigation
Upgrade gpt-latest to three-tier model failover - #25
Conversation
Co-authored-by: paulyuk <1968137+paulyuk@users.noreply.github.com>
gpt-latest to three-tier model failover
|
Copilot Please also add developer-friendly
|
Co-authored-by: paulyuk <1968137+paulyuk@users.noreply.github.com>
Added the five infrastructure READMEs with full-stack and standalone deployment examples, module outputs, Gateway routing, and script lifecycle/configuration guidance. Committed as |
|
Copilot Update the 5
|
Co-authored-by: paulyuk <1968137+paulyuk@users.noreply.github.com>
Updated all five READMEs with their expected working directories and folder-relative deployment/script paths. The infra README now explains azd discovery from infra/. Committed as |
|
Copilot In the root
This sample demonstrates a **hub-and-spoke governance architecture** for Foundry Hosted Agents using **AI Gateway** as the central hub. The Microsoft Agent Framework repo-digest agent runs in an isolated Foundry project spoke (`infra/foundry-agents/`) with zero model deployments and no direct credentials to backing models or external MCP servers. All model inference (`gpt-latest` three-tier failover across `gpt-6.1-sol` → `gpt-6-sol` → `gpt-5.4-mini`, plus `gpt-mini-latest`) and read-only GitHub MCP tool calls (`via Foundry Toolbox`) are routed **exclusively through AI Gateway (`infra/ai-gateway/`)** — there is no other access path from the agent to the model account (`infra/foundry-models/`) or to GitHub MCP.
- **Hub (`infra/ai-gateway/`)**: Standalone AI Gateway (`Microsoft.ApiManagement/aigateways`) that enforces central routing, token rate limits, failover (`gpt-latest`), and MCP tool brokering (`toolServers/github`). Only AI Gateway's managed identity has RBAC access (`Cognitive Services OpenAI User`) to the model account, and only AI Gateway holds the GitHub MCP token.
- **Agent Spoke (`infra/foundry-agents/`)**: Hosts the Foundry project, ACR, Storage, and Hosted Agent runtime. Its project account has no model deployments (`modelDeployments: []`) and no RBAC assignment on the model account, ensuring the agent cannot bypass AI Gateway to call models or GitHub MCP directly.
- **Model Spoke (`infra/foundry-models/`)**: Dedicated model-only Azure AI Services account (`allowProjectManagement: false`, `disableLocalAuth: true`) hosting `gpt-6.1-sol`, `gpt-6-sol`, and `gpt-5.4-mini`, accessible to the agent only through AI Gateway. |
Co-authored-by: paulyuk <1968137+paulyuk@users.noreply.github.com>
Updated the root README with the hub-and-spoke overview and Hub, Agent Spoke, and Model Spoke breakdown. I described the Gateway's actual cross-resource permission as the configured Foundry User role. Committed as |
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 1b3ab80e-64db-4e12-8e50-8fe293ced64b
Configure the default
gpt-latestalias to fail over fromgpt-6.1-soltogpt-6-sol, then togpt-5.4-mini. Provision and register all three deployments with the requested versions and capacities.gpt-mini-latestdirectly routed to the mini deployment.