Repository navigation
Upgrade gpt-latest alias to 3-tier failover (gpt-6.1-sol -> gpt-6-sol -> gpt-5.4-mini) #24
Copy link
Copy link
Closed
Description
Summary
Update the sample's default model deployments and gpt-latest AI Gateway alias to use a 3-tier failover chain across the latest GPT-6 and GPT-5.4-mini models:
- Priority 0:
gpt-6.1-sol(version2026-09-29,GlobalStandard, capacity20) — primary flagship model - Priority 1:
gpt-6-sol(version2026-09-22,GlobalStandard, capacity20) — secondary flagship failover in a separate quota pool - Priority 2:
gpt-5.4-mini(version2026-03-17,GlobalStandard, capacity200) — high-capacity safety-net failover (and direct target of thegpt-mini-latestalias)
Note: The exact Foundry catalog model name is gpt-6-sol (not gpt-6.0-sol). Both gpt-6.1-sol (2026-09-29) and gpt-6-sol (2026-09-22) are GA with GlobalStandard SKU across all 6 sample regions (eastus, eastus2, westus, northcentralus, swedencentral, japaneast).
Requirements
1. infra/main.bicep
- Update primary model defaults:
modelName:'gpt-6.1-sol'modelVersion:'2026-09-29'modelDeploymentName:'gpt-latest'(or keep ARM-safe catalog/deployment naming clean and consistent)
- Add secondary flagship failover model parameters:
secondaryModelName:'gpt-6-sol'secondaryModelVersion:'2026-09-22'secondaryModelDeploymentName:'gpt-6-sol'secondaryModelCapacity:20
- Keep mini model defaults:
miniModelName:'gpt-5.4-mini'miniModelVersion:'2026-03-17'miniModelDeploymentName:'gpt-mini-latest'miniModelCapacity:200
- Provision all 3 deployments in
gatewayModelDeploymentsand register all 3 inaiGateway'sfoundryModels. - Update
effectiveModelAliasBackendsfor thegpt-latestalias (primary-router) to:modelDeploymentName(gpt-6.1-sol) atpriority: 0,weight: 100secondaryModelDeploymentName(gpt-6-sol) atpriority: 1,weight: 100miniModelDeploymentName(gpt-5.4-mini) atpriority: 2,weight: 100
- Keep
gpt-mini-latest(mini-router) pointing directly tominiModelDeploymentNameatpriority: 0,weight: 100. - Export
AI_GATEWAY_INTERNAL_SECONDARY_MODEL_DEPLOYMENT,AI_GATEWAY_INTERNAL_SECONDARY_MODEL_NAME, andAI_GATEWAY_INTERNAL_SECONDARY_MODEL_VERSIONoutputs alongside existing internal model outputs.
2. Tests (tests/test-ai-gateway-model-registration.sh)
- Update
tests/test-ai-gateway-model-registration.shto assert thateffectiveModelAliasBackendsininfra/main.bicepconfigures all three backends (modelDeploymentNameat priority 0,secondaryModelDeploymentNameat priority 1, andminiModelDeploymentNameat priority 2, each with weight 100) and thatinfra/main.bicepdefaults togpt-6.1-sol(2026-09-29),gpt-6-sol(2026-09-22), andgpt-5.4-mini(2026-03-17).
3. Documentation (IMPLEMENTATION_NOTES.md)
- Update the architecture/model routing narrative and the Regions and model defaults table in
IMPLEMENTATION_NOTES.mdto document the 3-tiergpt-latestalias (gpt-6.1-sol->gpt-6-sol->gpt-5.4-mini) and the fallback guidance.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels
Activity