Skip to content

Gateway: closed-weight frontier provider catalog with per-provider API key UI #24

Description

@gregjkal

Summary

Gateway should know about all closed-weight frontier models and offer a UI for adding an API key per provider. Start with GPT-6-Astra.

Details

From the #cppa-wg21-org design discussion on 2026-09-09:

  • The Remote tab of the gateway config should present a tree: provider > model family > expandable versions. Vinnie's sketch:
    > Anthropic (rolldown)
      > Opus
      > Fable
      > Sonnet
    
    Each family opens to show individual versions.
  • Model availability depends on the user's subscription (example: Fable is available on a team account but not a personal account), so the UI and the routing layer need a "model not available" failure mode.
  • The PromptForge executor needs to know the model names so it can map tools.
  • Open question: are closed models equal siblings to open-weight models, differing only on the detail page (API key instead of download links)? Current direction is simply two tabs, Local | Remote.

Related

Current code: crates/gateway-config-ui/ui/src/views/models-view.ts (Remote scope), crates/gateway-config/src/config.rs.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions