Skip to content

Support GPT 5.6 and later models in Multi-Modal Vision selector #1086

Closed
Closed
Support GPT 5.6 and later models in Multi-Modal Vision selector#1086
Assignees
paullizer
Labels
bugSomething isn't working

Description

@paullizer
Paul Lizer (paullizer)
opened on Jul 28, 2026

Issue

The Multi-Modal Vision Analysis model selector omits configured GPT 5.6 deployments even though the same enabled deployments appear under Global Endpoints. This affects GPT 5.6 variants such as Luna, Sol, and Terra and may affect later GPT model versions that use aliases or different model-name fields.

Steps to Reproduce

  1. Enable Multi-Model Endpoints and configure an enabled endpoint with GPT 5.6 deployments (for example Luna, Sol, or Terra).
  2. Save the endpoint with those models enabled.
  3. Open Admin Settings > Search and Extract > Multi-Modal Vision Analysis.
  4. Open the Vision Model selector.

Expected Behavior

Every enabled vision-capable GPT 5.6 deployment appears in the selector, and future GPT 5.x or later naming variants are recognized when their model metadata or deployment name identifies them as GPT models.

Actual Behavior

The selector shows GPT 5.4 deployments but omits the enabled GPT 5.6 deployments shown under Global Endpoints.

Impact

Admins cannot choose newer multimodal deployments for image analysis, forcing them to remain on GPT 5.4 even when newer models are configured and governed.

Notes

The client-side vision filter currently checks only a subset of model naming fields and uses narrow literal patterns. Validate Azure OpenAI, New Foundry, and classic Foundry endpoint model objects, including aliases with spaces or hyphens.

Acceptance Criteria

  • Enabled GPT 5.6 Luna, Sol, and Terra deployments can appear in the Vision Model selector when their metadata identifies them as vision-capable GPT models.
  • Capability matching considers model, display, and deployment naming fields instead of depending on one field.
  • Separator and case differences do not prevent supported GPT model families from being recognized.
  • Existing GPT 5.4, GPT-4o, GPT-4.1, GPT-4.5, vision, and supported o-series behavior remains intact.
  • A focused UI regression test covers the newer multi-endpoint model variants.

Activity

  1. Paul Lizer (paullizer)
    added
    bugSomething isn't working
    on Jul 28, 2026
  2. Paul Lizer (paullizer)
    self-assigned this
    on Jul 28, 2026
  3. github-project-automation
    added this to Simple Chat Roadmapon Jul 28, 2026
  4. github-project-automation
    moved this to Pending Evaluation in Simple Chat Roadmapon Jul 28, 2026
  5. Paul Lizer (paullizer)
    moved this from Pending Evaluation to In progress in Simple Chat Roadmapon Jul 28, 2026

  6. paullizer commented on Jul 28, 2026

    @paullizer
    Paul Lizer (paullizer)
    on Jul 28, 2026
    ContributorAuthor

    Implemented in PR #1087.

    Summary:

    • Added GPT 5.6 and later capability matching across modelName, displayName, deploymentName, deployment, and name fields.
    • Applied the same matching contract to initial Jinja rendering and client-side endpoint updates.
    • Covered Azure OpenAI and New Foundry aliases including Luna, Sol, Terra, provider prefixes, normalized separators, and a future GPT 5.7-style deployment.
    • Preserved disabled endpoint/model and unsupported-family filtering.
    • Updated version 0.250.066, fix documentation, feature guidance, and release notes.

    Validation:

    • 17 affected UI, vision, and route-policy tests passed.
    • JavaScript syntax, Python compilation, Pylance diagnostics for new files, editor diagnostics, and whitespace checks passed.

    Commit: dafcdc1

  7. Paul Lizer (paullizer)
    moved this from In progress to In review in Simple Chat Roadmapon Jul 28, 2026
  8. Paul Lizer (paullizer)
    added a commit that references this issue on Jul 28, 2026

    Guard vision model helper during template reload (microsoft#1086)

    ea7e590

  9. paullizer commented on Jul 28, 2026

    @paullizer
    Paul Lizer (paullizer)
    on Jul 28, 2026
    ContributorAuthor

    Follow-up fix pushed in commit ea7e590 after reproducing a local admin-page 500:

    • Root cause: a long-lived Flask worker had the pre-change route module while Jinja reloaded the new template, so is_vision_capable_model was absent from the render context.
    • Added a guarded Jinja fallback for all vision selector branches. During worker/template skew, the selector renders its placeholder and the existing client-side population runs instead of returning UndefinedError.
    • Extended the Playwright regression to render the actual selector both with and without the route helper.
    • Re-ran the affected suite: 17 passed. Syntax, diagnostics, and whitespace checks passed.

    PR: #1087

  10. Paul Lizer (paullizer)
    added a commit that references this issue on Jul 28, 2026

    Fix GPT 5.6 multimodal vision model selection (#1086)

    dafcdc1

  11. paullizer commented on Aug 19, 2026

    @paullizer
    Paul Lizer (paullizer)
    on Aug 19, 2026
    ContributorAuthor

    Shipped in v0.250.066 via #1087.

    Release note entries:

    • v0.250.066: GPT 5.6+ Multi-Modal Vision Model Selection

    Full notes: https://microsoft.github.io/simplechat/explanation/release_notes/

    Closing as completed. This issue stayed open after the fix merged because pull requests target Development while the repository default branch is main, so GitHub never applied the Fixes # keyword automatically.

  12. Paul Lizer (paullizer)
    closed this as completedon Aug 19, 2026
  13. github-project-automation
    moved this from In review to Released in Simple Chat Roadmapon Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions