Skip to content

test(live): answer the Current Debate prompt and pin Muse Spark 1.3 Contributor - #85

Merged
Programcode merged 1 commit into
mainfrom
t3code/live-e2e-muse
Oct 1, 2026
Merged

Programcode merged 1 commit into
mainfrom
t3code/live-e2e-muse

Conversation

@Programcode

@Programcode Programcode commented Oct 1, 2026 •

Copy link
Copy Markdown
Owner

Fixes the live-e2e failure that every open PR and main show, and makes the live gate use the cheapest model.

Why live-e2e fails

It isn't billing. From 2026-09-27 to 2026-09-30 every live-e2e run died in 2 to 5 seconds without a runner, so the live suite never ran against Current Debate (#72). The runs on 2026-10-01 were the first real ones, and 5 of 8 journeys failed:

  • Brainstorm, case generation, sparring and Crossfire stopped at the "Which debate is this for?" dialog, so the request each test waits for was never sent.
  • The Library journey couldn't click "Add Source", which stays disabled without a current debate.

The Edge "wall clock" terminations in those logs come from the browser closing when the tests timed out. The server wasn't hanging; the Attack call in the same run completed normally.

Changes

  • The live specs answer the dialog with chooseForMotion(), the same way the full-stack specs do, and the Library journey calls startDebate() first.
  • .superset/db-gate.sh now defaults LIVE_MODEL to meta/muse-spark-1.3-contributor. OpenRouter lists it at $0.10 / $0.20 per million input/output tokens, against $0.15 / $0.50 for the old default, GLM 5.3 Flash. Its endpoint supports every parameter the app sends: response_format, reasoning effort, temperature and max tokens. It's test-only and stays out of the app catalog, so users can't pick it. Meta is its only provider, so a Meta outage fails the gate instead of failing over. docs/testing.md says so.

What still uses other models

  • Jev decisions go to typesafe/jev-1.13 through Jev's own API. A chat model can't replace it.
  • model-matrix deliberately runs one case on every catalog model.
  • The production canary picks GPT-5.6 Luna, the Basic default, and is capped at 10 requests a day. Production and staging only accept catalog models.
  • Unit, Edge and full-stack tests use the fake provider and cost nothing.

Verification

  • docs:check, typecheck, ESLint on e2e/live and bash -n on the gate script pass.
  • This PR's live-e2e job passed 8 of 8 journeys in 5.8 minutes with meta/muse-spark-1.3-contributor. expectProviderCallsHealthy checks that every chat call used the pinned model and returned 200.
  • browser-tests failed once on navigation-performance.spec.ts:118 (route-skeleton timing). This PR doesn't touch that code, and the same test flaked and passed on rerun on feat(staging): admin staging switcher and staging sync procedure #81.
  • Codex review (gpt-6.1-sol, high): no actionable findings.

🤖 Generated with Claude Code

…ontributor

The live journeys were never updated for Current Debate (#72): Actions was
out of minutes from 2026-09-27 to 2026-09-30, so the first real live-e2e run
was on 2026-10-01. Five journeys stopped at "Which debate is this for?" or,
in the Library, at a disabled Add Source button with no current debate. They
now answer the prompt the way the full-stack specs do, and the Library
journey starts a debate first.

The live gate's default model is now meta/muse-spark-1.3-contributor
($0.10/$0.20 per million tokens, against $0.15/$0.50 for GLM 5.3 Flash). It
supports every parameter the app sends. It is test-only and stays out of the
app catalog.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Copilot AI balanced review requested due to automatic review settings October 1, 2026 13:08
@vercel

vercel Bot commented Oct 1, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
debate-navigator Ready Ready Preview Oct 1, 2026 1:09pm UTC

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@coderabbitai

coderabbitai Bot commented Oct 1, 2026

Copy link
Copy Markdown

Warning

Review limit reached

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

Next included review available in 53 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Free

Run ID: eb67dd47-fc70-4eab-ab4e-8261536049a7

📥 Commits

Reviewing files that changed from the base of the PR and between fe6100a and 0ddad16.

📒 Files selected for processing (4)
  • .superset/db-gate.sh
  • docs/testing.md
  • e2e/live/models.spec.ts
  • e2e/live/research.spec.ts
  • Autopilot · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Autopilot is currently an internal CodeRabbit preview.


Note

🎁 Summarized by CodeRabbit Free

Your organization is on the Free plan. CodeRabbit will generate a high-level summary and a walkthrough for each pull request. For a comprehensive line-by-line review, please upgrade your subscription to CodeRabbit Essentials by visiting https://app.coderabbit.ai/settings/billing.

Comment @coderabbitai help to get the list of available commands.

@Programcode
Programcode merged commit 0645019 into main Oct 1, 2026
10 of 11 checks passed
Programcode added a commit that referenced this pull request Oct 1, 2026
Brings in #79 to #83 and #85.

Conflict in .superset/db-gate.sh: both sides added a function to the
readiness loop. The loop now waits for both `voice` and `account`.

#82 replaced the "Which debate is this for?" dialog with the first-debate
offer when no debate is current. e2e/voice-rounds.spec.ts still clicked
the old button in two places, so it answers the new offer the way
e2e/sparring.spec.ts does.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

This branch was successfully deployed

1 active deployment
Preview — 0ddad164 Deployed Oct 1, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants