Repository navigation
test(agentic): act with Ling 3.0 Flash VL instead of GPT-6 Luna - #111
Conversation
Ling costs $0.021/$0.062 per million tokens on OpenRouter, about a fifth of Luna. With the replay cache off it passed 23 of 24 actor-heavy tests on both viewports for $0.024; the one failure, a dialog left open, passed twice on rerun. Gemma 3 12B, cheaper still, failed 19 of 24. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
Warning Review limit reachedEnable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available. Next included review available in 27 minutes. View limit detailsLimit details: You’ve used the included review currently available. Review configuration: ⚙️ Run configuration
📒 Files selected for processing (2)
ℹ️ Recent review info⚙️ Run configuration
📒 Files selected for processing (5)
Included review availability: This review used your included allowance. Your plan provides up to 1 included review per hour; 0 remain after this review. 📝 WalkthroughWalkthroughThe default E2E acting model changed to ChangesAgent model default
Estimated code review effort: 2 (Simple) | ~8 minutes
Note 🎁 Summarized by CodeRabbit FreeYour organization is on the Free plan. CodeRabbit will generate a high-level summary and a walkthrough for each pull request. For a comprehensive line-by-line review, please upgrade your subscription to CodeRabbit Essentials by visiting https://app.coderabbit.ai/settings/billing. Comment |
Desktop had no recording for "Pause the source", so CI sent it to the actor on every run. Uncached, Ling failed it 2 of 7 times: it calls `check` on the switch without `checked: false` and reports the step done. Mobile already had a recording. Note the weakness in testing.md. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
None of the seven failing checks ever started. Each one failed in 2 to 4 seconds with no steps, and GitHub's annotation says: "The job was not started because recent account payments have failed or your spending limit needs to be increased." That is the Actions billing limit, not a code failure. No review feedback asks for a change: Copilot didn't review because of its quota, and CodeRabbit left no comments. My own verification turned up one real gap, which Local results on
The repo has no 🤖 Generated with Claude Code |
Follows up Adam's review comment on #110: use a much cheaper actor model for the agentic tests.
The actor drives
agent.acton a replay-cache miss and in explorations. The default changes fromopenai/gpt-6-lunatoinclusionai/ling-3.0-flash-vl($0.021/$0.062 per million tokens on Novita, DeepInfra as fallback, about a fifth of Luna). The judge stays Muse Spark.E2E_AGENT_MODELstill overrides, and no repository variable sets it, so CI picks up the new default.Trials on the local fake-mode stack, with
--no-cacheso every act step hit the model:first-debate,case-generation,practice,ai-tools,workspace), both viewports: 19 of 24 failed. It wandered, and DeepInfra rejected some of its tool-result messages.first-debateandcase-generationon desktop: Ling, GPT-5 nano and Qwen 3.5 9B all passed, costing $0.003, $0.012 and $0.027.Not run: the page sweep and the other specs, which make no
agent.actcalls, so the actor doesn't touch them. No CI run yet.No replay entries changed: the model isn't part of the replay key.
🤖 Generated with Claude Code
Summary by CodeRabbit