Skip to content

fix(ai): continue DurableAgent tool loops#2730

Merged
NathanColosimo merged 1 commit into
mainfrom
nathanc/fix-durable-agent-tool-stop-detection
Jul 1, 2026
Merged

fix(ai): continue DurableAgent tool loops#2730
NathanColosimo merged 1 commit into
mainfrom
nathanc/fix-durable-agent-tool-stop-detection

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Summary

  • Treat any DurableAgent step with collected tool calls as a tool-call step, even if the provider reports a non-tool finish reason.
  • Add a patch changeset for @workflow/ai.

Fixes #1387.

Testing

  • PATH="/Users/nathancolosimo/.cache/codex-runtimes/codex-primary-runtime/dependencies/node/bin:/Users/nathancolosimo/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin:$PATH" HUSKY=0 pnpm --dir packages/ai exec vitest run src/agent/stream-text-iterator.test.ts

@changeset-bot

changeset-bot Bot commented Jun 30, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: c782692

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
@workflow/ai Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercel Bot commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Building Building Preview, Comment Jun 30, 2026 11:45pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Jun 30, 2026 11:45pm
example-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workbench-astro-workflow Building Building Preview, Comment Jun 30, 2026 11:45pm
workbench-express-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workbench-fastify-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workbench-hono-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workbench-nitro-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workbench-nuxt-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workbench-tanstack-start-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workbench-vite-workflow Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Jun 30, 2026 11:45pm
workflow-swc-playground Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workflow-tarballs Ready Ready Preview, Comment Jun 30, 2026 11:45pm
workflow-web Ready Ready Preview, Comment Jun 30, 2026 11:45pm

@github-actions

github-actions Bot commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 1442 0 230 1672
✅ 💻 Local Development 1605 0 219 1824
✅ 📦 Local Production 1605 0 219 1824
✅ 🐘 Local Postgres 1593 0 231 1824
✅ 🪟 Windows 152 0 0 152
✅ 📋 Other 885 0 179 1064
Total 7282 0 1078 8360

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 125 0 27
✅ example 125 0 27
✅ express 125 0 27
✅ fastify 125 0 27
✅ hono 125 0 27
✅ nextjs-turbopack 149 0 3
✅ nextjs-webpack 149 0 3
✅ nitro 125 0 27
✅ nuxt 125 0 27
✅ sveltekit 144 0 8
✅ vite 125 0 27
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 127 0 25
✅ express-stable 127 0 25
✅ fastify-stable 127 0 25
✅ hono-stable 127 0 25
✅ nextjs-turbopack-canary 133 0 19
✅ nextjs-turbopack-stable 152 0 0
✅ nextjs-webpack-canary 133 0 19
✅ nextjs-webpack-stable 152 0 0
✅ nitro-stable 127 0 25
✅ nuxt-stable 127 0 25
✅ sveltekit-stable 146 0 6
✅ vite-stable 127 0 25
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 127 0 25
✅ express-stable 127 0 25
✅ fastify-stable 127 0 25
✅ hono-stable 127 0 25
✅ nextjs-turbopack-canary 133 0 19
✅ nextjs-turbopack-stable 152 0 0
✅ nextjs-webpack-canary 133 0 19
✅ nextjs-webpack-stable 152 0 0
✅ nitro-stable 127 0 25
✅ nuxt-stable 127 0 25
✅ sveltekit-stable 146 0 6
✅ vite-stable 127 0 25
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 126 0 26
✅ express-stable 126 0 26
✅ fastify-stable 126 0 26
✅ hono-stable 126 0 26
✅ nextjs-turbopack-canary 132 0 20
✅ nextjs-turbopack-stable 151 0 1
✅ nextjs-webpack-canary 132 0 20
✅ nextjs-webpack-stable 151 0 1
✅ nitro-stable 126 0 26
✅ nuxt-stable 126 0 26
✅ sveltekit-stable 145 0 7
✅ vite-stable 126 0 26
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 152 0 0
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 127 0 25
✅ e2e-local-dev-tanstack-start- 127 0 25
✅ e2e-local-postgres-nest-stable 126 0 26
✅ e2e-local-postgres-tanstack-start- 126 0 26
✅ e2e-local-prod-nest-stable 127 0 25
✅ e2e-local-prod-tanstack-start- 127 0 25
✅ e2e-vercel-prod-tanstack-start 125 0 27

📋 View full workflow run

@github-actions

github-actions Bot commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.046s (+4.8%) 1.008s (~) 0.962s 10 1.00x
💻 Local Express 0.048s (+3.9%) 1.006s (~) 0.958s 10 1.04x
💻 Local Next.js (Turbopack) 0.050s (-8.0% 🟢) 1.007s (~) 0.957s 10 1.07x
🐘 Postgres Next.js (Turbopack) 0.058s (-47.7% 🟢) 1.011s (-2.8%) 0.953s 10 1.25x
🐘 Postgres Express 0.062s (-15.5% 🟢) 1.011s (~) 0.949s 10 1.34x
🐘 Postgres Nitro 0.066s (+4.9%) 1.012s (~) 0.946s 10 1.43x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 0.181s (-50.5% 🟢) 2.101s (+14.7% 🔺) 1.920s 10 1.00x
▲ Vercel Express 0.286s (+41.6% 🔺) 2.280s (+15.3% 🔺) 1.993s 10 1.58x
▲ Vercel Next.js (Turbopack) 0.719s (+55.6% 🔺) 2.558s (~) 1.839s 10 3.98x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.078s (~) 2.006s (~) 0.928s 10 1.00x
💻 Local Express 1.084s (~) 2.007s (~) 0.923s 10 1.01x
💻 Local Next.js (Turbopack) 1.090s (+0.8%) 2.007s (~) 0.917s 10 1.01x
🐘 Postgres Express 1.092s (~) 2.011s (~) 0.919s 10 1.01x
🐘 Postgres Next.js (Turbopack) 1.098s (~) 2.009s (~) 0.911s 10 1.02x
🐘 Postgres Nitro 1.100s (+0.8%) 2.010s (~) 0.910s 10 1.02x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.416s (+4.0%) 3.262s (+23.9% 🔺) 1.846s 10 1.00x
▲ Vercel Nitro 1.460s (+8.5% 🔺) 3.198s (+13.1% 🔺) 1.737s 10 1.03x
▲ Vercel Next.js (Turbopack) 2.323s (+3.5%) 3.803s (~) 1.479s 10 1.64x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 10.446s (~) 11.023s (~) 0.577s 3 1.00x
💻 Local Nitro 10.454s (~) 11.023s (~) 0.568s 3 1.00x
💻 Local Express 10.460s (~) 11.023s (~) 0.563s 3 1.00x
🐘 Postgres Express 10.474s (~) 11.018s (~) 0.544s 3 1.00x
🐘 Postgres Nitro 10.494s (~) 11.021s (~) 0.527s 3 1.00x
🐘 Postgres Next.js (Turbopack) 10.519s (+1.2%) 11.014s (~) 0.495s 3 1.01x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 11.981s (-0.6%) 13.545s (-0.6%) 1.564s 3 1.00x
▲ Vercel Nitro 12.182s (+2.4%) 13.923s (+1.8%) 1.741s 3 1.02x
▲ Vercel Next.js (Turbopack) 12.925s (+2.0%) 14.240s (-3.4%) 1.315s 3 1.08x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 13.586s (~) 14.027s (~) 0.441s 5 1.00x
💻 Local Express 13.618s (-0.8%) 14.028s (~) 0.410s 5 1.00x
🐘 Postgres Express 13.628s (~) 14.019s (~) 0.391s 5 1.00x
💻 Local Next.js (Turbopack) 13.631s (~) 14.028s (~) 0.397s 5 1.00x
🐘 Postgres Next.js (Turbopack) 13.664s (~) 14.017s (~) 0.353s 5 1.01x
🐘 Postgres Nitro 13.693s (~) 14.022s (~) 0.329s 5 1.01x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 16.552s (-1.3%) 18.018s (-2.2%) 1.465s 4 1.00x
▲ Vercel Express 16.812s (+2.3%) 18.490s (-1.2%) 1.678s 4 1.02x
▲ Vercel Next.js (Turbopack) 18.000s (+4.6%) 20.025s (+3.7%) 2.025s 3 1.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 12.085s (~) 13.026s (~) 0.941s 7 1.00x
🐘 Postgres Express 12.117s (-2.9%) 13.019s (~) 0.902s 7 1.00x
💻 Local Express 12.148s (~) 13.024s (~) 0.876s 7 1.01x
💻 Local Next.js (Turbopack) 12.235s (~) 13.026s (~) 0.790s 7 1.01x
🐘 Postgres Nitro 12.375s (+1.4%) 13.024s (~) 0.649s 7 1.02x
🐘 Postgres Next.js (Turbopack) 12.444s (~) 13.159s (+1.9%) 0.715s 7 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 17.916s (+1.7%) 19.267s (~) 1.352s 5 1.00x
▲ Vercel Nitro 18.065s (+4.1%) 19.705s (+4.0%) 1.640s 5 1.01x
▲ Vercel Next.js (Turbopack) 21.003s (+5.7% 🔺) 22.701s (+3.8%) 1.698s 4 1.17x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.165s (-1.5%) 2.009s (~) 0.843s 15 1.00x
🐘 Postgres Next.js (Turbopack) 1.179s (-7.4% 🟢) 2.007s (-1.6%) 0.828s 15 1.01x
🐘 Postgres Nitro 1.195s (-0.6%) 2.009s (~) 0.814s 15 1.03x
💻 Local Express 1.379s (-1.0%) 2.007s (~) 0.628s 15 1.18x
💻 Local Next.js (Turbopack) 1.401s (-1.6%) 2.007s (~) 0.606s 15 1.20x
💻 Local Nitro 1.406s (~) 2.006s (~) 0.600s 15 1.21x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.352s (+7.5% 🔺) 4.288s (+12.9% 🔺) 1.935s 7 1.00x
▲ Vercel Express 2.382s (+20.7% 🔺) 3.517s (-5.7% 🟢) 1.135s 9 1.01x
▲ Vercel Next.js (Turbopack) 3.656s (+10.3% 🔺) 5.165s (+0.8%) 1.509s 6 1.55x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.325s (~) 2.828s (~) 1.503s 11 1.00x
🐘 Postgres Next.js (Turbopack) 1.330s (~) 3.009s (+21.4% 🔺) 1.679s 10 1.00x
🐘 Postgres Express 1.366s (+0.8%) 2.393s (+3.4%) 1.027s 13 1.03x
💻 Local Next.js (Turbopack) 2.131s (-22.2% 🟢) 2.826s (-9.1% 🟢) 0.695s 11 1.61x
💻 Local Nitro 2.421s (-4.0%) 3.009s (-3.2%) 0.588s 10 1.83x
💻 Local Express 2.449s (-5.2% 🟢) 3.009s (~) 0.560s 10 1.85x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.103s (+29.8% 🔺) 4.584s (+19.8% 🔺) 1.481s 7 1.00x
▲ Vercel Express 3.333s (+25.8% 🔺) 4.715s (+17.2% 🔺) 1.383s 7 1.07x
▲ Vercel Next.js (Turbopack) 5.144s (+41.8% 🔺) 6.770s (+17.2% 🔺) 1.626s 5 1.66x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.639s (+3.1%) 4.015s (~) 2.376s 8 1.00x
🐘 Postgres Nitro 1.698s (+6.9% 🔺) 4.142s (+3.2%) 2.445s 8 1.04x
🐘 Postgres Next.js (Turbopack) 2.941s (+61.6% 🔺) 5.845s (+19.5% 🔺) 2.904s 6 1.79x
💻 Local Express 4.514s (-32.2% 🟢) 5.013s (-32.4% 🟢) 0.498s 6 2.75x
💻 Local Next.js (Turbopack) 4.727s (-39.7% 🟢) 5.013s (-37.5% 🟢) 0.286s 6 2.88x
💻 Local Nitro 4.741s (-22.9% 🟢) 5.180s (-24.0% 🟢) 0.439s 6 2.89x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.785s (+43.1% 🔺) 5.437s (+28.6% 🔺) 1.651s 6 1.00x
▲ Vercel Express 4.047s (+50.9% 🔺) 5.597s (+29.1% 🔺) 1.550s 6 1.07x
▲ Vercel Next.js (Turbopack) 5.318s (+28.2% 🔺) 6.714s (+9.9% 🔺) 1.396s 5 1.40x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.176s (~) 2.008s (~) 0.832s 15 1.00x
🐘 Postgres Next.js (Turbopack) 1.190s (+0.6%) 2.007s (~) 0.817s 15 1.01x
🐘 Postgres Nitro 1.199s (+2.3%) 2.007s (~) 0.808s 15 1.02x
💻 Local Express 1.418s (-1.9%) 2.007s (~) 0.589s 15 1.21x
💻 Local Nitro 1.430s (+4.3%) 2.006s (~) 0.576s 15 1.22x
💻 Local Next.js (Turbopack) 1.454s (+1.7%) 2.007s (~) 0.553s 15 1.24x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.123s (+12.2% 🔺) 3.451s (-7.1% 🟢) 1.328s 9 1.00x
▲ Vercel Nitro 2.178s (+13.6% 🔺) 3.626s (+2.6%) 1.447s 9 1.03x
▲ Vercel Next.js (Turbopack) 3.491s (+13.4% 🔺) 4.752s (-3.7%) 1.262s 7 1.64x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.272s (-2.6%) 2.393s (-3.1%) 1.121s 13 1.00x
🐘 Postgres Next.js (Turbopack) 1.332s (-5.2% 🟢) 3.009s (+18.8% 🔺) 1.677s 10 1.05x
🐘 Postgres Nitro 1.341s (+2.0%) 2.509s (-3.2%) 1.169s 12 1.05x
💻 Local Express 2.461s (-6.7% 🟢) 3.008s (~) 0.548s 10 1.93x
💻 Local Nitro 2.483s (-9.3% 🟢) 3.009s (-10.0% 🟢) 0.525s 10 1.95x
💻 Local Next.js (Turbopack) 2.852s (+6.9% 🔺) 3.209s (~) 0.357s 10 2.24x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.432s (-3.0%) 3.787s (-4.1%) 1.356s 9 1.00x
▲ Vercel Nitro 2.432s (+4.9%) 3.883s (+2.8%) 1.451s 8 1.00x
▲ Vercel Next.js (Turbopack) 4.074s (+19.6% 🔺) 5.733s (+8.8% 🔺) 1.659s 6 1.68x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.553s (-2.5%) 4.137s (~) 2.584s 8 1.00x
🐘 Postgres Nitro 1.681s (+2.2%) 4.298s (~) 2.616s 7 1.08x
🐘 Postgres Next.js (Turbopack) 2.721s (+4.4%) 5.684s (+8.7% 🔺) 2.962s 6 1.75x
💻 Local Next.js (Turbopack) 4.499s (-29.3% 🟢) 5.681s (-21.3% 🟢) 1.182s 6 2.90x
💻 Local Nitro 5.517s (-14.3% 🟢) 6.214s (-16.2% 🟢) 0.697s 5 3.55x
💻 Local Express 5.759s (-9.1% 🟢) 6.214s (-8.8% 🟢) 0.455s 5 3.71x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.829s (~) 4.623s (+5.4% 🔺) 1.794s 7 1.00x
▲ Vercel Express 2.889s (+2.1%) 4.429s (-2.8%) 1.540s 7 1.02x
▲ Vercel Next.js (Turbopack) 4.398s (~) 5.881s (-4.7%) 1.482s 6 1.55x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.546s (-1.1%) 1.041s (+3.4%) 0.495s 58 1.00x
🐘 Postgres Next.js (Turbopack) 0.558s (-8.1% 🟢) 1.023s (-2.7%) 0.465s 59 1.02x
💻 Local Nitro 0.570s (-5.6% 🟢) 1.005s (-3.3%) 0.435s 60 1.04x
🐘 Postgres Nitro 0.571s (+1.3%) 1.007s (-1.5%) 0.436s 60 1.05x
💻 Local Express 0.602s (+9.0% 🔺) 1.005s (~) 0.403s 60 1.10x
💻 Local Next.js (Turbopack) 0.607s (-8.2% 🟢) 1.005s (-4.9%) 0.399s 60 1.11x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.552s (-7.3% 🟢) 4.066s (-8.7% 🟢) 1.514s 15 1.00x
▲ Vercel Express 2.605s (-3.2%) 4.030s (-6.1% 🟢) 1.425s 16 1.02x
▲ Vercel Next.js (Turbopack) 4.334s (+20.0% 🔺) 6.087s (+13.1% 🔺) 1.753s 10 1.70x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.210s (-10.4% 🟢) 2.008s (-1.1%) 0.797s 45 1.00x
🐘 Postgres Next.js (Turbopack) 1.290s (-13.4% 🟢) 2.008s (-6.0% 🟢) 0.718s 45 1.07x
🐘 Postgres Nitro 1.335s (+1.6%) 2.030s (-1.1%) 0.695s 45 1.10x
💻 Local Nitro 1.438s (+0.6%) 2.006s (~) 0.567s 45 1.19x
💻 Local Express 1.517s (+8.3% 🔺) 2.028s (+1.1%) 0.511s 45 1.25x
💻 Local Next.js (Turbopack) 1.536s (+3.1%) 2.006s (~) 0.471s 45 1.27x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 5.640s (-8.1% 🟢) 7.066s (-6.8% 🟢) 1.427s 13 1.00x
▲ Vercel Express 6.049s (-1.8%) 7.256s (-7.6% 🟢) 1.207s 13 1.07x
▲ Vercel Next.js (Turbopack) 9.170s (+15.6% 🔺) 10.427s (+6.5% 🔺) 1.257s 9 1.63x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.516s (-4.3%) 3.111s (+0.9%) 0.595s 39 1.00x
🐘 Postgres Next.js (Turbopack) 2.617s (-11.2% 🟢) 3.033s (-12.1% 🟢) 0.416s 40 1.04x
🐘 Postgres Nitro 2.624s (+0.8%) 3.059s (+0.8%) 0.435s 40 1.04x
💻 Local Nitro 3.108s (-2.2%) 3.821s (-3.1%) 0.713s 32 1.24x
💻 Local Express 3.276s (+9.7% 🔺) 4.009s (+15.7% 🔺) 0.733s 30 1.30x
💻 Local Next.js (Turbopack) 3.323s (+3.8%) 4.009s (~) 0.686s 30 1.32x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 10.906s (-6.8% 🟢) 12.374s (-7.6% 🟢) 1.467s 10 1.00x
▲ Vercel Nitro 11.998s (+1.2%) 13.779s (+2.8%) 1.781s 9 1.10x
▲ Vercel Next.js (Turbopack) 20.758s (+23.1% 🔺) 22.514s (+20.4% 🔺) 1.757s 6 1.90x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.179s (-22.8% 🟢) 1.006s (~) 0.828s 60 1.00x
🐘 Postgres Express 0.204s (-8.3% 🟢) 1.007s (~) 0.803s 60 1.14x
🐘 Postgres Nitro 0.223s (+3.8%) 1.006s (~) 0.784s 60 1.25x
💻 Local Nitro 0.482s (+12.1% 🔺) 1.004s (~) 0.523s 60 2.70x
💻 Local Express 0.498s (+10.7% 🔺) 1.005s (~) 0.507s 60 2.79x
💻 Local Next.js (Turbopack) 0.636s (+1.1%) 1.005s (~) 0.369s 60 3.56x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.166s (+25.2% 🔺) 2.413s (-2.6%) 1.247s 25 1.00x
▲ Vercel Nitro 1.197s (+16.8% 🔺) 2.511s (+3.0%) 1.314s 24 1.03x
▲ Vercel Next.js (Turbopack) 2.967s (+49.6% 🔺) 4.463s (+16.1% 🔺) 1.496s 14 2.54x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.285s (-10.3% 🟢) 1.029s (+0.8%) 0.744s 88 1.00x
🐘 Postgres Express 0.307s (-7.9% 🟢) 1.018s (+1.2%) 0.711s 89 1.08x
🐘 Postgres Nitro 0.340s (+1.1%) 1.018s (+1.1%) 0.678s 89 1.19x
💻 Local Express 2.378s (+9.4% 🔺) 3.009s (+8.8% 🔺) 0.630s 30 8.34x
💻 Local Nitro 2.399s (+24.7% 🔺) 3.009s (+19.9% 🔺) 0.610s 30 8.41x
💻 Local Next.js (Turbopack) 2.691s (-8.1% 🟢) 3.076s (-9.0% 🟢) 0.385s 30 9.44x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 1.525s (-5.8% 🟢) 3.068s (+2.1%) 1.544s 30 1.00x
▲ Vercel Express 1.771s (+24.4% 🔺) 3.345s (+11.3% 🔺) 1.574s 27 1.16x
▲ Vercel Next.js (Turbopack) 3.183s (+27.7% 🔺) 4.812s (+17.1% 🔺) 1.629s 19 2.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.455s (-16.3% 🟢) 1.050s (-6.0% 🟢) 0.595s 115 1.00x
🐘 Postgres Next.js (Turbopack) 0.519s (+3.8%) 3.035s (+20.7% 🔺) 2.515s 40 1.14x
🐘 Postgres Nitro 0.532s (-3.1%) 1.069s (-5.3% 🟢) 0.537s 113 1.17x
💻 Local Nitro 5.606s (-41.9% 🟢) 8.742s (-18.9% 🟢) 3.135s 14 12.33x
💻 Local Express 5.608s (-39.3% 🟢) 8.291s (-20.6% 🟢) 2.683s 15 12.33x
💻 Local Next.js (Turbopack) 6.624s (-38.7% 🟢) 9.416s (-19.9% 🟢) 2.792s 13 14.57x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.922s (+8.1% 🔺) 3.591s (-1.9%) 1.669s 34 1.00x
▲ Vercel Nitro 2.140s (+27.6% 🔺) 3.874s (+12.3% 🔺) 1.734s 32 1.11x
▲ Vercel Next.js (Turbopack) 4.672s (+15.0% 🔺) 6.340s (+8.1% 🔺) 1.668s 19 2.43x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 1.133s (-0.5%) 1.969s (~) 0.010s (-15.0% 🟢) 2.018s (~) 0.885s 10 1.00x
🐘 Postgres Express 1.144s (-0.7%) 1.999s (~) 0.001s (-8.3% 🟢) 2.010s (~) 0.866s 10 1.01x
💻 Local Nitro 1.151s (~) 2.005s (~) 0.012s (+10.3% 🔺) 2.019s (~) 0.868s 10 1.02x
💻 Local Express 1.158s (+1.5%) 2.004s (~) 0.014s (+30.2% 🔺) 2.021s (~) 0.863s 10 1.02x
🐘 Postgres Next.js (Turbopack) 1.163s (-4.8%) 2.001s (+0.6%) 0.002s (+66.7% 🔺) 2.012s (~) 0.849s 10 1.03x
🐘 Postgres Nitro 1.169s (-1.6%) 1.999s (~) 0.001s (~) 2.012s (~) 0.843s 10 1.03x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.114s (+3.7%) 3.185s (-5.0% 🟢) 2.205s (+59.2% 🔺) 5.836s (+11.5% 🔺) 3.722s 10 1.00x
▲ Vercel Nitro 2.240s (+17.2% 🔺) 3.356s (+7.8% 🔺) 2.285s (+39.6% 🔺) 6.139s (+18.8% 🔺) 3.899s 10 1.06x
▲ Vercel Next.js (Turbopack) 4.102s (+27.8% 🔺) 3.818s (-4.5%) 2.411s (+192.0% 🔺) 7.769s (+27.1% 🔺) 3.667s 10 1.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.521s (-4.2%) 2.005s (-1.5%) 0.005s (-10.5% 🟢) 2.025s (-1.7%) 0.504s 30 1.00x
💻 Local Express 1.557s (+1.2%) 2.010s (~) 0.012s (-11.4% 🟢) 2.024s (~) 0.467s 30 1.02x
💻 Local Nitro 1.571s (+0.7%) 2.010s (~) 0.013s (+2.0%) 2.028s (~) 0.457s 30 1.03x
💻 Local Next.js (Turbopack) 1.574s (~) 1.972s (~) 0.012s (+0.6%) 2.026s (~) 0.451s 30 1.04x
🐘 Postgres Next.js (Turbopack) 1.578s (-16.5% 🟢) 2.009s (-11.2% 🟢) 0.005s (-32.1% 🟢) 2.025s (-12.0% 🟢) 0.447s 30 1.04x
🐘 Postgres Nitro 1.635s (+4.0%) 2.005s (~) 0.005s (-6.7% 🟢) 2.027s (~) 0.391s 30 1.08x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 5.668s (~) 6.697s (-6.5% 🟢) 0.460s (+125.2% 🔺) 7.621s (-3.8%) 1.953s 8 1.00x
▲ Vercel Nitro 5.673s (~) 6.921s (-0.7%) 0.386s (+36.0% 🔺) 7.756s (+1.1%) 2.083s 8 1.00x
▲ Vercel Next.js (Turbopack) 10.544s (+11.9% 🔺) 11.377s (+5.8% 🔺) 0.298s (+16.0% 🔺) 12.819s (+8.4% 🔺) 2.275s 5 1.86x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.757s (-2.8%) 1.068s (+0.8%) 0.000s (+Infinity% 🔺) 1.079s (~) 0.322s 56 1.00x
🐘 Postgres Nitro 0.840s (+9.1% 🔺) 1.130s (+2.2%) 0.000s (-59.2% 🟢) 1.144s (+2.2%) 0.303s 53 1.11x
🐘 Postgres Next.js (Turbopack) 0.924s (-32.9% 🟢) 1.246s (-36.5% 🟢) 0.000s (NaN%) 1.258s (-37.2% 🟢) 0.334s 48 1.22x
💻 Local Next.js (Turbopack) 1.285s (-7.0% 🟢) 1.886s (-4.7%) 0.001s (+106.3% 🔺) 1.923s (-4.6%) 0.638s 32 1.70x
💻 Local Express 1.373s (+7.9% 🔺) 1.888s (-6.2% 🟢) 0.000s (-37.5% 🟢) 1.891s (-6.2% 🟢) 0.518s 32 1.81x
💻 Local Nitro 1.396s (+7.6% 🔺) 1.920s (-4.6%) 0.001s (+194.6% 🔺) 1.923s (-4.6%) 0.527s 32 1.84x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.107s (+7.9% 🔺) 4.264s (-1.6%) 0.000s (+Infinity% 🔺) 4.710s (-2.3%) 1.603s 13 1.00x
▲ Vercel Nitro 3.247s (-98.2% 🟢) 4.491s (-97.6% 🟢) 0.000s (NaN%) 4.959s (-97.3% 🟢) 1.712s 13 1.04x
▲ Vercel Next.js (Turbopack) 4.918s (+16.1% 🔺) 5.665s (+4.3%) 0.003s (+Infinity% 🔺) 6.553s (+5.7% 🔺) 1.635s 10 1.58x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.653s (-4.5%) 2.257s (-1.3%) 0.000s (~) 2.276s (-1.3%) 0.623s 27 1.00x
🐘 Postgres Nitro 1.786s (-5.5% 🟢) 2.304s (-5.3% 🟢) 0.000s (-100.0% 🟢) 2.319s (-5.3% 🟢) 0.533s 26 1.08x
🐘 Postgres Next.js (Turbopack) 2.112s (-25.3% 🟢) 2.608s (-22.3% 🟢) 0.000s (NaN%) 2.619s (-22.8% 🟢) 0.506s 23 1.28x
💻 Local Express 3.270s (-3.7%) 3.842s (-4.5%) 0.001s (+3.1%) 3.845s (-4.6%) 0.575s 16 1.98x
💻 Local Nitro 3.415s (-7.4% 🟢) 4.027s (-6.7% 🟢) 0.000s (-37.8% 🟢) 4.030s (-6.7% 🟢) 0.616s 15 2.07x
💻 Local Next.js (Turbopack) 3.563s (+2.2%) 4.127s (+3.5%) 0.000s (-60.0% 🟢) 4.164s (+3.2%) 0.601s 15 2.16x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.949s (+14.6% 🔺) 6.036s (+6.2% 🔺) 0.000s (NaN%) 6.536s (+6.4% 🔺) 1.588s 10 1.00x
▲ Vercel Nitro 5.064s (+16.4% 🔺) 6.215s (+5.5% 🔺) 0.000s (+Infinity% 🔺) 6.686s (+3.5%) 1.622s 10 1.02x
▲ Vercel Next.js (Turbopack) 7.448s (+7.3% 🔺) 7.899s (~) 0.000s (+Infinity% 🔺) 8.999s (+1.8%) 1.551s 7 1.51x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Nitro 9/21
🐘 Postgres Express 17/21
▲ Vercel Express 12/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 17/21
Next.js (Turbopack) 🐘 Postgres 14/21
Nitro 🐘 Postgres 13/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@NathanColosimo NathanColosimo marked this pull request as ready for review June 30, 2026 23:48
@NathanColosimo NathanColosimo requested review from a team and ijjk as code owners June 30, 2026 23:48

@karthikscale3 karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved. Behavior matches current AI SDK tool-loop semantics for client tool calls with non-tool finish reasons; regression coverage would still be a useful follow-up.

@NathanColosimo NathanColosimo enabled auto-merge (squash) July 1, 2026 16:40
@NathanColosimo NathanColosimo merged commit 0f02af4 into main Jul 1, 2026
180 of 197 checks passed
@NathanColosimo NathanColosimo deleted the nathanc/fix-durable-agent-tool-stop-detection branch July 1, 2026 16:40
github-actions Bot added a commit that referenced this pull request Jul 1, 2026
Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2740. (backport job run)

VaguelySerious pushed a commit that referenced this pull request Jul 1, 2026
Co-authored-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

DurableAgent stops tool loop when step has tool calls but finishReason is "other"/"unknown"

2 participants