Skip to content

fix(pstack): make the bug-fix playbook fix every site of the same fault - #1237

Open
rutkowskij wants to merge 1 commit into
cursor:mainfrom
rutkowskij:pstack/bug-fix-same-fault-sites
Open

rutkowskij wants to merge 1 commit into
cursor:mainfrom
rutkowskij:pstack/bug-fix-same-fault-sites

Conversation

@rutkowskij

Copy link
Copy Markdown

Why

When a bug report names one symptom, the agent often finds the same fault at other sites and leaves them out on purpose. It lists them in the reply and offers to fix them later. principle-fix-root-causes already says to fix every site, but the agent seldom opens it during a bug fix. The agent read the bug-fix playbook in 31 of 32 test runs, so the rule goes there.

What changed

  • poteto-mode/playbooks/bug-fix.md line 5 gets one sentence: "The same fault at sites the report did not name is part of the fix: fix them all, not only the reported one."
  • The generated Claude Code tree is regenerated.

Scope

  • Only the bug-fix playbook changes.
  • Tested on Claude Code only. Cursor runs with grok-4.7-medium mostly did not finish inside 15 minutes, so there is no Cursor result.

Blast Radius

Every poteto-mode bug fix. A fix can now cover more sites than the report names. On the tested tasks, cost and diff size stayed about the same.

Verification

  • Claude Code, Opus 5.5, /pstack:poteto-mode <bug report>, hidden graders: a race-condition task went from 5/9 to 9/9 runs that fix every site. An HTML-escaping task stayed at 3/3, and SWE-rebench python-scim__scim2-models-126 stayed at 4/4.
  • Tasks, graders, results and the failure quote: https://gist.github.com/rutkowskij/83bcf0dca0c925c83ff9f20ca66168ea
  • CI steps pass locally: validate-plugins.mjs and generate-pstack-harness-trees.mjs --check. In the script tests, only the statechart symlink test fails, and it fails the same way on main with Node 26.

When a report names one symptom, the agent often finds the same fault at
other sites and leaves it out to keep the change narrow. The playbook now
says those sites are part of the fix. The Claude Code tree is regenerated.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants