Skip to content

fix(pstack): make the bug-fix playbook fix every site of the same fault - #1

Closed
rutkowskij wants to merge 1 commit into
mainfrom
pstack/bug-fix-same-fault-sites
Closed

rutkowskij wants to merge 1 commit into
mainfrom
pstack/bug-fix-same-fault-sites

Conversation

@rutkowskij

@rutkowskij rutkowskij commented Nov 13, 2026 •

Copy link
Copy Markdown
Owner

Why

When a bug report names one symptom, the agent often finds the same fault at other sites and leaves them out on purpose. It lists them in the reply and offers to fix them later. principle-fix-root-causes already says to fix every site, but the agent seldom opens it during a bug fix. The agent read the bug-fix playbook in 31 of 32 test runs, so the rule goes there.

What changed

  • poteto-mode/playbooks/bug-fix.md line 5 gets one sentence: "The same fault at sites the report did not name is part of the fix: fix them all, not only the reported one."
  • The generated Claude Code tree is regenerated.

Scope

  • Only the bug-fix playbook changes.
  • Tested on Claude Code only. Cursor runs with grok-4.7-medium mostly did not finish inside 15 minutes, so there is no Cursor result.

Blast Radius

Every poteto-mode bug fix. A fix can now cover more sites than the report names. On the tested tasks, cost and diff size stayed about the same.

Verification

  • Claude Code, Opus 5.5, /pstack:poteto-mode <bug report>, hidden graders: a race-condition task went from 5/9 to 9/9 runs that fix every site. An HTML-escaping task stayed at 3/3, and SWE-rebench python-scim__scim2-models-126 stayed at 4/4.
  • Tasks, graders, results and the failure quote: https://gist.github.com/rutkowskij/83bcf0dca0c925c83ff9f20ca66168ea
  • CI steps pass locally: validate-plugins.mjs and generate-pstack-harness-trees.mjs --check. In the script tests, only the statechart symlink test fails, and it fails the same way on main with Node 26.

When a report names one symptom, the agent often finds the same fault at
other sites and leaves it out to keep the change narrow. The playbook now
says those sites are part of the fix. The Claude Code tree is regenerated.
@rutkowskij

Copy link
Copy Markdown
Owner Author

Superseded by cursor#1237.

@rutkowskij rutkowskij closed this Nov 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant