Repository navigation
fix(pstack): make the bug-fix playbook fix every site of the same fault - #1
Closed
rutkowskij wants to merge 1 commit into
Closed
rutkowskij wants to merge 1 commit into
rutkowskij wants to merge 1 commit into
Conversation
When a report names one symptom, the agent often finds the same fault at other sites and leaves it out to keep the change narrow. The playbook now says those sites are part of the fix. The Claude Code tree is regenerated.
Owner
Author
|
Superseded by cursor#1237. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
When a bug report names one symptom, the agent often finds the same fault at other sites and leaves them out on purpose. It lists them in the reply and offers to fix them later.
principle-fix-root-causesalready says to fix every site, but the agent seldom opens it during a bug fix. The agent read the bug-fix playbook in 31 of 32 test runs, so the rule goes there.What changed
poteto-mode/playbooks/bug-fix.mdline 5 gets one sentence: "The same fault at sites the report did not name is part of the fix: fix them all, not only the reported one."Scope
grok-4.7-mediummostly did not finish inside 15 minutes, so there is no Cursor result.Blast Radius
Every poteto-mode bug fix. A fix can now cover more sites than the report names. On the tested tasks, cost and diff size stayed about the same.
Verification
/pstack:poteto-mode <bug report>, hidden graders: a race-condition task went from 5/9 to 9/9 runs that fix every site. An HTML-escaping task stayed at 3/3, and SWE-rebenchpython-scim__scim2-models-126stayed at 4/4.validate-plugins.mjsandgenerate-pstack-harness-trees.mjs --check. In the script tests, only the statechart symlink test fails, and it fails the same way on main with Node 26.