Are the second Consumer's acceptance criteria machine-usable, and is its test data resettable? #546

Activity

1. orioltf

   added

   app:unic-archon-dlc

   wayfinder:researchWayfinder ticket: investigate against primary sourcesWayfinder ticket: investigate against primary sources

   on Sep 23, 2026
2. orioltf

   added a parent issue on Sep 23, 2026

   • wayfinder: e2e specs from acceptance criteria, at a second Consumer #538
3. orioltf

   self-assigned this

   on Sep 23, 2026
4. orioltf commented on Sep 23, 2026

   

   orioltf

   on Sep 23, 2026

   MemberAuthor

   More actions

   Findings, 2026-09-23

   Acceptance criteria: mostly machine-usable, but not where the ticket is.

   • Tickets sampled: 17 (14 user stories, 2 test cases, 1 task).
   • User stories that carry acceptance criteria in the ticket body: 0 of 14.
   • User stories that link a separate specification page instead: 13 of 14. One has an empty body. One link points at the wrong page.
   • Specification pages read: 9. Numbered criteria on them: 116.

   Judgement	Criteria	Share
   Clear end-to-end pass condition	65	56%
   Testable after a decision or a fixture	25	22%
   No end-to-end pass condition	26	22%

   • Criteria carry stable per-row IDs: yes.
   • Criteria that contradict another criterion on the same page: 2.
   • Steps of the test-case tickets: unmeasured. They live in a tracker add-on, not in the field that was read.

   Test data: not resettable today.

   • Setup and teardown projects wired into the suite: yes.
   • Setup that creates data: no. The file holds comments only.
   • Teardown that deletes or restores data: no. The file holds comments only.
   • Any seeding or reset route in the suite: no.
   • The Consumer has an open ticket for stable, nightly-reset test data: yes. Not started.

   Detail in the seat's notes, outside git.
5. orioltf

   closed this as completedon Sep 23, 2026