Conversation
4 tasks
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Bounded inventory only. This PR adds one research document that maps the three paper tracks (OpMem, vertical packs, conviction/stop-loss), pins the current Brainy benchmark protocol, maps every live claim to code/data/artifact/SHA, explains why drafts #185 / #186 / #187 stay open, and lists the smallest next experiments with call/cost/runtime estimates.
No benchmark was run. No provider credits were spent. No scores, README percents, or cycle-closeout numbers changed. Anti-benchmax and the independently verifiable 90% LoCoMo / 80% LME / 13/13 / 17/17 goal are preserved as gates, not claims.
Changes
docs/research/inventory-reproduction-plan-2026-09-18.md— the inventory (papers, protocol, claim map, PR relationship, costed next experiments, reproduce commands marked do-not-run).docs/research/README.md— index row (labeled not a pin).docs/research/paper-topics.md— pointer to the inventory.Test plan
origin/dev@bbe55f7plus read-only GitHub state of docs: n=1540 product-recall handoff for next-cycle planning #185/Eval-protocol-v2 staged runner and worker slot keep-alive #186/S5: versioned RRF retrieval for search and /recall #187.bbe55f7) then E2 (new-tenant S0 180) as the next measurement sequence — or reject.Linear / tracking
Paper roadmap: paper-topics.md. Related Linear still open: ENG-76 (finance pack), ENG-86 (supersession; API exists, OpMem still uses
/correct), ENG-78 (finance goldens). No new Linear id.Risk / follow-ups
bbe55f7. Public 11.4% / 21/30 / 4/20 remain on1b5ab3e. UnifiedResult JSON for those runs is gitignored.current_database(); land Eval-protocol-v2 staged runner and worker slot keep-alive #186 first if merging.