Conversation
Add docs/research/opmem/PUBLICATION_READINESS.md with reproducible protocol, claims/evidence table, independent 13/13 vs 10/13 review, missing work, threats to validity, artifact instructions, manuscript outline, and PR #185-#187 overlap map. Fix provably stale 12-task wording in opmem-spec, public-bench-ladder, mem0-parity-gaps, and master-plan; banner July opmem post as pre-upd03. Co-authored-by: aria <aria@engramhq.com>
3 tasks
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
OpMem-first publication package built only from existing repo evidence. No benchmarks were run and no provider spend. The goal is to state clearly what is ready for a Paper 1 submission versus what is still missing, and to align normative docs with the live 13-task suite (
upd03).Independent static review confirms the frozen 2026-08-15 pin: Brainy 13/13 and Mem0 Platform 10/13 are supported by markdown artifacts and Brainy per-task JSON; we do not claim re-validation on current
bbe55f7or inflate Platform numbers as OSS-reproducible.Changes
docs/research/opmem/PUBLICATION_READINESS.md— full package:docs/research/opmem/README.md— index and pin summarydocs/research/opmem-spec.md— taxonomy includesupd03, 13 tasksdocs/research/public-bench-ladder.md— L0 OpMem row → 13/13 vs 10/13docs/research/mem0-parity-gaps.md— executive OpMem rowdocs/research/master-plan.md— §1.1 OpMem rowdocs/research/posts/2026-07-opmem-v0.md— supersession banner (July 12/12 numbers preserved as historical)Intentionally not rewritten: dated artifacts (
opmem-baseline-report.md,opmem-staging-vs-mem0.json,launch-narrative.md, etc.) remain historical 12-task records.No product code changes.
Test plan
find fixtures/opmem -name '*.json' | wc -l→ 13opmem-spec.mdno longer saysv0: 12 tasksgo test ./...— not required (docs-only)bbe55f7— explicitly out of scope (no spend)Linear / tracking
OpMem Paper 1 track (paper-topics.md). Inventory cross-ref: PR #188 (
inventory-reproduction-plan-2026-09-18.md).Risk / follow-ups
bbe55f7re-measure.run_opmem.pyexits 0 on task failures; documented as a threat.mainwithout explicit approval (staging =devonly).Ready vs missing (from package)
RunManifest/ frozen multi-system JSON in gitbbe55f7re-pin