Skip to content

Introduction paper: reconcile sources and integrate scoped theorem recoveries - #918

Closed
amaybaum wants to merge 110 commits into
mainfrom
draft/oi-introductory-paper-20261025
Closed

amaybaum wants to merge 110 commits into
mainfrom
draft/oi-introductory-paper-20261025

Conversation

@amaybaum

@amaybaum amaybaum commented Oct 25, 2026 •

Copy link
Copy Markdown
Owner

This is the guiding draft PR for the Introduction paper and the controlled replacement of the Explainer. The Introduction is the primary short-form scientific entry point to Observational Incompleteness; it does not replace the technical papers or their proofs.

The canonical r32 manuscript and its reconciled source/evidence are pushed on 2026-10-28. This remains a draft; no release, retirement or merge is authorized.

Publication structure and document map

The owner's publication decision of 2026-10-26 remains in force. The table now includes all seven core papers identified in the repository README, rather than treating Main as the entire technical corpus.

Document Role
Introduction — papers/Introduction.md Self-contained entry point for physicists and researchers: the idea, established results, explanatory examples, bounded applications, and unresolved questions. Directs readers to the relevant technical source, not only Main.
Main — papers/Main.md Finite embedded observers; the finite-horizon stochastic/reversible/fixed-basis correspondence; hidden-memory, capacity and recurrence results, with their exact hypotheses.
SM — papers/SM.md The simple-cubic branch, lattice and representation results, and the Standard-Model programme and phenomenology, distinguishing established mathematics from named physical bridge assumptions.
GR — papers/GR.md The gravitational, cosmological-horizon and dark-sector programme, including the black-hole-information discussion; conditional results and unresolved field-equation/physical bridges remain explicit.
Substratum — papers/Substratum.md Reconstruction and substratum gauge structure. Converse/existence/uniqueness claims retain their proved scope; Bell-compatible completion carries H-Bell where required.
Structure — papers/Structure.md Observation and gauge hierarchies, universality classes of embedded observers, and comparisons with other unification programmes.
Methodology — papers/Methodology.md Developmental draft on the framework's foundations, methodology and axiom structure. Its inclusion is not certification of every claim it contains.
Juno — papers/Juno.md Focused solar-mixing phenomenology and its distinction between retrodiction and a forward empirical test.
Book — book/ Comprehensive exposition, interpretation and broader implications, including technical material in chapters and appendices; maintained chapters and FULL mirrors must stay consistent.
Explainer — papers/Explainer.md Legacy overview to be superseded through the reviewed replacement/retirement procedure below, with its content and history preserved. This description does not perform that retirement.
Verification corpus — verification/ Supporting Lean kernels, Mathlib developments, exact/numerical probes, coverage ledger and retained evidence. This is the evidence layer, not an additional physics paper.

Main is not the complete proof corpus. Proofs and qualifications also occur in the companion papers, book appendices, Lean modules and verification records. Claim status follows the actual argument and its dependencies, not the prominence of a document. The Introduction must preserve those distinctions and must not present a conditional bridge, finite test or conjecture as an unconditional theorem. Exploratory non-core applications do not become evidence for the core merely by being included elsewhere in the repository.

Paper scope

The paper explains the central idea, finite-horizon correspondence and memory results; separates a fixed-readout representation from full operational quantum mechanics; uses the card examples within their mathematical scope; and discusses the cosmological constant and black-hole information as bounded applications with explicit open assumptions.

It must neither inherit unsupported Explainer claims nor present known results as novel. Technical arguments are attributed to their actual sources across the core corpus.

The original 12–15-page planning target is historical. The current canonical r32 build is 24 pages; no scientific or readability gate is waived.

Integrated r32 checkpoint — 2026-10-28

Current head: fa32b043ee1bc23fd78924c5c1c884b9918d2242. Checkpoint: fde5cbbe2ec21a1b66ccce3465dafbd5e0194f59, exact tree fe56adf4146910b4d5d62fa040e6928e2f8ef2e8. The draft branch advanced normally without force. Its first parent preserves historical Introduction head 9dc2b069; its second parent is the published integration checkpoint f2a104fb. Main, held #982 and all prior checkpoints are unchanged.

Canonical builds: Introduction 24 pages, GR 90 and book 548, with zero dropped glyphs and matching source stamps. All six inherited Introduction formal statements and proof grades are unchanged. Original Introduction audit/reproduction records remain intact.

Independent scoped source review: ACCEPT. Fresh r32-v2 reader gate: MET, all twelve graded items PASS. Complete answers, prospective protocol/questions, input identities and independent evaluation are retained in reader-v2-results.`` The earlier v1 NOT MET remains preserved; its Q9 omission was not supplemented or reinterpreted. Q1–Q9 criteria and the all-PASS threshold remain unchanged; v2 Q10 was fixed prospectively for the newly accepted whole-future result.

Integrated exact-head verification 40735421405 PASSED on fde5cbbe: all 25 executed jobs succeeded and one optional job was skipped. Mathlib Build, Release gate, Lean kernel, core probes and retained KTOKEN checks passed. Its PR checkout tree exactly matches the reviewed content tree. The dedicated coherent-entropy replay 40735421543 also passed. Scoped source and comprehension acceptance plus green integrated CI do not authorize release or merge.

The candidate includes:

  • Actual-trajectory finite-block memory bounds and a genuine supremum over all natural time/horizon pairs.
  • A separate exact finite-image entire-future random variable, with ordinary discrete Shannon information in bits, whole-future capacity and its genuine time supremum. Equality of the two suprema and a separate infinite-product/limit entropy interpretation are not certified.
  • Nonempty record-fibre identification and finite-period/rooted recurrence cores, while full P24.5 Bayesian/stabilization and Main history implications retain their separate scope.
  • Written finite coherent-entropy and clocked-release examples, SC-36's configuration-state Page obstruction and definite-D premise, and the restricted book ancillary/regress correction. Physical evaporation, scrambling, full gauge reconstruction and ontological regress termination are not established.
Separate recovery/correction Exact-head verification
#990 finite trajectory/C3, a958bc54 Passed
#991 identification/recurrence, bd05018f Passed
#993 finite-image whole future, 96a3020b Passed
#989 finite coherent entropy/release, ce978ce5 Passed, including dedicated replay
#992 book regress correction, a2be1e45 Passed

Each normal verification run has 25 executed jobs passing and one optional skip. The integrated registry ordering was independently repaired before this push: every family object is unchanged, and KTOKEN is last as required by its retained controls. Earlier unaccepted checkpoints remain in history.

Source maps, bounds, exclusions and reproducible controls are under verification/audits/manuscript/introductory-paper-20261025/r32-integration/ and the linked recovery directories. #946 unit closure, stacked-source acceptance, final exact-head release review and owner merge approval remain separate. No main merge, Explainer retirement, native F/E designation or special launch occurred.

Scientific-consistency and source-correction gate

Parallel work is authorized; automatic merging is not. Preserve the agreed sequence—#918 before the pending #961–#964 source-correction merges, subject to their actual dependencies—and reconcile/reverify any changed head before requesting approval.

Remaining landing requirements

  1. Record independent scientific, editorial and comprehension verdicts on the applicable paper revision. Preserve the historical run 6 and run 7 criteria and verdicts. Version the protocol for any P24.5-corrected revision prospectively and use a fresh blind reader; do not infer new-revision acceptance from the historical run 7 pass.
  2. Complete the applicable full-corpus audit/source-correction reconciliation under Audit: the Introduction against the full core OI corpus (gate for #918) #942/Source-correction gate: every substantive audit finding gets a source fix or a recorded no-change reason #946. Preserve claim-to-proof provenance and every load-bearing hypothesis.
  3. Reconcile with main and verify the resulting diff; recheck exact Lean names/references, coverage and retained axiom evidence at the landing head. Complete the required build, manuscript/mirror checks and CI; do not substitute an old run for the actual landing evidence.
  4. Present the reconciled exact SHA and its evidence to the owner for explicit merge approval.

The PR remains a draft. No merge is authorized by this description.

Controlled Explainer replacement

  • Preserve the Explainer's content and history; audit unique material and migrate what is essential to the Introduction, the appropriate technical paper or the book. Do not preserve redundant material merely for completeness.
  • Perform the actual archival move, superseded notice and link/index/build-tool updates only through the reviewed retirement procedure after acceptance of the replacement.
  • Preserve historical receipts and reproduction paths; update active references without rewriting historical evidence.
  • Drafting the paper, migration audit and retirement plan is authorized here. Actual retirement and final publication remain gated; they have not been performed merely by updating this PR description.

Original PR created via Claude Code: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb. Subsequent checkpoint records and review provenance are retained in the branch and PR conversation.


Generated by Claude Code

Adds verification/audits/manuscript/introductory-paper-20261025/PLAN.md:
the scope of three preliminary audits for a proposed short introduction to
Observational Incompleteness (planning scope, novelty and fidelity of the
central correspondence and the black-hole application, and the Explainer's
unique content). No paper, Explainer replacement or manuscript edit.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
Adds to verification/audits/manuscript/introductory-paper-20261025/:
- NOVELTY-AUDIT.md, the novelty and fidelity audit of the central
  correspondence and the black-hole application (unreviewed; its
  conclusions are provisional until independently reviewed; references
  not read in full are tagged);
- EXPLAINER-AUDIT.md, the audit of what replacing papers/Explainer.md
  would lose, with its two search scripts in explainer-tools/;
- README.md, stating each record's status, the findings carried forward
  for separate work, and the open decisions;
- SHA256SUMS.

EXPLAINER-AUDIT.md has three scratch-directory paths replaced by relative
descriptions; nothing else differs. sha256 of the auditor's report
f2fedace546787037101196ebf4fd7152a7f84e00b28d857083a69c351a57685, retained
copy f74dba57729443d653cbfda464e66caeec3f0ef9b1143df6a660498a44dc04eb.
NOVELTY-AUDIT.md is byte-identical to the auditor's report
(9f8a0ef3ec7d1e62bf671dd38c82500ad5857ba375924a96fe35d531f51fcf3c).
No manuscript change.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
…paper records

Addresses the focused review of 96b2a75. Each audit file now opens with a
status block (unreviewed; no verdict in it is an established result; its
relation to the auditor's report, with that report's sha256), so a reader
reaching it directly sees its status. README.md states that #917 was read
at 809fac5 (not on main), attributes the Equivalence.lean docstring to the
class RevReal, records two errata in EXPLAINER-AUDIT.md (its tools/ paths
mean explainer-tools/; the Explainer has 41 displays, not 42), gives the
scripts' expected argument, and lists the unresolved literature and scope
questions. SHA256SUMS is regenerated.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
…0 columns

The README now records that C8's C4 step is argued in prose and names the
fidelity notes F3-F8 (Main.md) and F9 (ch07 §7.6). Both status blocks are
re-wrapped; NOVELTY-AUDIT.md below its block stays byte-identical to the
auditor's report. SHA256SUMS regenerated.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
…dence record

Adds novelty-v5/ to the introductory-paper audit records:
- AUDIT.md (r3), AUDIT-r2.md, AUDIT-r1.md, CHANGES.md, CHANGES-r1.md,
  byte-identical to the reviewed and written objects;
- review/REVIEW.md (independent review of r1: BLOCK, wording only) and
  review/RECHECK-r2.md (re-check of r2: ACCEPT WITH NITS);
- README.md: status, path mapping, what is not retained, and the stated
  source-coverage limits, attribution corrections and manuscript defects.

r3 applies the re-check's eight nits and changes no classification.
SHA256SUMS and the directory README gain the new entries. No manuscript
is changed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
…e2db4)

r4 re-bases the site references and fidelity notes to main 52e2db4
(after #925-#928, #916 and #930), records each fidelity note as fixed,
changed or open with its fixing commit, adds F28 (fixed by #930) and the
candidate F29, and applies first-hand full-text reading: the XOR example
is known (RHP 2014 Eq. 15), C3 has full-text support, the divisibility
credit is RHP 2014 Thm 2.4, C4 and C5 stay partly verified, and C8-R
stays a candidate with no priority sentence. Unread primary texts are
listed with the reason each was not read. Correctness and originality
are recorded separately.

Retained: AUDIT-r3.md (byte-identical to the committed r3),
AUDIT-r4-prerecheck.md (the object the re-check read) and
review/RECHECK-r4.md (ACCEPT WITH NITS; its R1, R2 and nits applied).
The parent README's carried-forward findings are updated to their
current status. No PDFs or extractions are committed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
@amaybaum amaybaum changed the title WIP: introductory paper — preliminary audits WIP: Introduction paper and Explainer replacement Oct 26, 2026
… audit re-verification

Owner decision 2026-10-26: the Introduction paper replaces the Explainer as the
primary short-form presentation (Introduction -> Main -> Book); the Explainer is
retired, preserved for provenance, only after the Introduction passes
independent scientific and editorial review.

- design/: the outline, contribution statement and claim register for the
  Introduction paper at main 687e885, through four revisions with their
  independent reviews (r1 ACCEPT WITH CHANGES; r2 and r3 BLOCK on wording;
  r4 ACCEPT), the change notes, and exact scratch probes of the worked
  examples and the card-table game.
- explainer-review/: the independent re-verification of EXPLAINER-AUDIT.md at
  687e885 (HOLDS WITH CORRECTIONS), with the reviewer's helper scripts and
  their outputs at both commits.
- README.md: records the owner decision, the open owner decisions, the new
  records, and that novelty-v5 r4 was re-checked (ACCEPT WITH NITS).

No paper text and no manuscript change. The release-gate CI log cited as
provenance is identified by digest, not committed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb

Copy link
Copy Markdown
Owner Author

Owner decisions on the Explainer retirement (2026-10-26).

The retirement strategy is approved, conditional on independent review and acceptance of the Introduction paper.

Item Decision
Migration audit Accepted provisionally, pending independent review.
Content to transfer None required, subject to review.
Move to papers/legacy/Explainer.md Approved, after the Introduction is accepted.
Superseded notice Required.
Main.md:66 Noether reference Redirected to Substratum §6.2.
Retirement PR One PR with two commits: (1) add the accepted Introduction; (2) the single retirement commit.

Additional safeguards:

  1. Historical reproducibility. Moving the file must not break the reproduction of earlier certified results. The CI probe, census, coverage ledger, build scripts and references are updated without silently changing historical evidence. Where an old path is part of an immutable receipt, that historical reference is preserved, not rewritten.
  2. External access. A minimal papers/Explainer.md redirect notice stays, pointing to the Introduction and to the archived document, provided it can be excluded from active manuscript checks.

Publication structure:

  • Introduction: the accessible scientific entry point, understandable on its own, which directs readers to Main for the complete technical arguments.
  • Main: the formal framework and proofs.
  • Book: the comprehensive interpretation and applications.

Next milestone. Complete the migration review and the Introduction draft's scientific review before any retirement change. Both are in progress.

The final retirement merge stays conditional on those reviews and on the repository's governance checks.


Generated by Claude Code

The first full draft of the Introduction paper from outline r4, kept in the
audit directory (not papers/) until it passes independent scientific and
editorial review. Owner markers flag pending decisions (title; three
black-hole passages conflicting with live ch07/GR text; Lean-check retention);
verify markers flag bibliography entries to check. DRAFT-NOTES records one
correction to the reviewed r4 card-table clause (Main:702's no-classical-memory
result is for an initialized hidden slot, not the uniform burn card), with its
numerical check in probe/swap_memory.py; the correction awaits review.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
…t's independent reviews

- retirement/: the content-migration audit and retirement plan, r1-r3, with the
  independent review (ACCEPT WITH CHANGES) and re-check (ACCEPT WITH NITS). No
  Explainer content needs migrating; Main.md:66 is repointed to Substratum
  §6.2. After the Introduction's acceptance, one PR with two commits moves the
  Explainer to papers/legacy/ with a superseded notice and a redirect stub at
  the old path, and makes every dependent change together. No receipt, seal,
  certificate or record is rewritten. The owner approved the strategy on
  2026-10-26, conditional on the Introduction's review and acceptance.
- draft/review/: the independent scientific review (ACCEPT WITH CHANGES; it
  confirms the draft's correction of the r4 card-table clause by an exact
  check) and editorial review (ACCEPT WITH CHANGES) of the Introduction draft
  r1, with their probes.

The absolute scratch prefix in four records is written S (noted in the
READMEs). Reviewer copies of repository tools and dry-run trees are not kept.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
… erratum to design r4

- draft/Introduction-r2.md: applies both independent reviews of r1 (every
  required change; conflicts resolved with science governing content and the
  editorial review governing presentation, recorded in CHANGES-r2.md). 15
  pages in the repository's default build, no dropped glyphs; voice_check and
  claims_check pass. Owner markers record the open decisions; the paper does
  not land while any R11 site is uncorrected or the §A.42 expected result is
  not retained. r1 is kept unchanged.
- design/ERRATUM-r4.md: corrects the r4 card-table clause "admits no
  classical-memory decomposition (Main:702)", which holds only for the
  initialized-slot swap; the reviewed r4 files are kept as they were.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
… duplicate checks

CI on c1ce96e (run 40305833333) failed in the Mathlib bridge job's release
gate. claims_check flagged the countercontrol phrase `qm requires oi`, quoted
in RETIREMENT r1-r3 §4.1(4)(ii) and in the plan re-check, as an unqualified OI
necessity assertion. duplicate_check flagged two identical "### Confirmed"
headings in the plan review.

Each flagged paragraph now says the phrase is a reading the R7-OINN guard
forbids, because only core containment is proved. The two headings now name
their sections. Nothing else in the records changes. claims_check,
duplicate_check and voice_check pass locally, and SHA256SUMS is refreshed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
… erratum nits

- draft/review/: the scientific re-check of r2 (BLOCK, narrow: four required
  replacements) and the editorial re-check (ACCEPT WITH NITS).
- draft/Introduction-r3.md and CHANGES-r3.md:
  - R2-1 to R2-4 applied verbatim:
    - the Bell item states the framework's adopted branch, not a necessity;
    - the finite-carrier obstruction gives the imported unboundedness premise
      before its conclusion;
    - the decoupling paragraph keeps the scope limit on GR Thm A.7;
    - two steps are labelled "not machine-checked" rather than "proved on
      paper".
  - The reviewers' nits are applied; CHANGES-r3 records each departure from a
    suggested text with its reason.
  - The owner decisions of 2026-10-26:
    - the title;
    - Contributions as exposition, claiming no new theorem or physical result;
    - two raw LaTeX lines that change layout only;
    - D1-D3 handled conservatively.
  - The build is 15 pages, with no overfull boxes and no dropped glyphs.
  - R11, the §A.42 retention marker and five VERIFY markers still gate
    landing. r2 is kept unchanged.
- design/ERRATUM-r4.md: E1-E4. The quoted SOURCES text is exact, the
  citations are restored, and the reason given is the range of J(Phi_1). The
  Pauli-twirl identity carries the claim, and the probe is cited as provenance.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
- draft/review/: the scientific re-check of r3 (ACCEPT WITH NITS) and the
  editorial re-check (ACCEPT WITH NITS).
  - The scientific re-check confirms the departure from its own suggested N2
    text: no step from history-level (C4) to routed readback is proved.
  - The editorial re-check records two things. First, the census tool checks
    only `(kernel: …)` parentheticals, so it covers nothing in this paper.
    Second, the 28 Lean identifiers and the Appendix A line numbers were
    checked directly.
- draft/Introduction-r4.md and CHANGES-r4.md:
  - "the lattice" becomes "the substratum's spatial coupling graph".
  - [BHa] and [BHb] are marked as unpublished, internally reviewed research
    records.
  - The Contributions paragraph says the black-hole results of §5 come from
    unpublished repository computations whose novelty has not been
    established.
  - §6.5 item 4 states which results are proved and which are computed.
  - The code recipe is inline.
  - 16 pages: §1-§7 end on p. 12. No overfull boxes and no dropped glyphs.
  - The title hyphenation is left for the owner. r3 is unchanged.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
…TS, nits optional)

The scientific re-check confirms the eight changed lines and the N3 wording.
The editorial re-check confirms the build: 16 pages, with the narrative ending
on p. 12, no overfull boxes and no dropped glyphs. It records layout-only
options for the final pass. README lists the remaining landing gates.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
…ions audit (WIP, under review)

The owner widened the paper's scope on 2026-10-26, organizing it around three
questions: what OI is, what it might explain, and what remains to be proved.
About four pages go to "Applications and Potential Resolutions".

- design/applications-audit/: a read-only audit of each candidate application
  against main 687e885, with its checks.
  - The Bekenstein-Hawking 1/4 is fixed by calibrating two normalizations, for
    every mode density, so it is presented as consistency and not prediction
    (quarter.py).
  - The cosmological-constant proposal is conditional on the open covariant
    field equations, and the 10^122 ratio against the de Sitter entropy is a
    dimensional identity (cc.py).
  - The Cabibbo closed form is a postdiction with selection (git dating, and
    the look-elsewhere count in lookelse.py).
- design/OUTLINE-r5.md, CLAIMS-r5.md, CHANGES-r5.md, DEPENDENCIES-r5.md:
  - the section plan, about 13.2 main-text pages, 4.0 of them applications;
  - a register of every claim beyond r4, with status, source, verification
    layer and dating;
  - the change map from r4: Theorems 1-4 carried verbatim, with hypotheses
    and references;
  - the corpus overclaims r5 does not lean on.

No paper text changes. r4 stays the accepted baseline.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb
…w and audit corrections

- design/review/r5/: the independent review of the r5 design (ACCEPT WITH
  CHANGES: 19 wording changes, structure confirmed) and its checks.
- design/applications-audit/CORRECTIONS.md: the four audit errors the review
  found (look-elsewhere count, a line reference, a split quotation, the JUNO
  dating). AUDIT.md is kept as reviewed.
- design/OUTLINE-r6.md, CLAIMS-r6.md, CHANGES-r6.md, DEPENDENCIES-r6.md.
  These follow the owner's narrowing of 2026-10-26:
  - quantum emergence is the central thesis, with two applications: the
    cosmological constant and black-hole information (preservation versus
    accessible recovery);
  - all other applications are removed;
  - about 10.4 main-text pages, with 2.65 for the applications;
  - neither application is presented as a demonstrated resolution;
  - derivations are cited, not re-derived. A results register gives each
    result's exact statement, status and layer, reference, and a witness for
    each direction of an equivalence.
  The r5-review changes on retained content are applied; the rest are moot.

No paper text changes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013T6pfKuv5mi3MXtKjH2tZb

amaybaum commented Nov 5, 2026

Copy link
Copy Markdown
Owner Author

Owner decision (amaybaum, Claude Code session chat, 2026-11-05, after c.6655356740; quoted here under §A.42 item 7):

I choose (b) for #918: restore the original "REST API" wording and correct the SC-42 checker rather than changing valid wording to satisfy the checker.

Restore the original "REST API" wording at README:105. Approve the narrowly scoped SC-42 checker modification adding REST to CAPS_OK. Requirements: Do not weaken unrelated SC-42 controls. Confirm that existing negative controls still fail as intended. Document why REST is a legitimate abbreviation rather than a scientific wording defect. Independently review the checker modification. Preserve the previously reviewed Introduction corrections.

Remaining landing steps are authorized in sequence: 1. Start from the preserved branch at 719af26b. 2. Apply the approved README and checker corrections. 3. Rebuild the Introduction and verify 25 pages with no dropped glyphs. 4. Regenerate the specified L120 ledger fingerprint. 5. Merge current main into the landing branch without rewriting the preserved commits. 6. Run the local checks, including SC-42. 7. Push and open a draft PR. 8. Obtain independent review of the exact revised head, including the checker change and manuscript corrections. 9. Allow normal PR CI to run and verify its results. 10. Present the final reviewed SHA, CI evidence and mergeability for my separate merge decision.

Any manual workflow dispatch still requires separate approval of its exact inputs. No merge is authorized yet.

The owner also verified that the preservation branch was at 719af26b3cd9e07c69194cf272c3e8b0ec95b39b.

Steps 1–7 are done. Draft PR #1124, head ba92a6cc.

  • The checker change touches only CAPS_OK, with a comment documenting REST.
  • The paper_caps negative control still fails its mutant, and all 9 controls pass.
  • The SC-42 result and controls files differ from main only in checker_sha256.
  • Build: 25 pages, 0 dropped glyphs.
  • L120 regenerated: C-unnamed-b596be8a → C-unnamed-99fe05c0, fingerprint 99fe05c0d24d20c3.
  • main 4b4b437c merged in, with 40fc5954 and 719af26b preserved.

Step 8 (independent review of ba92a6cc) and step 9 (PR CI) are in progress.


Generated by Claude Code

amaybaum commented Nov 5, 2026

Copy link
Copy Markdown
Owner Author

Owner merge approval for the Introduction landing #1124 (amaybaum, Claude Code session chat, 2026-11-05; quoted under §A.42 item 7):

Approve merging #1124 at ba92a6cc, subject to a final verification that: Its exact head is still ba92a6cc. Independent review and required CI checks remain satisfactory. The approved Introduction corrections and SC-42 REST exception are preserved. The merge introduces no unreviewed content changes. Verify the merge and subsequent main CI.

Pre-merge verification:


Generated by Claude Code

amaybaum added a commit that referenced this pull request Nov 5, 2026
… SC-42 REST allowance)

Owner-approved merge of the reviewed head ba92a6c (review #1124 c.6655788106; PR CI run 42010587847 green; approval quoted on #918 c.6656173399).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011zDyUSyEszk3JJx83uXKKq

amaybaum commented Nov 5, 2026

Copy link
Copy Markdown
Owner Author

Owner decisions (amaybaum, Claude Code session chat, 2026-11-05; quoted under §A.42 item 7):

#1127 — Merge approved. I accept the independent delta review's ACCEPT verdict at 6f4073b89e4be7583b033d883faec9e65117da2f. Authorize marking PR #1127 ready and merging it with a normal merge commit, provided: The head remains exactly 6f4073b8. main remains at 5e35eb88 before merging. Exact-head CI remains green. The net diff remains limited to README.md, build.sh and .zenodo.json. Both approved wording corrections remain intact. After merging, verify the merged tree, run or check main CI, confirm the 303 legacy records remain intact, and post the merge record.

#1128 — Integration preparation approved. After #1127 merges and main CI passes: 1. Merge current main into #1128. 2. Verify that the scientific text and claims remain unchanged. 3. Confirm the YAML header preserves the Pandoc metadata. 4. Check the rebuilt artifacts and the six shifted ledger line references. 5. Obtain the scoped independent review. 6. Run CI on the exact integrated head. Present the resulting SHA for separate merge approval.

#918 — Closure assessment. After the documentation and formatting work is reconciled, prepare a final closure checklist for #918. Distinguish: Completed Introduction obligations. Remaining obligations with durable homes in other Issues. Any unresolved blocker that genuinely prevents closing #918. Do not close #918 automatically. Bring me the final disposition recommendation.

Pre-merge verification for #1127:


Generated by Claude Code

amaybaum added a commit that referenced this pull request Nov 5, 2026
…o description, correspondence diagram)

Owner-approved merge of the reviewed head 6f4073b (review c.6656883592, delta check ACCEPT c.6657092310; PR CI run 42019670604 green; approval quoted on #918 c.6657303442).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011zDyUSyEszk3JJx83uXKKq

amaybaum commented Nov 5, 2026

Copy link
Copy Markdown
Owner Author

Owner decisions (amaybaum, Claude Code session chat, 2026-11-05; quoted under §A.42 item 7):

PR #1128 — Merge approved. Approve merging #1128, subject to final verification that: The head is still the exact independently reviewed and CI-green commit. The base has not changed in a way requiring further integration. The diff remains limited to the approved header-formatting changes, rebuilt artifacts and corresponding ledger line adjustments. No scientific statements or proof-status classifications have changed. Use a normal merge commit. Verify the merged tree, main CI and the 303 legacy records. Record the merge evidence.

Introduction rewrite — Separate PR. Approve preparing the rewrite in a new, independent draft PR based on the updated main after #1128 lands. For now, the authorization covers planning and drafting the proposal only: Complete the claim inventory. Prepare the six-part structure and word budget. Draft the sample opening. Identify formal-source and verification gaps. Document ledger, citation, workflow, README and Zenodo consequences. Present these for my review before authorizing the full manuscript rewrite.
Editorial decisions. Displayed theorems: Prefer plain-language statements in the main narrative. Retain formal equations only when they are essential to understanding the result. The finite-horizon equivalence may retain its compact mathematical expression. Lean inventory: Remove the detailed inventory from the Introduction. Preserve any necessary evidence in the appropriate formal paper or canonical verification record, with a short reference from the Introduction. Coverage ledger: Do not artificially preserve statement IDs or fingerprints when the underlying text changes. Record accurate supersession mappings and update the ledger according to repository rules. Main retitle: Keep this as a separate correction. The Introduction rewrite should cite the actual title on main at its drafting base and reconcile references if the retitle subsequently lands. Scientific scope: The rewrite must not strengthen existing claims, hide open assumptions or turn mathematical representability into physical equivalence. Simplifying a scientifically qualified statement does not require deleting its limitations. … Do not merge the rewrite, change formal papers or modify verification workflows without separate authorization. … I would optimize the Introduction for comprehension rather than a rigid word count.

Pre-merge verification for #1128:


Generated by Claude Code

amaybaum added a commit that referenced this pull request Nov 5, 2026
…g only)

Owner-approved merge of the reviewed head 4b11324 (review ACCEPT #1128 c.6657744673; PR CI run 42024143500 green; approval quoted on #918 c.6657998945). Header format and six ledger line fields only; no statement, id, fingerprint or status change.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011zDyUSyEszk3JJx83uXKKq

amaybaum commented Nov 5, 2026

Copy link
Copy Markdown
Owner Author

Proposal for owner review — not adopted: Introduction rewrite plan

Scope of this document. Planning only, under the owner's authorization of 2026-11-05 (#918 c.6657998945): claim inventory, six-part structure with word budgets, sample opening, formal-source and verification gaps, and the consequences for ledger, citations, workflows, README and Zenodo. No manuscript, formal paper, workflow or ledger file is changed; no branch or PR is opened.

Drafting base. main at 13ced581 (merge of #1128, the header-format correction). All line numbers below are papers/Introduction.md at that commit. All formal-source citations were checked against papers/Main.md, papers/GR.md, papers/Substratum.md and book/The-Incompleteness-of-Observation-FULL.md at the same commit.

Current size. Abstract 370 words; body §§1–6 12,378 words (§1 1,155; §2 5,689; §3 2,671; §4 667; §5 1,128; §6 1,018); "Code, data and formal verification" 193; Appendix A 410; References 1,074. Total file 14,449 words (wc -w, which counts LaTeX tokens).

The governing brief (owner, quoted)

  • The Introduction should explain the science; the formal papers establish and verify it. Current text ≈14,500 words, interrupted by theorem machinery, Lean declarations, proof qualifications, source checkpoints and computational details.
  • Audience: educated non-experts, no assumed QM, information theory or formal verification. Objective: significantly simpler, clearer, shorter, more engaging, preserving the exact scientific meaning and limitations.
  • Principles: intuition → result → why it matters; plain English, short paragraphs, concrete examples; notation only when it materially helps; keep the finite-horizon equivalence, hidden-memory results and the limits on deriving full QM central; distinguish mathematical representation from physical derivation; keep proved vs conditional vs open distinct; gravitational and black-hole applications as precisely scoped results or proposals, not established physical consequences where assumptions remain open.
  • Do not duplicate verification details: move/defer Lean declaration lists, proof machinery, computation descriptions, commit hashes, source checkpoints and verification tables to formal papers / canonical verification records; cite Main, GR, Substratum etc. where results are explained. Before removing technical details, verify each claim has an adequate supporting reference; if a formal paper lacks essential verification information, flag a separate correction rather than silently discarding evidence. Replace Appendix A's Lean inventory with a short technical-source guide, or remove it if references suffice.
  • Length target ≈3,000–4,500 words main narrative excluding references, subject to preserving essential qualifications. No weakening or exaggeration; no new physical assumptions or results; accurate attribution of earlier work (e.g. Egri et al.; Barandes; Shamir; others the current text cites).
  • Narrative arc: (1) The central question: could quantum randomness reflect incomplete observation? (2) The simple idea: a deterministic world can appear random to an observer who sees only part of it. (3) What the mathematics proves: finite-horizon correspondence, hidden memory, conditional recurrence results. (4) What it does not prove: full QM, Born-rule selection, physical availability of quantum operations. (5) Why it matters: carefully scoped implications for quantum foundations, cosmology and black-hole information. (6) What remains open: the physical mechanisms needed to turn mathematical representability into a complete theory.
  • Example of the desired register: "When observations contain information about the past that cannot be recovered from the present observation alone, a deterministic model reproducing those observations must retain the relevant information in its hidden state. The formal result also places a bound on how much memory the hidden state must carry [Main]."

Owner's editorial decisions (#918 c.6657998945), applied throughout: plain-language statements, formal equations only where essential, the finite-horizon equivalence may keep its compact form (S ⇔ D ⇔ Q_fb); the Lean inventory leaves the Introduction, with necessary evidence preserved in the appropriate formal paper or canonical verification record and gaps flagged; no artificial preservation of ledger ids or fingerprints, with accurate supersession mappings; cite Main's title as it stands on main (the #1028 retitle is reconciled later); no strengthening, no hidden assumptions, no turning representability into physical equivalence; comprehension over a rigid word count.


A. Claim inventory (summary; the full 84-row table is in the proposal file)

The full inventory (I-01 … I-84: claim, status as stated, verified formal source, fate, flag) is kept in the writer's proposal file and will accompany the rewrite PR. Summary of fates:

  • Keep in plain words (central): the card picture with its disclaimer (I-01–02); OI hypothesis, posits and representation choice (I-03–05); hidden ≠ unknowable (I-06); not the uncertainty principle (I-07); Theorem 1 and "possibility, not fact" (I-15–17, I-19, I-21, I-23); Born exponent not selected (I-22); Theorem 2, the Corollary (both directions), keeping-the-past ≠ memory, capacity bound (I-26, I-29–31); forecast chaining, Theorem 3, recurrence-cycle result with every hypothesis, late memory, XOR (I-38–39, I-41–45, I-48); limits on deriving QM: assumed kinematics, Theorem 4, OI alone ⇏ QM, failure of full reversible control, relating evolution, qubit obstruction, Bell trade-off and H-Bell (I-51, I-54–64); vacuum energy as two levels + conditional proposal + open G3 (I-65–70); black-hole conservation vs recovery and the Page obstruction (I-71–74); open problems (I-82).
  • Compress: turtles (I-08); realization datum (I-13); independent-prior realization (I-18); variational minimum (I-31); C1–C4 checklist (I-35); three notions (I-52); BH model description and further limits (I-72, I-75); [CE]/[CR] (I-76–77, owner Q5).
  • Move to source: Pinsker floor (I-32); proof-and-source paragraphs (I-37, I-46); six-hidden-state model (I-47); availability rules (I-55); trivial-ancilla quotient (I-61); Lean inventory and code/data section (I-83–84).
  • Drop: different-deck example (I-40, F-6); card-table Pauli-twirl classical-memory remark (I-53, F-5); "checked in Lean, not independently reviewed" list (I-80).
  • Flags: 10 separate-correction items (F-1–F-10), section D.

B. Proposed new structure

Title block (form of #1128) · Abstract · six numbered sections · "Where the details are" · References. Budgets are guides (owner: comprehension over word count).

§ Heading Purpose Claims Main citations Budget Example(s)
— Abstract the whole arc in plain words, limits included I-05, I-15, I-26/29/31, I-42, I-51, I-56–58, I-22, I-67–69, I-73/74 — 180–200 —
1 Could quantum randomness reflect incomplete observation? the question; the card picture with its disclaimer; three questions; what this paper is; status words I-01, I-02, I-10, I-11 Book §1.11 450 two-card swap
2 The simple idea: a hidden deterministic world can look random reversible rule, visible/hidden split, OI hypothesis and its posits; hidden ≠ unknowable; not the uncertainty principle; turtles; what a "pattern" and a "realization" are I-03–I-08, I-12, I-13 Main §1.2; Substratum Prop. 24.5, Thm 24(iii); Main §3.4 550 two readings identify both cards; turtles
3 What the mathematics proves 1,400
3.1 Every finite pattern has a hidden deterministic explanation Theorem 1 in words + compact S ⇔ D ⇔ Q_fb; possibility not fact; tape-and-clock construction; quantum side by permutation; Markov laws in all classes; periodicity limit; credit I-09, I-14–I-17, I-19–I-21, I-23 Main §3.4; [EGGH26; Bar23; Bar25; LP17; SGD19] 450 tape + clock
3.2 Memory must be stored out of sight Theorem 2 + Corollary in the owner's register; capacity bound; exact minimum; keeping the past ≠ memory; the four-item checklist; fair coin I-25, I-26, I-28–I-31, I-35, I-36 Main §1.3, §1.5, §3.4 500 card game; fair coin
3.3 Recurrence: forecasts that cannot be chained forecast chaining; Theorem 3 in words; recurrence-cycle result with its hypotheses (shared independent preparation; every start counted; full-support equivalence); late memory beyond accessible windows; XOR I-38, I-39, I-41–I-45, I-48, I-18 (one clause) Main §2.3, §3.4; [RHP14; BD16; Dou26] 450 weather; card game; $X_3=X_0$; XOR
4 What the mathematics does not prove 850
4.1 Representation is not derivation fixed measurement only; Born exponent not selected; relating evolution not selected; representation not explanation; three notions in one sentence I-22, I-51, I-52, I-54, I-61 Main §3.2, §3.4; [Bar26; Cal26] 250 permutation entries 0/1
4.2 What full quantum theory would need assumed matrix/tensor kinematics; five conditions (plain list); Theorem 4 in words; independence and "OI alone does not imply QM"; finite bijective dynamics fails full reversible control I-55–I-60 GR §3.3; [Sti55; Kra83; Oza84; Har01; CDP11; MM11] 350 coherence-free qubit theory
4.3 No fixed finite world reproduces a qubit factorization proved, unboundedness imported; per-pattern vs fixed world I-62 Main §3.4; [HKLP24; GH03; Mon08; Har04] 120 —
4.4 Bell correlations ceiling under stated assumptions; what OI keeps and gives up; H-Bell open I-50, I-63, I-64 Main §3.3; Substratum §3.2; [Bel64; CHSH69] 180 two laboratories
5 Why it matters 800
5.1 Quantum foundations no fixed-measurement record alone rules out a hidden deterministic account; the informative content is memory; conditional physical reading "if OI holds" I-24, I-81 (first clause), [tH14] Main §1.2, §3.4 150 —
5.2 The energy of empty space 120 orders; two levels (established); proposal conditional on field equations; missing link G3; related proposals I-65–I-70 GR §6.2, §6.3, §8.5; [Wei89; EvEMU11; KP14; Vol06] 300 —
5.3 Black-hole information: keeping versus showing conservation vs recovery; toy-model separation and floor with status; Page-curve obstruction; coherent finite example (scoped) I-71–I-74, I-76/77 (scoped or dropped) GR App. A.7–A.9; [BHa; BHb; CE; CR; HP07; Sha79; Haw76; Pag93b] 350 burned letter
6 What remains open the physical mechanisms between representability and a complete theory: kinematics and (iii)–(v); Born exponent and relating evolution; C4 at the cosmological partition and an experimental memory-witness test; gluing/approximation/mixing hypothesis; H-Bell; field equations (G3); physical coherent preparation, scrambling, proper shell, single-trajectory entropy, GSL, islands I-59, I-75, I-82 Main §1.3, §3.4, §4.5; GR §2.2, §3.3, §6.2, §8.5, App. A.6; Book §7.6; [Pen20; AEMM19; AMMZ20] 350 —
— Where the details are short technical-source guide (replaces Appendix A and "Code, data and formal verification") I-83, I-84 see below 120 —

Total ≈ 4,300–4,700 words with the abstract; ≈ 4,150–4,500 without.

Displayed mathematics kept: S ⇔ D ⇔ Q_fb (owner-permitted). Optional: the capacity inequality $M_t \le \log_2|\mathcal C_H|$ in words only; the field-equation display of §4 (owner Q1). No numbered Theorems, so no bold **Theorem** headers (consequence in D(i)).

Proposed "Where the details are" (replacement for Appendix A and the Code/data section):

Proofs of the results described here are in the formal papers: the finite-horizon correspondence, hidden memory and its bounds in [Main §§1.3, 1.5, 3.4]; recurrence and indivisibility in [Main §2.3]; memory, indivisibility and quantum non-Markovianity in [Main §3.2]; the Bell ceiling in [Main §3.3]; the operational characterization in [GR §3.3]; vacuum energy in [GR §6]; the Page-curve conditions in [GR, App. A]; identification from retained records in [Substratum, Prop. 24.5]. Where a statement is also checked in the Lean proof assistant, the formal paper names the checked declarations beside it; the repository's census of those declarations (verification/lean-manuscript-census.json) and its proof-coverage ledger (verification/coverage/LEDGER.json) record which manuscript statements each declaration supports. The black-hole computations [BHa; BHb] and their code are in verification/programmes/black-hole-information/, and the finite probes in papers/oi_lattice_code/foundations/, both under the MIT License.

(Whether [CE]/[CR] are cited, and how, depends on owner Q5; if kept, the references keep their "read at commit" form, since the files are not in main's tree.)

papers/introduction_repro/. The rewrite no longer states that a list of declarations was checked at 17b830bc, so the directory stops supporting any statement in the Introduction. Proposal: the rewrite PR does not touch it (removal or relocation of research evidence needs its own audit and owner authorization under §A.46 item 6; evidence-replay.yml reads it from pinned commits). A separate item (F-10) decides its disposition: (a) keep it in place as the record of the Introduction text it supported, with its README naming that commit; (b) relocate it under verification/audits/manuscript/ (§A.36); or (c) remove it after the §A.46 item 6 audit. Recommendation: (a) or (b), in a separate PR after the rewrite lands.

How the structure meets the owner's comprehension test. After §§1–2 a reader can say what OI proposes: observers are parts of a reversible, deterministic (and, as a posit, finite) world, and randomness is what partial access looks like. §3 says what has been proved, in three statements that can be repeated in one sentence each: every finite pattern of fixed-measurement records has a hidden deterministic explanation; memory in the records must be stored, with a minimum size, in the hidden part; and under a stated preparation assumption a finite reversible world forces forecasts that cannot be chained somewhere in its cycle. §4 is placed before the applications so that the reader meets the limits before any implication: the correspondence represents statistics and does not derive them; full quantum theory needs assumed matrix structure and five conditions OI does not supply; the operations a finite reversible world supplies, under the stated observer access, fail one of them; the Born exponent and the evolution between times are not selected. §5 then says why the results matter, each implication labelled as established, conditional or proposal. §6 names exactly what is missing before OI could claim to derive quantum mechanics. Each of these four things is stated in its own section, so a reader can find and restate it.


C. Sample rewritten opening

(The traceability list after the sample maps each sentence group to inventory ids; nothing below is new. Main's title is cited as it stands on main at the drafting base.)

# Observational Incompleteness: From Deterministic Dynamics to Quantum Observations

**Author:** Alex Maybaum  
**Date:** October 2026  
**Status:** DRAFT PRE-PRINT  
**Classification:** Theoretical Physics / Foundations

***

## Abstract

Could the randomness of quantum measurements come from the fact that observers see only part of a deterministic world? Observational incompleteness (OI) is the hypothesis that every observer is part of a reversible, deterministic world and registers only part of it; the models here also take that world to be finite, as a posit. Over any finite number of steps, every pattern of observations, including every record of a quantum system measured in the same way at each step, is produced exactly by some partly hidden deterministic world. The informative question is therefore what such worlds must contain: whenever a record has memory, the hidden part must store it and must be large enough to hold it. If the hidden part is prepared in the same way whatever is visible at the start, any visible step that is not fully predictable also makes the forecasts from the possible starts impossible to chain step by step somewhere in the world's cycle. These results represent quantum statistics; they do not derive quantum mechanics. Full quantum theory follows only from an assumed matrix structure together with five conditions that OI does not supply, and the quadratic form of quantum probabilities is not selected. Applications to the energy of empty space and to black-hole information are stated as scoped results and proposals.

## 1. Could quantum randomness reflect incomplete observation?

Quantum theory predicts the results of measurements only as probabilities. Whether that randomness belongs to nature, or shows that something is missing from the description, is one of the oldest questions about the theory. Einstein's objection is usually paraphrased as "God does not play dice."

This paper examines a different picture: God plays cards. A deck evolves by fixed rules and nothing in the rules is random, yet a player who sees only some of the cards finds the game uncertain. The picture is an analogy. It shows how hidden information, deterministic rules and random-looking observations fit together; it proves nothing about quantum mechanics, and none of the results below depends on it.

Here is the simplest version. Two cards lie on a table, one face up and one face down, and each shuffle swaps them. After one shuffle the player can predict the colour now showing no better than by tossing a coin. After a second shuffle the original card is back, with certainty. The player's record therefore has memory: what is seen next depends on what was seen earlier, not only on what is showing now. That memory is kept in the face-down card. Once the cards are dealt nothing random happens; the uncertainty is the player's, and it comes from what the player cannot see. The game's statistics are those of ordinary classical probability, so it illustrates how hidden information works; it is not a model of quantum mechanics [Book §1.11].

Framed this way, a question about interpretation becomes three mathematical questions. Which patterns of observations can a partly hidden deterministic world produce? Where must the hidden information sit? What does it force the observations to look like? Section 3 gives the answers proved for finite worlds, and section 4 states what those answers do not establish. Section 5 discusses what follows for the foundations of quantum theory, for the energy of empty space and for black holes, and section 6 lists the steps still missing.

**What this paper is.** This is an explanatory paper and it claims no new theorem. The results it describes are proved in the formal papers: [Main] for the finite-observer results, [GR] for the operational and gravitational results and [Substratum] for what retained records reveal. The black-hole results rest on unpublished finite computations and written proofs [BHa; BHb]. The novelty of the operational characterization, of the result on the evolution relating two times and of the black-hole results has not been assessed. Earlier work is credited where it is used. Deterministic systems have been analysed with quantum methods before, for example by 't Hooft [tH14].

**How to read the status words.** A result is *proved* when the cited paper gives a complete mathematical proof; many of these proofs are also checked by computer in the Lean proof assistant, and the formal papers name the checked statements. A result that uses a published theorem of others says so. A result is *conditional* when it is proved from a stated assumption that is not itself established, and *open* when it is not settled either way. A *proposal* is a physical interpretation that the mathematics allows but does not establish.

## 2. The simple idea: a hidden deterministic world can look random

Start with a world whose rule is *reversible*: each complete configuration has exactly one successor, and no two configurations have the same successor. Such a rule loses no information, so the whole present determines the whole past. In the formal papers this rule is a *bijection* of the world's configurations.

Now put an observer inside that world. The observer registers only part of each configuration, the *visible* part; the rest is *hidden*. Two configurations that look the same to the observer can differ in their hidden parts and so lead to different visible futures. The visible part therefore changes in a way that looks random to the observer, although the whole world changes without any randomness. What the observer sees depends on three things: the rule, the division into visible and hidden parts, and how the hidden part is prepared at the start [Main §1.2].

*Observational incompleteness* (OI) is the physical hypothesis that every physical observer is in this situation: a part of a reversible, deterministic world, with a specified way of reading and preparing its surroundings, able to distinguish only finitely many visible configurations [Main §1.2]. Two features of this starting point are choices, not results. Reversibility is a representation choice, motivated by the observed near-unitarity of physical evolution (unitary evolution is the reversible evolution of quantum theory). The finiteness of the whole world is posited; it does not follow from the observer being embedded in it [Main §1.2, Remark (status of the early commitments)]. The finite reversible world is called the *substratum*.

Hidden does not mean unknowable. In the two-card game the first two colours the player sees already identify both cards, even though the visible record has memory. In general, an observer who keeps a record of past observations knows a hidden quantity exactly when every starting configuration compatible with that record gives it the same value [Substratum, Prop. 24.5]. What is hidden is what cannot be read directly at one moment; whether it can be inferred depends on the records kept and on what the observer can do. That result is about inference from records; it does not supply a physical mechanism for storing, preparing or acting on them.

Nor is this incompleteness the uncertainty principle of quantum theory. It arises even when the observer always reads the world in one fixed way, and the visible statistics of such a fixed readout are subject to no uncertainty relation [Main §3.4].

What does the substratum itself run on? Hawking's story of a world resting on a turtle, and then on turtles all the way down, asks that question. A deeper layer that never acts back on the substratum can be added without changing anything this observer sees, under the preparation assumptions of [Substratum, Theorem 24(iii)]; for this observer it is another description of the same data. A deeper layer that can act back may change later records, and cannot be set aside on that ground. These results do not classify every possible deeper level or show that the regress ends. The finite reversible world is the model under investigation, not a demonstrated final description of nature [Substratum §§2–4; Book §3.8].

The question of section 1 can now be stated precisely. Fix a number of steps. A *pattern* lists the probability of every possible sequence of visible observations over those steps. A hidden world *realizes* a pattern if, with its rule and its preparation of the hidden part, the observer's sequence of observations has exactly those probabilities. Which patterns can be realized, and what must a world that realizes them contain? Section 3 gives the answers.

Traceability of the sample (sentence groups → inventory): Abstract: I-05/I-04 (hypothesis, finiteness posit), I-15 (correspondence, fixed measurement), I-21/I-29/I-26/I-31 (memory stored; capacity), I-42 with I-39 (shared preparation; not-fully-predictable step; somewhere in the cycle), I-51/I-54 (representation, not derivation), I-55–I-57 (assumed matrix structure; five conditions not supplied by OI), I-22 (exponent not selected), I-67–I-69/I-73–I-74 (scoped applications). §1: I-01, I-02, three questions (current L22), I-10 (including its novelty clause, which covers the §§3.2–3.3 and §5 results), I-11. §2: I-03, I-13, I-05, I-04, I-06 and I-27's "no physical mechanism" clause, I-07, I-08, I-12/I-14 (pattern, realization).

Sample word count: abstract ≈ 218; §1 ≈ 515; §2 ≈ 610 (≈ 1,330 in all; §§1–2 run about 125 words over their combined 1,000-word budget; trimming candidates: the turtle paragraph and the status-word paragraph).

Wording checks done on the sample: no internal paths in body text; no phrases from the §A.32/§A.33 families (checked against the SC-42 scan lists: "should not be read", "the reader should", "discipline", "honest", "temptation", "no longer", "formerly", "withdrawn", "now settled", "in its current form", …); no mid-sentence 4+-letter capitals; no revision narration. Two points for the reviewer: "Substratum §§2–4" widens the current "§§3–4" because the regress discussion is in Substratum §2 (L50, L54) — confirm; the abstract's "and must be large enough to hold it" paraphrases the capacity bound (I-31).


D. Implications and safeguards

Formal-source and verification gaps (separate-correction items)

flag What the Introduction carries that no formal paper does Where the evidence would be preserved Proposed handling
F-1 Record-fibre identification core "machine-checked for nonempty compatible-state sets" (Lean RecordFibreIdentification). Substratum Prop. 24.5 cites no kernel; ledger SUBSTRATUM:P-24.5 says "not formalized in Lean"; census family kernel-only. Substratum Prop. 24.5 (anchor) + census + ledger, after review #1118 (review, census disposition, Substratum anchor, ledger re-grade). Rewrite cites Prop. 24.5 as a paper result only.
F-2 Actual finite-permutation trajectory capacity bound, supremum over finite blocks (Lean TrajectoryMemory). Only the Introduction states it; the ledger's C3 row calls it unreviewed. Main §3.4 C3 corollary (anchor) after review #1118. Rewrite omits it.
F-3 Entire-future finite-image bound $J^*$ (Lean FullFutureMemory); audit record full-future-memory-20261028 exists on main. Main §3.4 or that audit record #1118. Rewrite omits it.
F-4 "First sentence of the recurrence-cycle Corollary is machine-checked on the actual finite realization" (Lean RootedRecurrenceBridge). Main §2.3 gives a paper proof (ledger MAIN:T-history-readback-finite-recurrence-implies = P). Main §2.3 (anchor) after review #1118. Rewrite states the result as proved (paper), with its hypotheses.
F-5 Card table's memory is classical in the sense of [BBS24] via a Pauli-twirl decomposition (uniform burn card). Main §4.5 covers only the fixed-initial-slot swap. Main §4.5 or Book §1.11, if wanted Owner choice: drop (proposed; not used elsewhere), or land in Main §4.5/Book §1.11 by its own correction.
F-6 "Different deck" worked example (overlap only from a never-dealt start; return at step 2, recurrence at 3), cited to [Main §2.3]; Main §2.3 carries only the general statement. — (illustration) Rewrite drops the example and keeps the principle; no evidence is lost. Listed for completeness.
F-7 Black-hole conservation-versus-recovery results (1,376/40,320; 60; 32; the $1/\lvert\mathcal U\rvert$ floor): no formal paper carries them; support is the research record [BHa] on main. GR App. A or a dedicated note, if they are to be "established by a formal paper" Owner question (E-Q6). Rewrite keeps them, cited to [BHa] with their status (exhaustive enumeration, floor proved, unpublished, novelty not assessed).
F-8 [CE]/[CR] coherent constructions: no formal paper; files exist only in history (bdcbd32, 2624d49, reachable via 4a90ac2f); the reference paths do not resolve in main's tree; [CR] not independently reviewed. GR App. A.7 or the audit record, landed in the tree Owner question (E-Q5). If kept, the reference wording keeps "read at commit".
F-9 Attribution of the trajectory-labelling realization [EGGH26, Prop. 13] and the independent-prior form [EGGH26, Prop. 16], and [LP17], appears in no formal paper (Main §3.4 does not cite Egri et al.). Main §3.4 / §4.4 Separate attribution correction to Main (not authorized here); rewrite keeps the attribution.
F-10 papers/introduction_repro/ supports only the Appendix A statement (baseline declarations at 17b830bc, axiom reports). After the rewrite it supports no Introduction statement. in place, or verification/audits/manuscript/ Separate disposition item (§A.46 item 6); rewrite PR leaves it untouched.

(i) Coverage ledger (verification/coverage/LEDGER.json)

tools/proof_census.py registers a statement only for a line starting with a bold **Theorem|Lemma|Corollary|Proposition|Claim|Definition|Axiom …**; ids are text-derived (number or parenthetical label; unnamed-<hash> otherwise) and fingerprints hash the statement block. tools/coverage_check.py fails on a ledger entry with no census statement and on a census statement with no entry. The proposed rewrite has no bold theorem headers, so all six Introduction rows disappear from the census and must be removed in the same commit. Proposed supersession record (in the PR's change note, not in the ledger, since all six are MIRROR rows carrying no obligation):

retired row mirrored canonical row (unchanged)
INTRODUCTION:T-1 (fp 97ce3099…) MAIN:T-finite-horizon-stochastic-reversible-unitary (K3)
INTRODUCTION:T-2 (fp a1abae06…) MAIN:T-unavoidable-hidden-predictive-memory (K3)
INTRODUCTION:C-unnamed-99fe05c0 Main §1.5 corollary — no canonical row (its own note says so)
INTRODUCTION:T-3 (fp 67e2d2a4…) MAIN:T-overlap-return (K3)
INTRODUCTION:C-recurrence-cycle-indivisibility (fp 603c7f6d…) MAIN:T-history-readback-finite-recurrence-implies (P)
INTRODUCTION:T-4 (fp 106e5e68…) GR:T-operational-completion-characterization (K3)

If the owner prefers to keep the compact equivalence as a bold **Theorem 1**, the census would derive INTRODUCTION:T-1 again with a new fingerprint; that is a new mirror row to be written and re-affirmed against Main §3.4, not the old row carried over. Removing rows changes no canonical row, no K-level and no backlog entry; the baseline report's mirror count drops by six. coverage_check.py and the release gate are to be run on the rewrite head.

(ii) #1118 and the D3/O1 wording

The rewrite removes the "Checked in Lean, not independently reviewed" paragraph (D3) and every statement resting on the four kernel-only families. Consequences: #1118's step 3 ("relabelling … the Introduction's wording") has nothing left to relabel in the Introduction; its steps 1–2 (independent review, census disposition) stand, but the anchors should go to Main §2.3/§3.4 and Substratum Prop. 24.5 rather than to the Introduction (F-1–F-4). #1118's deferred census registration of papers/Introduction.md becomes optional: after the rewrite the Introduction cites no kernel identifier, so registering it in verification/lean-manuscript-census.json would check nothing. Proposal: record on #1118, when the rewrite lands, that the Introduction no longer cites these modules and that the publication-facing anchors move to the formal papers. Any wording the owner fixed under D3/O1 for the Introduction is superseded by the rewrite text and needs the owner's confirmation in the rewrite review.

(iii) papers/introduction_repro/ and evidence-replay.yml

evidence-replay.yml (manually dispatched only) reads papers/introduction_repro/results-121598983127.json from the pinned commits EXPECTED_14 (4a260ca9, #918's audited head) and EXPECTED_28 (e73f7be3), not from main's tree; its comment describes the evidence as what "the Introduction … cites". The rewrite therefore does not break the workflow, but makes the comment's description historical. No workflow edit is proposed (not authorized); if F-10 relocates or removes the directory, the workflow still works because it reads from those commits, and those commits must stay reachable (§A.42 item 3; tracked with #941). The local clone used here is shallow, so ancestry of 4a260ca9/e73f7be3/17b830bc from main was not verified independently in this pass. #941's Appendix A additions (OD-15) become moot if Appendix A is removed; #941 should record that.

(iv) SC-42 added-text scan constraints for paper text

The scan (verification/audits/manuscript/bell-operational-reconciliation-20261029/check_sc42_integration.py) applies on its own round, but the rewrite should satisfy its families anyway, plus §A.32/§A.33: no local paths (/tmp/, /home/, /root/, /Users/, the "scr"+"atchpad" token, drive letters); no secrets or e-mail addresses; register family ("should not be read", "the reader should", "reader should note", "discipline", "honest", "temptation", "stated in that register", "neither borrows"); history family ("is now settled", "now settled", "in its current form", "the corrected form", "as redefined", "no longer", "formerly", "withdrawn", "earlier revisions", "previously stated"); no mid-sentence capitals of four or more letters outside acronyms (CHSH, QFT, …). Run the same regexes on the rewrite diff's added words before review.

(v) Other descriptions of the Introduction

  • README.md line 16 ("A short introduction to the framework's finite-observer results") stays accurate.
  • README.md line 117 lists the contents and says "Its Appendix A lists the Lean declarations it cites … the axiom reports … are in papers/introduction_repro/". Needs updating in the same PR: new contents line (question, correspondence, hidden memory, recurrence, limits on deriving quantum theory, scoped applications), Appendix A sentence removed, introduction_repro sentence adjusted per F-10.
  • .zenodo.json describes "the introductory paper Introduction (an introductory entry point to the finite-observer results)": accurate; no change proposed.
  • papers/Introduction.tex and .pdf are rebuilt with sh ./build.sh Introduction (page count and characters per page checked).
  • verification/audits/manuscript/observer-relative-finiteness-20261030/DEPENDENCY-AUDIT.md cites Introduction line numbers at a past commit: a record, left unchanged.
  • No book chapter mirrors the Introduction (it is not in the census manuscript list and has no book counterpart), so §A.14 mirroring does not apply; claims it shares with Main/GR are unchanged.

(vi) Proposed process

  1. Owner reviews this proposal and answers section E. (Planning authorization ends here.)
  2. On separate owner authorization: a new draft PR from current main, independent of Introduction: use the papers' standard header instead of the pandoc % title block (formatting only) #1128 (landed) and Correction planning: scientific overclaims and status corrections (from the 2026-11-01 disposition) #1028 (Main retitle), with one writer.
  3. Full rewrite following section B; references trimmed to those cited; Main's title as on main at the drafting base.
  4. Independent claim-by-claim review against the landed Introduction (13ced581) and the formal sources: every sentence mapped to an inventory id; every dropped item mapped to its fate; no strengthening, no lost limitation (checked especially for I-04, I-16, I-22, I-39/42, I-43, I-51, I-55, I-58, I-64, I-68, I-72). This also discharges Introduction full-corpus scientific consistency audit (gate for #918) #941 requirement 5 ("independent scientific review … of any Introduction revisions").
  5. Same PR: ledger rows retired (D(i)), README line 117, rebuilt .tex/.pdf; release gate, coverage_check.py, lean_manuscript_census.py and the added-text scan run; exact-head CI green.
  6. Owner merge decision. F-1–F-10 proceed as their own items (Independent review and census disposition of the four kernel-only Lean families the Introduction cites #1118 for F-1–F-4; new Issues or existing ones for F-5, F-7–F-10), none bundled into the rewrite.

E. Open questions for the owner

  1. Displayed formulas. Keep only S ⇔ D ⇔ Q_fb (proposed)? Or also the capacity bound and the targeted field-equation form of §5.2?
  2. Numbered results. Drop the "Theorem 1–4" numbering (proposed; retires six ledger rows) or keep "Theorem 1" for the equivalence (re-created mirror row)?
  3. Where the Appendix-A material lives. The kernel names for Theorems 1–4 and the capacity/recurrence lemmas are already printed in Main and GR, and the census and ledger record them. For the four kernel-only families, proposed home: Main §2.3/§3.4 and Substratum Prop. 24.5 anchors via Independent review and census disposition of the four kernel-only Lean families the Introduction cites #1118, not an appendix to Main. Agree, or prefer one verification record (e.g. under verification/audits/manuscript/)?
  4. Vacuum-energy identity. Keep the "mismatch ≈ de Sitter entropy" dimensional identity (GR §6.3), or drop it as a detail open to over-reading?
  5. [CE]/[CR]. Keep one scoped sentence on the finite coherent entropy curve (with "not a black-hole evaporation model" and, for [CR], "not independently reviewed"), or drop both from the Introduction until their evidence is in main's tree or a formal paper?
  6. Black-hole toy results (F-7). Acceptable for the Introduction to remain their only manuscript home, cited to [BHa]? Or should a formal paper (GR App. A) carry them first?
  7. Title and date. Keep the title "Observational Incompleteness: From Deterministic Dynamics to Quantum Observations"? Update the date line to the month the rewrite lands? (Main is cited as "The Incompleteness of Observation: The Equivalence of Quantum Mechanics and Embedded Observation", its title at 13ced581; the Correction planning: scientific overclaims and status corrections (from the 2026-11-01 disposition) #1028 retitle is reconciled later.)
  8. Card-game Bell remark and anticorrelated aside (I-49/I-50). Fold the card-protocol Bell ceiling into §4.4 (proposed) and drop the anticorrelated-cards aside (Book §1.11 does not state it)?
  9. papers/introduction_repro/ (F-10). Keep in place, relocate, or audit for removal — in a separate PR after the rewrite?

Generated by Claude Code

amaybaum commented Nov 5, 2026

Copy link
Copy Markdown
Owner Author

Owner decisions on the Introduction rewrite proposal c.6658252620 (amaybaum, Claude Code session chat, 2026-11-05; quoted under §A.42 item 7):

Approve the proposed structure and authorize drafting the full rewrite in a separate PR. The sample opening is a good starting point, but I want a few improvements before it becomes the manuscript.
In particular, the general OI hypothesis must not be presented as requiring a finite total substratum. That is an assumption of the finite models, not a universal requirement of OI.

Question Decision
Q1 — Displayed formulas Keep only [the finite-horizon equivalence S ⇔ D ⇔ Q_fb], with its fixed-measurement, finite-horizon scope explained immediately
Q2 — Numbered theorems Remove theorem numbering from the Introduction; retain plain-language statements with precise citations
Q3 — Lean evidence Keep it in formal papers and canonical verification records; #1118 retains the outstanding independent-review work
Q4 — Vacuum-energy identity Omit the entropy/mismatch dimensional identity from the Introduction; leave it in GR
Q5 — CE/CR Omit both detailed constructions for now, retaining their evidence and review obligations elsewhere
Q6 — Black-hole toy results Keep the qualitative conservation-versus-recovery result, explicitly sourced to BHa and labelled as unpublished finite-model research; move numerical detail to technical sources
Q7 — Title/date Keep the Introduction title; update the date to the revision month
Q8 — Card-game Bell discussion Put the scoped Bell result in §4.4; omit the anticorrelated-cards aside
Q9 — introduction_repro/ Preserve it in place as historical verification evidence; handle its eventual disposition separately

Two additional editorial corrections are important. The card example should explicitly state that the hidden card is initially drawn with equal probabilities and independently of the visible card. And the sample opening should move detailed novelty and verification qualifications into the technical-source guide, keeping a short, clear distinction between established and open results near the beginning.
The six ledger mirrors may be retired with traceable mappings to formal sources. The unnumbered corollary that lacks a canonical ledger row must be checked separately before retirement; no scientific result should lose its only accountable source.

Consolidated: Accept the six-part proposal WITH CHANGES. Approve drafting the complete reader-focused manuscript in its own draft PR, using the nine editorial decisions above. Maintain an independently reviewable claim-by-claim mapping to the landed Introduction and its formal sources. Make observer-relative finiteness explicit and simplify the opening further. Retain no duplicate verification inventory.
Sequence: Record F, prepare and review the narrow Main retitle, then draft the full Introduction rewrite on the resulting current base. Keep scientific execution and the large manuscript merge behind their separate approval gates.

(The Q1 cell's formula was elided in transmission and is filled in from the proposal's Q1 and the owner's earlier decision on #918, c.6657998945: "The finite-horizon equivalence may retain its compact mathematical expression.")


Generated by Claude Code

amaybaum pushed a commit that referenced this pull request Nov 5, 2026
…w nit N1, #1129)

The blob first appears on #918's branch at 3941ef8; 4a260ca is where
the workflow first pinned it. Comment only; no pin or check changes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011zDyUSyEszk3JJx83uXKKq

amaybaum commented Nov 5, 2026

Copy link
Copy Markdown
Owner Author

Owner instruction (amaybaum, Claude Code session chat, 2026-11-05; quoted under §A.42 item 7):

The Main retitle dependency has been satisfied. There is no longer a reason to delay the rewrite for #1130. … start the authorized manuscript writer now, on a fresh branch from current main, and open a dedicated draft PR. The first review should check both scientific fidelity and actual readability for non-experts, not just whether the wording matches the previous paper.

The rewrite writer has started on branch rewrite/introduction-reader-20261105 from current main (after #1130, d9f0a845), under the decisions in c.6658427740. The draft PR will follow, and merging it is not authorized.


Generated by Claude Code

amaybaum commented Nov 5, 2026

Copy link
Copy Markdown
Owner Author

Cross-link: #918's residual obligations are now carried on #941

Under owner ruling #1031 c.6666613671, item A, #918's outstanding obligations are carried on #941 in c.6666760529:

The F-10 row and the writer-941 clause in #941's planning block were corrected in the same pass.

This PR stays open. Under item C, closure without merge waits for #1152 to land and pass its required checks. Heads recorded now, unchanged:

  • draft/oi-introductory-paper-20261025 = 44236326976d2c9ad743f52595365b64ceb86d35;
  • staging/introduction-repro-ext-20261027 = 0a8f4930d1607340fe7e97ce19cd8690d0ed2391.

Generated by Claude Code

amaybaum commented Nov 5, 2026 •

Copy link
Copy Markdown
Owner Author

Closing without merge (§A.43 item 6), under owner rulings #1031 c.6666613671 (item C) and #1152 c.6666823484. Both conditions hold:

What landed from this PR. The Introduction landed through #1124 (f5efa7a0) and was rewritten in #1134 (9f9dbc28). Related landings:

Residuals carried on #941 (c.6666760529, c.6666916186):

Branches preserved, not deleted or rewritten (heads checked with git ls-remote just before closure):

  • draft/oi-introductory-paper-20261025 = 44236326976d2c9ad743f52595365b64ceb86d35 (= refs/pull/918/head)
  • staging/introduction-repro-ext-20261027 = 0a8f4930d1607340fe7e97ce19cd8690d0ed2391

The cited branches research/introduction-recovery-r32-20261028, research/page-coherent-entropy-20261028 and audit/intro-corpus-20261026 are also kept.

This PR's description is out of date: it names fa32b043, 24 pages, and "no Explainer retirement". Closing it adopts no unlanded claim and changes no scientific status.


Generated by Claude Code

@amaybaum amaybaum closed this Nov 5, 2026
amaybaum pushed a commit that referenced this pull request Nov 6, 2026
Cause: book/acknowledgments.md and book/appendix-c-objections.md now
differ from the checker's pinned base ca3a5bb, and the checker emits
one "chapter line mirrored in FULL" predicate per added chapter line,
so core B's byte comparison failed. Regenerated by running the
unchanged checker exactly as the CI step does. The only difference is
four added passing mirror predicates (the two pointer lines, the blank
line after them, the Appendix C sentence); verdict PASS, normal and
optimized runs agree, and the controls output still equals
sc42-integration-controls.json. Checker, controls and workflow are
unchanged. Same procedure as #1013, #1112, #918, #1140, #1015, #1154.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011zDyUSyEszk3JJx83uXKKq
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants