Skip to content

Add Float64 Oracle Audit and Three Questions Framework to XProf Numerical Parity. - #3338

Open
copybara-service[bot] wants to merge 1 commit into
masterfrom
test_975592711
Open

Add Float64 Oracle Audit and Three Questions Framework to XProf Numerical Parity.#3338
copybara-service[bot] wants to merge 1 commit into
masterfrom
test_975592711

Conversation

@copybara-service

@copybara-service copybara-service Bot commented Sep 3, 2026

Copy link
Copy Markdown

Add Float64 Oracle Audit and Three Questions Framework to XProf Numerical Parity.

  • Implements kernel_oracle in numerical_validator.py supporting automatic float64 promotion (kernel_oracle="auto") and explicit float64 analytical callables.
  • Adds OracleAudit dataclass reporting reference and candidate ULP distances and maximum absolute deviations from the oracle.
  • Surfaces correctness_basis ("AGREEMENT_AND_ORACLE" vs "AGREEMENT_ONLY") and run_config in validation report payloads.
  • Introduces UlpContext reporting median (p50) ULP, 99.9th percentile, and regime reliability flags.
  • Implements dual gating with np.allclose alongside ULP distance checks.
  • Dispatches test regimes based on criterion: Q3 and discrete types execute full procedural distributions; continuous parity defaults to normal regime with automated diagnostic triage fallback.
  • Adds chunk_callable utility for memory-constrained oracle validation.
  • Adds B3 0-ULP false green auto-probe on batch 0.
  • Adds pin-inert reference detection probing accelerator precision sensitivity.
  • Updates CLI tool verify_numerical_parity to accept and serialize --kernel_oracle and --regimes.
  • Synchronizes numerical_correctness.md reference documentation and SKILL.md across 1P and 3P mirrors.

@copybara-service
copybara-service Bot force-pushed the test_975592711 branch 10 times, most recently from 6973ba6 to e225592 Compare September 6, 2026 10:16
…ical Parity.

- Implements `kernel_oracle` in `numerical_validator.py` supporting automatic float64 promotion (`kernel_oracle="auto"`) and explicit float64 analytical callables.
- Adds `OracleAudit` dataclass reporting reference and candidate ULP distances and maximum absolute deviations from the oracle.
- Surfaces `correctness_basis` ("AGREEMENT_AND_ORACLE" vs "AGREEMENT_ONLY") and `run_config` in validation report payloads.
- Introduces `UlpContext` reporting median (`p50`) ULP, 99.9th percentile, and regime reliability flags.
- Implements dual gating with `np.allclose` alongside ULP distance checks.
- Dispatches test regimes based on criterion: Q3 and discrete types execute full procedural distributions; continuous parity defaults to normal regime with automated diagnostic triage fallback.
- Adds `chunk_callable` utility for memory-constrained oracle validation.
- Adds B3 0-ULP false green auto-probe on batch 0.
- Adds pin-inert reference detection probing accelerator precision sensitivity.
- Updates CLI tool `verify_numerical_parity` to accept and serialize `--kernel_oracle` and `--regimes`.
- Synchronizes `numerical_correctness.md` reference documentation and `SKILL.md` across 1P and 3P mirrors.

PiperOrigin-RevId: 975592711
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant