Skip to content

Derive reporting xi means from an exactly nested fine grid - #400

Draft
cailmdaley wants to merge 6 commits into
fix/layout-independent-meansfrom
feat/nested-fine-grid
Draft

cailmdaley wants to merge 6 commits into
fix/layout-independent-meansfrom
feat/nested-fine-grid

Conversation

@cailmdaley

@cailmdaley cailmdaley commented Oct 5, 2026 •

Copy link
Copy Markdown
Collaborator

Reporting ξ± means come from pair-weighted rebinning of one unpatched fine-grid measurement on exactly nested edges. The patched reporting measurement supplies covariance only and uses TreeCorr's default bin_slop; b_target governs the mean-producing pass.

  • rebin_gg_means reuses pure-E/B's pair-weight operator (gg.weight) for ξ± and separations; it sums pair counts and weights. The route handles tomographic auto/cross pairs, and the reporting Snakemake job consumes the fine SACC product.
  • Both shipped paper configs use k=34, 0.07939053012074941–301.3330747561176′, 1015 bins. The fine-grid means pass has bin_slop=1; configuration and consumption reject non-nested edges. COSEBIs and pure-E/B must be regenerated for the changed integration grid.
  • Exact-counting weighted synthetic catalogues reproduce direct reporting TreeCorr means to 10⁻¹². Layout, cross-pair, producer and DAG tests pass.
  • Full container suite at the stacked Derive reporting xi means from an exactly nested fine grid #400 head, slow tests included: 537 passed; three environment failures reproduce on T (seven missing configured paths and two NFS FITS-cleanup errors). Host workflow suite: 11 passed, 1 skipped.
  • SP_v1.4.6.3: published mean, count and weight fields are bit-identical across seeded and develop-saved patch centres; the covariance differs by layout. Against unpatched reporting bin_slop=0.036: 0.095σ rms / 0.221σ max (angle_slop=0.01 reference: 0.053σ / 0.131σ). Against the old patched means: 0.299σ / 0.866σ seeded and 0.358σ / 1.119σ saved centres.
  • Reusing nested_fine.npz, the default-tolerance covariance-only reporting pass took 3.95 min seeded / 3.76 min saved centres at 8 threads, excluding catalogue loading and patch-centre construction. The earlier fine measurement took 179.6 min once; it was not rerun for this timing.

Top: layout difference, patched vs fine-rebinned means. Bottom: fine-rebinned means against the other estimates; the dotted line is the most converged reference.

Depends on #399; base is fix/layout-independent-means. The effect of changing bin_slop on jackknife covariance remains open in #401.

The decision record on assay/decision-record is not edited: this changes the real_space.integration_grid Values pins for cosmo_val.integration.{min_sep,max_sep,nbins} and bmodes/config/config.yaml#fiducial.{min_sep_int,max_sep_int,nbins_int}. bmodes.pure_eb_rebinning retains grid=integration and Σw_iw_j (gg.weight).

— Luna on behalf of Cail

Validate logarithmic bin-size ratios and edge alignment rather than silently snapping a requested binning. Both shipped paper grids use k=34 and outward-rounded 0.08–300 arcmin coverage (1015 bins); explicit bounds preserve the existing covariance interfaces.

Co-Authored-By: GPT-6.1 Sol <noreply@openai.com>
cailmdaley and others added 5 commits October 5, 2026 16:18
…nly its covariance

Reuse the pure-E/B averaging operator for correlations and separations, sum counts and weights, and supply those canonical means to the shared correlation processor. The reporting workflow job consumes the unpatched fine SACC product, including lossless auxiliary means, before blinding.

Co-Authored-By: GPT-6.1 Sol <noreply@openai.com>

Co-Authored-By: GPT-6 Luna <noreply@openai.com>
… and the DAG

Weighted fine bins reproduce exact direct reporting counts and means; distinct patch layouts leave the published means identical. DAG tests check the fine-to-reporting dependency and use the workflow’s canonical path spelling on automounted disks.

Co-Authored-By: GPT-6.1 Sol <noreply@openai.com>
The producer uses arcminutes for both grids; the reference comparison must carry those units rather than default to dimensionless separations.

Co-Authored-By: GPT-6.1 Sol <noreply@openai.com>
The production input path is a string; the regression should exercise that same SACC interface.

Co-Authored-By: GPT-6.1 Sol <noreply@openai.com>
The pure-E/B plotting path now resolves the configured integration grid through CosmologyValidation's helper. Give the minimal tomography test host that same interface so its slow bin-keyed regression still reaches the statistics step.

Co-Authored-By: GPT-6 Luna <noreply@openai.com>
@cailmdaley
cailmdaley force-pushed the feat/nested-fine-grid branch from 005b79d to bf331e3 Compare October 5, 2026 14:18

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant