Repository navigation

Ngmix v2.0 (CI mirror of #740) - #741

Merged

cailmdaley merged 146 commits into

developfrom

ngmix_v2.0

Jul 6, 2026

Commits on Jan 9, 2023
- ngmix update runs, with issues
  Lucie Baumont
  committed
  f27d4c2
Commits on Jan 12, 2023
- still debugging ngmix
  Lucie Baumont
  committed
  b36b92b
- Merge remote-tracking branch 'origin/develop' into ngmix_update
  Lucie Baumont
  committed
  4ea9b42
Commits on Jan 17, 2023
- change T to r50
  Lucie Baumont
  committed
  56e60ba
- added r50 as galaxy guess option
  Lucie Baumont
  committed
  d86c88a
- new version of ngmix produces output. not yet tested the quality
  Lucie Baumont
  committed
  52e411e
Commits on Oct 15, 2023
- unfinished overhaul of ngmix module
  lbaumo
  committed
  9b7c8d7
- ngmix module overhaul
  lbaumo
  committed
  441797e
- Merge branch 'CosmoStat:develop' into ngmix_update
  lbaumo
  authored
  2b34488
Commits on Oct 16, 2023
- ngmix update psf stuff
  lbaumo
  committed
  396035c
- ngmix module random numbers
  lbaumo
  committed
  139ffae
Commits on Oct 17, 2023
- ngmix module new classes
  lbaumo
  committed
  ccf6e1a
- Merge branch 'ngmix_update' of https://github.com/lbaumo/shapepipe into ngmix_update
  lbaumo
  committed
  e09dc48
Commits on Oct 18, 2023
- more ngmix updates
  lbaumo
  committed
  75ddcc8
- ngmix update
  lbaumo
  committed
  a98063a
Commits on Feb 2, 2026
- Added ngmix test fitting script
  martinkilbinger
  committed
  886e0db
Commits on Apr 25, 2026
- docker install: leave extensions
  martinkilbinger
  committed
  8fd590c
Commits on Apr 26, 2026
- remove obsolete scripts
  martinkilbinger
  committed
  621bab1
- keeping extension for shapepipe_run.py, updated workflow
  martinkilbinger
  committed
  06934c9
- Fixed Dockerfile
  martinkilbinger
  committed
  883c4d6
- fix: add bin/ wrappers to git and fix pyproject.toml license format
  
  martinkilbinger
  and
  claude
  committed
  a662554
- fix: use ENV key=value format in Dockerfile
  
  martinkilbinger
  and
  claude
  committed
  ce6804d
- fixed extensions of scripts
  martinkilbinger
  committed
  88f3fe3
Commits on Apr 27, 2026
- added missing Git_cat cfg file
  martinkilbinger
  committed
  25d9238
- modified Mh runner acfg
  martinkilbinger
  committed
  8bcfe1f
Commits on Apr 28, 2026
- going to job 512
  martinkilbinger
  committed
  a9e70c6
Commits on May 4, 2026
- added ID to Mh output
  martinkilbinger
  committed
  a3eec86
- added ID to Mh output
  martinkilbinger
  committed
  a813280
- v2.0 running up to job 256
  martinkilbinger
  committed
  5856b9f
Commits on May 5, 2026
- fixing log headers; weightwatcher exe
  martinkilbinger
  committed
  adc2684
Commits on May 6, 2026
- Merge remote-tracking branch 'upstream/develop' into ngmix_v2.0
  martinkilbinger
  committed
  f922f05
- improved job checks
  martinkilbinger
  committed
  b0c6f31
- multi-epoch vignet handling for v2.0
  martinkilbinger
  committed
  7fccb0e
- Merge branch 'ngmix_v2.0' of github.com:martinkilbinger/shapepipe-1 into ngmix_v2.0
  martinkilbinger
  committed
  546e628
Commits on May 7, 2026
Commits on May 9, 2026
- running until ngmix call
  martinkilbinger
  committed
  bed3a50
- Merge remote-tracking branch 'remotes/origin/ngmix_update' into ngmix_v2.0
  martinkilbinger
  committed
  6839230
Commits on May 10, 2026
- Update to ngmix v2.4;
  martinkilbinger
  committed
  d01503d
Commits on May 12, 2026
- Added Axel's centroid shift test scripy (py)
  martinkilbinger
  committed
  fd88094
- Merge branch 'ngmix_v2.0' of github.com:martinkilbinger/shapepipe-1 into ngmix_v2.0
  martinkilbinger
  committed
  ceb4f91
- debugging ngmix and small nb of processed objects
  martinkilbinger
  committed
  7e00cfd
- Merge branch 'ngmix_v2.0' of github.com:martinkilbinger/shapepipe-1 into ngmix_v2.0
  martinkilbinger
  committed
  eba7ece
Commits on May 13, 2026
- adapting centroid shift script to v2.0
  martinkilbinger
  committed
  b729eb8
- Add centroid bias validation infrastructure from test_centroid_bug
  martinkilbinger
  committed
  9f4170d
Commits on May 14, 2026
- Merge remote-tracking branch 'origin/ngmix_v2.0' into ngmix_v2.0
  martinkilbinger
  committed
  7f3d172
Commits on May 15, 2026
- testing centroid bug and fix with three different setting (bug, fix, v2.0)
  martinkilbinger
  committed
  bd12880
Commits on May 16, 2026
- centroid bug fixed for v2.0
  martinkilbinger
  committed
  440f822
- fixed pyproject for Docker deployment
  martinkilbinger
  committed
  0f52921
- fixing versions in docker
  martinkilbinger
  committed
  3a70fdf
Commits on May 18, 2026
- Merge remote-tracking branch 'origin/ngmix_v2.0' into ngmix_v2.0
  martinkilbinger
  committed
  77054bb
Commits on May 20, 2026
- fixing bugs in ngmix
  martinkilbinger
  committed
  60962ff
- Merge remote-tracking branch 'origin/ngmix_v2.0' into ngmix_v2.0
  martinkilbinger
  committed
  30181ff
Commits on May 21, 2026
- fixed merge errors
  martinkilbinger
  committed
  d146cae
Commits on May 22, 2026
- debugged ngmix
  martinkilbinger
  committed
  67079de
Commits on Jun 1, 2026
- Merge develop into ngmix_v2.0
  
  cailmdaley
  and
  claude
  committed
  00525c4
Commits on Jun 2, 2026
- fix(ngmix): thread seeded rng through noise-image generation
  
  cailmdaley
  and
  claude
  committed
  22f1f0a
- test: smoke-import the shipped ngmix-v2.0 validation scripts
  
  cailmdaley
  and
  claude
  committed
  5cdb1bb
- remove stranded v1 centroid_bias.py from ngmix_v2.0
  
  cailmdaley
  and
  claude
  committed
  dd4f656
Commits on Jun 5, 2026
- cleanup(ngmix): drop dead code flagged in v2.0 review
  
  cailmdaley
  and
  claude
  committed
  bd60dc8
Commits on Jun 8, 2026
- Merge branch 'develop' into ngmix_v2.0
  cailmdaley
  committed
  e455127
Commits on Jun 10, 2026
- fix(ngmix): emit true half-light radii in r50 columns; dedupe PSF size columns
  
  cailmdaley
  and
  claude
  committed
  d6531b1
Commits on Jun 11, 2026
- fix(ngmix): restore weight mask binarization
  cailmdaley
  committed
  6ddea5b
- feat(ngmix): support background-rms weights
  cailmdaley
  committed
  f466c98
- config(ngmix): wire background-rms vignets
  cailmdaley
  committed
  7a44abd
- test(ngmix): guard optional rms vignet input
  cailmdaley
  committed
  f79de46
- fix(ngmix): zero fallback weights for degenerate constant stamps
  cailmdaley
  committed
  4aa3b2a
- test(ngmix): pin spatially-varying RMS through the observation chain
  cailmdaley
  committed
  158986a
- test: prune deleted fitting.py from validation-script smoke list
  cailmdaley
  committed
  0df6bf6
- docs(example): state BKG_RMS_VIGNET_PATH all-or-nothing semantics
  cailmdaley
  committed
  0bc6016
- Merge remote-tracking branch 'origin/ngmix_v2.0' into fix/ngmix-size-columns
  cailmdaley
  committed
  b1b4970
- Merge pull request #743 from CosmoStat/fix/ngmix-size-columns
  cailmdaley
  authored
  42cdb35
- config(example): drop removed CHECK_EXISTING_DIR from ngmix template
  
  cailmdaley
  and
  claude
  committed
  16789eb
- fix(sextractor): declare positional WCS input in runner decorator
  
  cailmdaley
  and
  claude
  committed
  d4ada3d
- docs(ngmix): drop stale LOG_WCS option; headers input is positional
  
  cailmdaley
  and
  claude
  committed
  b2dcd79
- fix(sextractor): skip TILE_ID metadata key when sizing the CCD scan
  
  cailmdaley
  and
  claude
  committed
  fcd117f
- fix(ngmix): NaN-fill failed fit types in compile_results
  cailmdaley
  committed
  450f3c1
- fix(ngmix): skip failed-PSF epochs in multiepoch PSF average
  cailmdaley
  committed
  00e9f89
- fix(ngmix): restore mcal_flags as OR of per-type fit flags
  cailmdaley
  committed
  7a1b3b1
- fix(example): migrate configs to positional WCS-headers input
  cailmdaley
  committed
  3eb6a66
- fix(ngmix): rename ntry_fit column to nfev_fit
  cailmdaley
  committed
  436bcc8
- chore(ngmix): drop dead copyfile import and unused Tile_cat columns
  cailmdaley
  committed
  05f1584
- removed obsolete cfis_simu directory; superceded by cfis_image_sims (soon to be merged
  martinkilbinger
  committed
  ceeb62d
- removed obsolete config file
  martinkilbinger
  committed
  ff612b7
- Merge develop into ngmix_v2.0: #737 + #742; uv.lock regenerated
  
  cailmdaley
  and
  claude
  committed
  061ca3c
- fix(example): explicit FILE_EXT in config_exp_psfex.ini
  
  cailmdaley
  and
  claude
  committed
  6f4901b
- fix(example): Ng templates point BKG_RMS_VIGNET_PATH at surviving producer
  
  cailmdaley
  and
  claude
  committed
  0433a36
- fix(ngmix): per-pixel fixnoise noise image in the background-RMS branch
  
  cailmdaley
  and
  claude
  committed
  bb93c28
- test(ngmix): galsim noise-injection validation of background-RMS weights
  
  cailmdaley
  and
  claude
  committed
  c5a9cc4
- test(ngmix): tighten validation docstrings per review (ratio-test scope, pull-tol derivation)
  
  cailmdaley
  and
  claude
  committed
  6bae2a4
- Merge fix/lazy-mpi-init into ngmix_v2.0 (#744)
  cailmdaley
  committed
  6b30fd4
- refactor(run): replace -e/--exclusive flag with NUMBER_LIST (#746)
  
  cailmdaley
  and
  claude
  committed
  c23ea84
- fix(scripts): fail fast if NUMBER_LIST cannot be set; dead -e guard
  
  cailmdaley
  and
  claude
  committed
  e9473a0
- Merge pull request #748 from CosmoStat/refactor/number-list-replaces-exclusive
  cailmdaley
  authored
  5a51dd6
Commits on Jun 12, 2026
- test: candide-aware pytest architecture + two scientific guardrails
  
  cailmdaley
  and
  claude
  committed
  6eb99aa
- test: consolidate the suite under one discovery root
  
  cailmdaley
  and
  claude
  committed
  71f217b
- feat(ngmix): make the Jacobian centroid source configurable (hsm | wcs)
  
  cailmdaley
  and
  claude
  committed
  0ee0e94
- ci: fast-test workflow on push and PR
  
  cailmdaley
  and
  claude
  committed
  f912d08
Commits on Jun 16, 2026
- Merge remote-tracking branch 'origin/develop' into probe-ngmix
  claude
  committed
  e6988f5
- docs(CLAUDE): drop the don't-bump-ngmix rule
  claude
  committed
  8b6ac7b
- rename moments_fail column to mcal_types_fail
  claude
  committed
  f0fca23
Commits on Jun 17, 2026
- address code-review findings on ngmix v2.0
  claude
  committed
  f90082b
- ci: declare build-system so uv installs shapepipe
  claude
  committed
  b6ec343
- test: skip MPI-launcher run test when libmpi is absent
  claude
  committed
  e57544b
- ci: drop fast-tests workflow; one in-image test path
  claude
  committed
  216f407
Commits on Jun 20, 2026
- Merge remote-tracking branch 'origin/develop' into wt/ngmix-v2-secbump
  cailmdaley
  committed
  09c15a1
- Merge remote-tracking branch 'origin/develop' into wt/741-develop-merge
  cailmdaley
  committed
  0ae5b14
- ngmix: restore original-PSF fit; split the two PSF families by name (#749)
  
  cailmdaley
  and
  claude
  committed
  b6c84c4
- make_cat: rename ngmix columns to the ESTIMATOR_COMPONENT_OBJECT grammar (#749)
  
  cailmdaley
  and
  claude
  committed
  7e7887b
- tests: cover both PSF families and the 3-tuple do_ngmix_metacal (#749)
  
  cailmdaley
  and
  claude
  committed
  c3fbebe
- make_cat: update shipped param files to the new ngmix column grammar (#749)
  
  cailmdaley
  and
  claude
  committed
  b7ababa
- make_cat: add _save_ngmix_data tests; soften the grammar docstring (#749)
  
  cailmdaley
  and
  claude
  committed
  9b3025d
- ngmix: fit a copy of the original PSF so gal_obs.psf is never mutated (#749)
  
  cailmdaley
  and
  claude
  committed
  9ab43af
- ngmix: drop dead r50 columns (derivable from T)
  
  cailmdaley
  and
  claude
  committed
  b690d3f
- tests: hypothesis property tests for the PSF column refactor
  
  cailmdaley
  and
  claude
  committed
  85db8c1
- deps: bump cs_util 0.2 -> 0.2.1 so cs_util.size is in the image
  
  cailmdaley
  and
  claude
  committed
  dfac162
- refactor: route size conversions through cs_util.size
  
  cailmdaley
  and
  claude
  committed
  413c5dd
- test: make_data gains psf_shear for an elliptical PSF
  
  cailmdaley
  and
  claude
  committed
  e2f37be
- review: address PR #761 code review
  
  cailmdaley
  and
  claude
  committed
  31d2080
- refactor(ngmix): build the per-family PSF res-keys from one loop
  
  cailmdaley
  and
  claude
  committed
  8ae3203
- refactor(make_cat): family-loop the PSF column write block
  
  cailmdaley
  and
  claude
  committed
  2087874
Commits on Jun 30, 2026
- ngmix: default the centroid to WCS (astrometry), demote HSM to legacy
  
  cailmdaley
  and
  claude
  committed
  31ae736
- ci: set SHAPEPIPE_ON_CANDIDE=0 so candide tests reliably skip in CI
  
  cailmdaley
  and
  claude
  committed
  db61e5b
- docs(CLAUDE): PYTHONPATH-shadow recipe for testing a library build in-container
  
  cailmdaley
  and
  claude
  committed
  ade9cf3
- fix(hsm): store true e-type distortion in E*_HSM columns, not g-type shear
  
  cailmdaley
  and
  claude
  committed
  98e822a
- refactor(hsm): one column grammar for HSM star/PSF moments, size stored as T
  
  cailmdaley
  and
  claude
  committed
  4b17f7e
- refactor: remove the spread_model pipeline module (unused, never cut on)
  
  cailmdaley
  and
  claude
  committed
  85a18ab
- refactor(make_cat): one column grammar for ngmix, galsim & HSM-sink columns
  
  cailmdaley
  and
  claude
  committed
  4f0756d
- build: track cs_util @ develop (git ref) for the size/shape helpers
  
  cailmdaley
  and
  claude
  committed
  f9a8f05
Commits on Jul 1, 2026
- Go back to g-type ellipticities
  Sacha Guerrini
  committed
  d5b3e92
- Rename the HSM columns with G1/2 instead of E1/2
  Sacha Guerrini
  committed
  7d527d3
- (fix) Remaining E1/2 HSM column instead of G1/2
  Sacha Guerrini
  committed
  0df4f2c
- (fix) Change the HSM label in the associated pytest
  Sacha Guerrini
  committed
  726207b
- (fix) Non-passing test because test was based on e-type ellipticity instead of g-type
  Sacha Guerrini
  committed
  bcf4def
- (fix) Fix the magnitude comparison test between e- and g-type ellipticities.
  Sacha Guerrini
  committed
  c5b428b
- ngmix: give the PSF observation a finite weight map (#749) (#779)
  
  cailmdaley
  and
  claude
  authored
  66b338d
- refactor(make_cat): remove the dead galsim shape serialization path
  
  cailmdaley
  and
  claude
  committed
  e036a95
- refactor(make_cat): restrict SHAPE_MEASUREMENT_TYPE to ngmix
  
  cailmdaley
  and
  claude
  committed
  df84064
- test: drop galsim from the frozen column-grammar examples
  
  cailmdaley
  and
  claude
  committed
  1c69af5
Commits on Jul 3, 2026
- Revert "remove the galsim dead shape path" — carve out of #761
  
  cailmdaley
  and
  claude
  committed
  de138b6
- Restore spread_model to #761 — it does not belong in this PR
  
  cailmdaley
  and
  claude
  committed
  714847c
- fix(spread_model): read PSF size under the new HSM grammar
  
  cailmdaley
  and
  claude
  committed
  e9bfd53
- Merge pull request #761 from CosmoStat/refactor/psf-column-grammar
  cailmdaley
  authored
  c2d03c3
- fix(make_cat): read the HSM g-type PSF columns the producers write
  
  cailmdaley
  and
  claude
  committed
  662fad4

Commits

Commits on Jan 9, 2023

Commits on Jan 12, 2023

Commits on Jan 17, 2023

Commits on Oct 15, 2023

Commits on Oct 16, 2023

Commits on Oct 17, 2023

Commits on Oct 18, 2023

Commits on Feb 2, 2026

Commits on Apr 25, 2026

Commits on Apr 26, 2026

Commits on Apr 27, 2026

Commits on Apr 28, 2026

Commits on May 4, 2026

Commits on May 5, 2026

Commits on May 6, 2026

Commits on May 7, 2026

Commits on May 9, 2026

Commits on May 10, 2026

Commits on May 12, 2026

Commits on May 13, 2026

Commits on May 14, 2026

Commits on May 15, 2026

Commits on May 16, 2026

Commits on May 18, 2026

Commits on May 20, 2026

Commits on May 21, 2026

Commits on May 22, 2026

Commits on Jun 1, 2026

Commits on Jun 2, 2026

Commits on Jun 5, 2026

Commits on Jun 8, 2026

Commits on Jun 10, 2026

Commits on Jun 11, 2026

Commits on Jun 12, 2026

Commits on Jun 16, 2026

Commits on Jun 17, 2026

Commits on Jun 20, 2026