Repository navigation

Project the softmax parametrization exactly onto the capped simplex each step - #1096

Open

MaxGhenis wants to merge 30 commits into

mainfrom

softmax-exact-cap-projection

Commits on Sep 28, 2026
- Add the chi-square L2 basis and a softmax mass parametrization to Adam calibration
  
  MaxGhenis
  and
  claude
  committed
  f8a4bed
- Test the chi-square L2 basis and softmax mass parametrization
  
  MaxGhenis
  and
  claude
  committed
  7599cd1
- Plumb --l2-basis and --mass-parametrization through the ACS local tool
  
  MaxGhenis
  and
  claude
  committed
  fa8df5d
Commits on Sep 30, 2026
- Add the ACS local L2-basis sweep harness, optimizer reference and doc draft
  
  MaxGhenis
  and
  claude
  committed
  949599a
- Seed the ACS local sweep's prior from --acs-share; add seeding options and the Modal grid
  
  MaxGhenis
  and
  claude
  committed
  da7f465
- Make the sweep launcher importable inside its Modal container; add the frontier analysis
  
  MaxGhenis
  and
  claude
  committed
  35ad665
- Address review round 1: truthful provenance, derived test bounds, softmax cap receipt
  
  MaxGhenis
  and
  claude
  committed
  5e7203f
- State the projection stall's conditions and measure the gradient scale at full size
  
  MaxGhenis
  and
  claude
  committed
  1ba923c
- Extend the sweep grid with holdout at the knee and intermediate priors
  
  MaxGhenis
  and
  claude
  committed
  9ef71ed
- Merge origin/main (#1053 sparse ACS local tool) and fold the penalty options into its solver stamp
  
  MaxGhenis
  and
  claude
  committed
  30706e3
- Add a second holdout fold and projection at the held-out optimum to the sweep grid
  
  MaxGhenis
  and
  claude
  committed
  bc763cb
Commits on Oct 1, 2026
- Write up the ACS local L2-basis frontier: seeding, penalty, holdout, floors
  
  MaxGhenis
  and
  claude
  committed
  5888b65
- Add projection at lambda 0.03 to the ACS local frontier
  
  MaxGhenis
  and
  claude
  committed
  a471113
- Keep uv.lock at main's approved digest
  
  MaxGhenis
  and
  claude
  committed
  d9ea709
- Address review round 2: state the training-fit cost, the prior as a limit not a bound, and the merged resume stamp
  
  MaxGhenis
  and
  claude
  committed
  2e4d443
- Add head-equivalence reruns to the sweep grid
  
  MaxGhenis
  and
  claude
  committed
  d82ff85
- Address review round 3: recommend projection, state the softmax cap-loop limit, lead the gate with the relative floor
  
  MaxGhenis
  and
  claude
  committed
  8ebf901
- Merge remote-tracking branch 'origin/main' into l2-design-basis
  MaxGhenis
  committed
  51cef49
- Re-pin the spec-engine digests solve.py moves; compare path problems by fingerprint
  
  MaxGhenis
  and
  claude
  committed
  412c8f7
- Measure run-to-run variation; hold the held-out claim to "no worse"
  
  MaxGhenis
  and
  claude
  committed
  ab65596
- Address review round 4: pin every penalty flag in the recipe, receipt the published weights, keep claims inside the noise
  
  MaxGhenis
  and
  claude
  committed
  3dfe38d
- Address review round 5 nits: exact district minimum, frontier wording, changelog
  
  MaxGhenis
  and
  claude
  committed
  f8e48b2
- Re-pin the H1 calibrate parity case solve.py's edits move
  
  MaxGhenis
  and
  claude
  committed
  b115745
Commits on Oct 2, 2026
- Re-pin the loader golden vector solve.py's edits move
  
  MaxGhenis
  and
  claude
  committed
  b7b4c29
- Project the softmax parametrization's log-weights exactly onto the capped simplex
  
  MaxGhenis
  and
  claude
  committed
  9bca3f3
- Record the in-loop cap ratio in the ACS tool and sweep; add the full-scale cap-step launcher
  
  MaxGhenis
  and
  claude
  committed
  4bddde6
- Merge remote-tracking branch 'origin/l2-design-basis' into softmax-exact-cap-projection
  MaxGhenis
  committed
  1949e4b
- Measure the softmax cap step at full scale before and after the exact projection
  
  MaxGhenis
  and
  claude
  committed
  493eacf
- Run the float32 cap-step measurement on Modal; record why the 32-round loop ran out
  
  MaxGhenis
  and
  claude
  committed
  c4bf1d4
- Document the exact cap projection and its measurement; re-pin the digests solve.py moves
  
  MaxGhenis
  and
  claude
  committed
  16ff6eb

Navigation Menu

Repository navigation

Project the softmax parametrization exactly onto the capped simplex each step - #1096

Project the softmax parametrization exactly onto the capped simplex each step#1096
MaxGhenis wants to merge 30 commits into
mainfrom
softmax-exact-cap-projection

Commits on Sep 28, 2026

Add the chi-square L2 basis and a softmax mass parametrization to Adam calibration

Test the chi-square L2 basis and softmax mass parametrization

Plumb --l2-basis and --mass-parametrization through the ACS local tool

Commits on Sep 30, 2026

Add the ACS local L2-basis sweep harness, optimizer reference and doc draft

Seed the ACS local sweep's prior from --acs-share; add seeding options and the Modal grid

Make the sweep launcher importable inside its Modal container; add the frontier analysis

Address review round 1: truthful provenance, derived test bounds, softmax cap receipt

State the projection stall's conditions and measure the gradient scale at full size

Extend the sweep grid with holdout at the knee and intermediate priors

Merge origin/main (#1053 sparse ACS local tool) and fold the penalty options into its solver stamp

Add a second holdout fold and projection at the held-out optimum to the sweep grid

Commits on Oct 1, 2026

Write up the ACS local L2-basis frontier: seeding, penalty, holdout, floors

Add projection at lambda 0.03 to the ACS local frontier

Keep uv.lock at main's approved digest

Address review round 2: state the training-fit cost, the prior as a limit not a bound, and the merged resume stamp

Add head-equivalence reruns to the sweep grid

Address review round 3: recommend projection, state the softmax cap-loop limit, lead the gate with the relative floor

Merge remote-tracking branch 'origin/main' into l2-design-basis

Re-pin the spec-engine digests solve.py moves; compare path problems by fingerprint

Measure run-to-run variation; hold the held-out claim to "no worse"

Address review round 4: pin every penalty flag in the recipe, receipt the published weights, keep claims inside the noise

Address review round 5 nits: exact district minimum, frontier wording, changelog

Re-pin the H1 calibrate parity case solve.py's edits move

Commits on Oct 2, 2026

Re-pin the loader golden vector solve.py's edits move

Project the softmax parametrization's log-weights exactly onto the capped simplex

Record the in-loop cap ratio in the ACS tool and sweep; add the full-scale cap-step launcher

Merge remote-tracking branch 'origin/l2-design-basis' into softmax-exact-cap-projection

Measure the softmax cap step at full scale before and after the exact projection

Run the float32 cap-step measurement on Modal; record why the 32-round loop ran out

Document the exact cap projection and its measurement; re-pin the digests solve.py moves