Add challenge 120: Fused AdamW (Medium) - #316
Open
adityasharmaaaaa wants to merge 2 commits into
Open
adityasharmaaaaa wants to merge 2 commits into
adityasharmaaaaa wants to merge 2 commits into
Conversation
adityasharmaaaaa
requested review from
ishaan-arya,
kunal-mansukhani and
shxjames
as code owners
August 26, 2026 16:44
Contributor
Review notes — not merging (challenge ID collision)
Challenge quality looks solid (decoupled AdamW reference, good edge cases, all 6 starters, CI green), but please renumber to a free ID (120+ after today's merges of 115/117/119) and update Thanks for the contribution — happy to merge once the ID is unique. |
adityasharmaaaaa
force-pushed
the
add-fused-adamw-challenge
branch
from
September 30, 2026 14:57
ede346c to
0bbfe96
Compare
Contributor
Author
|
@kunal-mansukhani Renumbered to 120 (folder is now challenges/medium/120_fused_adamw) and rebased on latest main. Ready for another look. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds a new challenge implementing a fused AdamW optimizer step (decoupled weight decay + bias-corrected first/second moment updates), covering params/m/v as in-place stateful tensors, a gap in the existing challenge set, which has no optimizer-related content despite covering PPO/DPO/GRPO/GAE losses. Includes starters for all 6 supported frameworks (CUDA, Mojo, CuTe, PyTorch, Triton, JAX), an example/functional/performance test suite (11 functional cases covering zero-grad, warm/cold optimizer state, extreme step counts, non-default betas, etc.), and a challenge.html writeup with two hand-verified worked examples. Verified pre-commit run --all-files passes (mojo-format excluded locally, no mojo binary installed) and ran reference_impl against every generated test case to confirm finite, valid output.