test-dynamo(0711): add dynamo causal-lm test infra + fix gemma3 and qwen3_moe subfunction export - #1174
Draft
vbaddi wants to merge 30 commits into
Draft
test-dynamo(0711): add dynamo causal-lm test infra + fix gemma3 and qwen3_moe subfunction export#1174vbaddi wants to merge 30 commits into
vbaddi wants to merge 30 commits into
Conversation
Squash of prior dynamo work (16 WIP commits) into a single commit to simplify rebase onto mainline. Original history preserved at tag backup/before-rebase-20260501-212703. Contents: - Enable torch.dynamo-based export with inline compiler across causal LMs, VLMs, embedding, ASR models. - Subfunction extraction / nested compile region utilities. - Torch patches and custom-op utils consolidated under QEfficient/utils. - Dynamo-specific tests and e2e example. (cherry picked from commit 70f0cac) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
…r models Signed-off-by: vbaddi <vbaddi@qti.qualcomm.com> (cherry picked from commit 087f8d4) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: vbaddi <vbaddi@qti.qualcomm.com> (cherry picked from commit 5fa0d57) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
…ck previous commit, if this fails Signed-off-by: vbaddi <vbaddi@qti.qualcomm.com> (cherry picked from commit 2ca7b45) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
…mmit (nit(0502), if this fails Signed-off-by: vbaddi <vbaddi@qti.qualcomm.com> (cherry picked from commit 22d6385) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com> (cherry picked from commit 575545a) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com> (cherry picked from commit 806f2cf) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com> (cherry picked from commit 6dd6362) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com> (cherry picked from commit 3266f7c) Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
Signed-off-by: Sharvari Medhe <smedhe@qti.qualcomm.com>
…en3_moe subfunction export Signed-off-by: vbaddi <vbaddi@qti.qualcomm.com>
Signed-off-by: vbaddi <vbaddi@qti.qualcomm.com>
amarquic
added a commit
to amarquic/efficient-transformers
that referenced
this pull request
Jul 14, 2026
Creates tests/dynamo/ following the same structure as PR quic#1174: - conftest.py: markers, dynamo_workdir fixture, xdist-safe result capture, HTML/JSON report generation - utils/hash_manager.py: blake2b-keyed workdirs (collision-safe under -n auto) - utils/hardware_manager.py: file-lock QAIC device pool for HW lanes - utils/report_generator.py: HTML + JSON coverage matrix output Extends DynamoModelSpec in model_registry.py with two new flags: weight_free_supported - True for all validated causal LM architectures weight_free_cb_supported - True for all architectures where CB is also verified Both flags False for VLM text-side models (out of scope for this PR) Adds tests/dynamo/causal_lm/test_weight_free.py with 4 CPU-only lanes: 1. test_weight_free_export - meta-device export produces ONNX + weight_spec.json 2. test_weight_free_no_embedded_weights - ONNX has no large embedded initializers 3. test_weight_free_spec_coverage - all spec keys resolve in prepared_checkpoint/ 4. test_weight_free_cb_export - continuous_batching=True export produces artifacts All lanes are @pytest.mark.dynamo_export (CPU, no QAIC hardware) and @pytest.mark.regular. Run with: pytest tests/dynamo/causal_lm/test_weight_free.py -m 'dynamo_export' -n auto Signed-off-by: Amar <amarshar@qti.qualcomm.com>
quic-amitraj
force-pushed
the
quic-enable-dynamo-for-causallm
branch
5 times, most recently
from
July 23, 2026 15:03
7e7959d to
1f893d5
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
tests/dynamo/causal_lm/— a test suite for theuse_dynamo=Trueexport path (PR #1169).Covers 32 architectures across 16 feature columns: export, FP16/BF16/MXFP6/MXINT8 compile, CPU parity (HF PT == QEff PT == ORT), HW parity (ORT == QAIC FP16), CB, blocking-KV, sampler, prefix caching, and multi-device (CCL). HTML + JSON report generated on every run.Parallelism model:
Two model fixes required for the subfunction lane to pass:
QEffSlidingWindowCache.from_legacy_cache.QEffQwen3MoeExperts.__qeff_init__.