Skip to content

Add Support for Kimi K2.5 Vision - #1108

Open
quic-mamta wants to merge 38 commits into
quic:mainfrom
quic-mamta:kimi_vision
Open

Add Support for Kimi K2.5 Vision#1108
quic-mamta wants to merge 38 commits into
quic:mainfrom
quic-mamta:kimi_vision

Conversation

@quic-mamta

@quic-mamta quic-mamta commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Summary

This PR adds QEff support for Kimi K2.5 Vision using a ConditionalGeneration flow designed for Dual-QPC execution, and updates our Transformers dependency to align with the required upstream APIs.

What’s included

• Added QEff Kimi K2.5 multimodal model support:
• New Kimi K2.5 config classes (text + vision).
• New Kimi K2.5 model implementation with:
• vision tower + projector integration,
• language decoder integration via DeepSeek-V3,
• multimodal input merging and generation path,
• export/runtime helpers (dummy inputs, dynamic axes, specializations, output naming).
• Added a Kimi K2.5 vision export example for Dual-QPC
• Added parity checks for vision and language models.

Validation

• Verified model wiring and transform registration are in place for Kimi K2.5 conditional generation flow.
• Verified export example script supports reduced-layer / expert-subset setup for iterative validation.

Example Script -
python examples/kimi_k2/export_kimi_k25_vision.py

Tests -
python examples/kimi_k2/test_kimi_k25.py

mamtsing added 7 commits June 19, 2026 16:13
…lQPC and upgrade TF

Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta quic-mamta changed the title Add Support for Kimi K 2.5 Vision Add Support for Kimi K2.5 Vision Jun 22, 2026
@quic-mamta
quic-mamta force-pushed the kimi_vision branch 3 times, most recently from b9557a3 to c3af323 Compare June 23, 2026 08:56
@quic-mamta
quic-mamta marked this pull request as draft June 23, 2026 09:03
@quic-mamta quic-mamta self-assigned this Jun 23, 2026
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta
quic-mamta requested review from ochougul and quic-rishinr and removed request for ochougul June 23, 2026 11:37
@quic-mamta
quic-mamta force-pushed the kimi_vision branch 2 times, most recently from e73f8e9 to e5c2056 Compare June 24, 2026 10:07
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta
quic-mamta force-pushed the kimi_vision branch 6 times, most recently from 6388273 to 9712a36 Compare June 30, 2026 13:45
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <168400541+quic-mamta@users.noreply.github.com>
@quic-mamta
quic-mamta force-pushed the kimi_vision branch 4 times, most recently from fe80ff9 to 710cd8b Compare July 20, 2026 21:15
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
mamtsing and others added 3 commits July 24, 2026 11:03
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <168400541+quic-mamta@users.noreply.github.com>
@quic-mamta
quic-mamta force-pushed the kimi_vision branch 3 times, most recently from d1b7de4 to 5557087 Compare July 24, 2026 18:33
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@github-advanced-security

Copy link
Copy Markdown

You are seeing this message because GitHub Code Scanning has recently been set up for this repository, or this pull request contains the workflow file for the Code Scanning tool.

What Enabling Code Scanning Means:

  • The 'Security' tab will display more code scanning analysis results (e.g., for the default branch).
  • Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results.
  • You will be able to see the analysis results for the pull request's branch on this overview once the scans have completed and the checks have passed.

For more information about GitHub Code Scanning, check out the documentation.

quic-mamta and others added 2 commits July 26, 2026 15:37
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-rishinr
quic-rishinr marked this pull request as ready for review July 27, 2026 10:10
Comment thread QEfficient/utils/load_kimi_utils.py Outdated
Comment thread QEfficient/utils/load_kimi_utils.py Outdated
Comment thread tests/utils/load_kimi_utils.py
Comment thread examples/kimi_k2/export_kimi_k25_vision.py
Comment thread QEfficient/transformers/models/kimi_k25/configuration_kimi_k25.py Outdated
Comment thread QEfficient/transformers/models/modeling_auto.py
Comment thread QEfficient/transformers/quantizers/quant_transforms.py
Comment thread tests/unit_test/models/test_model_quickcheck.py
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants