Skip to content

fix: address stable model export failures - #240

Merged
regisss merged 2 commits into
huggingface:mainfrom
JakeStevens:fix-stable-model-export-failures
Jul 21, 2026
Merged

fix: address stable model export failures#240
regisss merged 2 commits into
huggingface:mainfrom
JakeStevens:fix-stable-model-export-failures

Conversation

@JakeStevens

Copy link
Copy Markdown
Collaborator

Summary:

  • Bound XLM-Roberta masked-LM dynamic sequence shapes to avoid ExecuTorch int_oo upper-bound failures.

  • Switch GPT-2 coverage to public openai-community/gpt2 and handle missing position_ids via cache_position.

  • Fix T5 dynamic encoder-length export by returning actual cross-attention K/V lengths instead of full static cross-cache buffers.

Test plan:

  • GPT-2 focused slow test passes.

  • XLM-Roberta direct main_export(..., "xnnpack") passes.

  • T5 translation/summarization pass for both xnnpack and portable.

@JakeStevens JakeStevens mentioned this pull request Jul 20, 2026
Summary:

- Bound XLM-Roberta masked-LM dynamic sequence shapes to avoid ExecuTorch int_oo upper-bound failures.

- Switch GPT-2 coverage to public openai-community/gpt2 and handle missing position_ids via cache_position.

- Fix T5 dynamic encoder-length export by returning actual cross-attention K/V lengths instead of full static cross-cache buffers.

Test plan:

- GPT-2 focused slow test passes.

- XLM-Roberta direct main_export(..., "xnnpack") passes.

- T5 translation/summarization pass for both xnnpack and portable.
@JakeStevens
JakeStevens force-pushed the fix-stable-model-export-failures branch from 34f6ce0 to 2fe5028 Compare July 20, 2026 20:00
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@JakeStevens

Copy link
Copy Markdown
Collaborator Author

Note: the failing tests are gemma3, llama, phi, phi4, qwen3. This PR resolved gp2, roberta, t5, which are all green now.

I will address the rest in a follow up PR, still debugging.

@regisss

regisss commented Jul 21, 2026

Copy link
Copy Markdown
Collaborator

Note: the failing tests are gemma3, llama, phi, phi4, qwen3. This PR resolved gp2, roberta, t5, which are all green now.

I will address the rest in a follow up PR, still debugging.

Sounds good. Can you just run make styleplease? It seems the code quality check failed.

@JakeStevens

Copy link
Copy Markdown
Collaborator Author

done, should pass lint now

@JakeStevens

Copy link
Copy Markdown
Collaborator Author

Proposed fix for the remaining failures:

#244

@regisss
regisss merged commit b05096a into huggingface:main Jul 21, 2026
81 of 86 checks passed
@JakeStevens
JakeStevens deleted the fix-stable-model-export-failures branch July 21, 2026 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants