Skip to content

refactor: unify causal VLMs into the causal-lm framework. - #2744

Draft
wai-bao wants to merge 1 commit into
xLLM-AI:mainfrom
wai-bao:refactor/simplify-vlm-unify-cleanup
Draft

refactor: unify causal VLMs into the causal-lm framework.#2744
wai-bao wants to merge 1 commit into
xLLM-AI:mainfrom
wai-bao:refactor/simplify-vlm-unify-cleanup

Conversation

@wai-bao

@wai-bao wai-bao commented Nov 14, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Summary

  • Use the causal-LM registration and creation APIs for language and multimodal models, carrying backend selection through ModelContext.
  • Discover multimodal routing from the registered processor without separate backend registration.
  • Preserve checkpoint loading and reuse existing model bases, embedding merge, and model argument loaders.
  • Remove duplicate tests, test-only interfaces, unused code, and unrelated naming and comment changes.

Validation

  • C++ formatting, license checks, and Python formatting/lint passed.
  • Full static checks remain incomplete.
  • Native compilation, runtime behavior, and performance were not validated for this update.

@netlify

netlify Bot commented Nov 14, 2026 •
edited
Loading

Copy link
Copy Markdown

✅ Netlify Deploy Preview ready

Built without sensitive environment variables

Name Link
🔨 Latest commit eb3c069
🔍 Latest deploy log https://app.netlify.com/projects/xllm-docs-preview/deploys/6af966f034e5f94d685ea970
😎 Deploy Preview https://deploy-preview-2744--xllm-docs-preview.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
🤖 Make changes Run an agent on this branch

To edit notification comments on pull requests, go to your Netlify project configuration.

@wai-bao
wai-bao force-pushed the refactor/simplify-vlm-unify-cleanup branch 2 times, most recently from f379cf8 to f89f3e2 Compare November 15, 2026 00:55
@wai-bao
wai-bao force-pushed the refactor/simplify-vlm-unify-cleanup branch from f89f3e2 to eb3c069 Compare November 15, 2026 08:01

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@liutongxuan liutongxuan Awaiting requested review from liutongxuan liutongxuan will be requested when the pull request is marked ready for review liutongxuan is a code owner
@JimHsiung JimHsiung Awaiting requested review from JimHsiung JimHsiung will be requested when the pull request is marked ready for review JimHsiung is a code owner
@DongheJin DongheJin Awaiting requested review from DongheJin DongheJin will be requested when the pull request is marked ready for review DongheJin is a code owner
@yingxudeng yingxudeng Awaiting requested review from yingxudeng yingxudeng will be requested when the pull request is marked ready for review yingxudeng is a code owner
@Kang-Meng Kang-Meng Awaiting requested review from Kang-Meng Kang-Meng will be requested when the pull request is marked ready for review Kang-Meng is a code owner
@DragonFive DragonFive Awaiting requested review from DragonFive DragonFive will be requested when the pull request is marked ready for review DragonFive is a code owner
@zhang-minchao zhang-minchao Awaiting requested review from zhang-minchao zhang-minchao will be requested when the pull request is marked ready for review zhang-minchao is a code owner
@xiao-yu-chen xiao-yu-chen Awaiting requested review from xiao-yu-chen xiao-yu-chen will be requested when the pull request is marked ready for review xiao-yu-chen is a code owner
@XuZhang99 XuZhang99 Awaiting requested review from XuZhang99 XuZhang99 will be requested when the pull request is marked ready for review XuZhang99 is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@wai-bao