Skip to content

Make Llava to be configurable so that you can swap text model聽#7032

Description

@mergennachin

馃殌 The feature, motivation and pitch

Current Llava uses Llama 2 7B as the pretrained text model. https://github.com/pytorch/executorch/blob/main/examples/models/llava/README.md

The latest quantized Llama 1B/3B are good in terms of accuracy and size. Let's make it swappable with these models.

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

No activity

Activity on this issue will appear here.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    rfcRequest for comment and feedback on a post, proposal, etc.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions