Skip to content

cld2labs/llama-3.1-8b-instruct#98

Open
arpannookala-12 wants to merge 1 commit intoopea-project:mainfrom
cld2labs:cld2labs/llama-3.1-8b-instruct
Open

cld2labs/llama-3.1-8b-instruct#98
arpannookala-12 wants to merge 1 commit intoopea-project:mainfrom
cld2labs:cld2labs/llama-3.1-8b-instruct

Conversation

@arpannookala-12
Copy link
Copy Markdown
Contributor

Summary

  • Adds model card for llama-3.1-8b-instruct (Meta) under third_party/Dell/model-deployment/llama-3.1-8b-instruct/
  • Adds Helm-based deployment guide for deploying llama-3.1-8b-instruct via vLLM on Gaudi and CPU (Xeon) with Keycloak OIDC and APISIX ingress

…ell EI

Signed-off-by: arpannookala-12 <ganesh.arpan.nookala@cloud2labs.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant