Skip to content

feat: add private local RAG quickstart with Ollama - #7

Open
mhbuehler wants to merge 1 commit into
crewAIInc:mainfrom
mhbuehler:local-rag
Open

mhbuehler wants to merge 1 commit into
crewAIInc:mainfrom
mhbuehler:local-rag

Conversation

@mhbuehler

Copy link
Copy Markdown

Summary

  • Add a private local RAG quickstart using CrewAI Knowledge and Ollama.
  • Use Sentence Transformers for local embeddings and ChromaDB for storage.
  • Demonstrate task guardrail validation and automatic accelerator selection.
  • Document Ollama as a model runtime option in the main README.

Validation

  • Executed the notebook end to end with llama3.2:3b.
  • Confirmed that execution produces a valid final response.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant