Local LLMs and Retrieval Augmented Generation (RAG) on personal documents

Notebooks:

Notebooks and code for examples on running local LLMs with RAG over personal documents

Mistral 7b with RAG and Chroma vector DB to chat with downloaded PDFs

Colab link

Run the colab notebook to start playing.

Chat with and Explore Schrodinger's essay collection What is life?, and the classic Feynman Lectures on physics. -

Credits

references:

Code:

Github: jai-llm / RAG_Docs_LLaMA2 repo: RAG_HastieBooks_chromaDB_V3 notebook

Github: madhavthaker1 / llm repo : Conversational RAG notebook

• Accompanying blog post

Llamaindex guide: RAG over personal documents

Data:

(PDF) What is Life? by Erwin Schrodinger

(PDF) Feynman Lectures on Physics

Andrej Karpathy Blog: Software 2.0

Todo's

Right now, system runs in colab on free tier. Add local hosting configuration guide to run on premise.