Name		Name	Last commit message	Last commit date
Latest commit History 20 Commits
LICENSE		LICENSE
LlamaIndex_RAG.ipynb		LlamaIndex_RAG.ipynb
README.md		README.md

Repository files navigation

LlamaIndex RAG Chat

Perform RAG (Retrieval-Augmented Generation) from your PDFs using this Colab notebook!
Powered by Llama 2

Features

Free, no API or Token required
Fast inference on Colab's free T4 GPU
Powered by Hugging Face quantized LLMs (llama-cpp-python)
Powered by Hugging Face local text embedding models
Set custom prompt templates
Prepared Chat mode (not QA)

Getting started

Open in colab
Make sure the Colab's Runtime Type is set to T4 GPU (at least)
Edit preferences in Block 4
Upload your PDF into Files (Default name: rag_data.pdf)
Runtime > Run all

About

Perform RAG (Retrieval-Augmented Generation) from your PDFs using this Colab notebook! Powered by Llama 2

colab.research.google.com/github/kazcfz/LlamaIndex-RAG/blob/main/LlamaIndex_RAG.ipynb

ai chatbot transformers colab colab-notebook rag huggingface llm llama-index llamacpp retrieval-augmented-generation llama2 openllm

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%