A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
-
Updated
Jan 3, 2025 - Python
#
semantic-cache
Here are 10 public repositories matching this topic...
Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.
python redis openai embedding vector-search vector-database large-language-models llm semantic-cache retrieval-augmented-generation llmcache
-
Updated
Feb 15, 2025 - Python
This is a RAG based chatbot in which semantic cache and guardrails have been incorporated.
-
Updated
Nov 11, 2024 - HTML
Enhance LLM retrieval performance with Azure Cosmos DB Semantic Cache. Learn how to integrate and optimize caching strategies in real-world web applications.
-
Updated
Mar 22, 2024 - Python
Redis Vector Similarity Search, Semantic Caching, Recommendation Systems and RAG
redis vector vector-search llm semantic-cache redis-vector-search retrieval-augmented-generation dalle-3
-
Updated
Apr 3, 2024 - Python
A ChatBot using Redis Vector Similarity Search, which can recommend blogs based on user prompt
python redis chatbot vector-search vector-database sentence-transformers huggingface-transformers large-language-models llm generative-ai semantic-cache redis-vector-search llmcache
-
Updated
Sep 30, 2023 - Python
RAG Application with Optimizations on HNSW Index, Quantization, Hybrid Search and Semantic Caching
quantization hnsw huggingface hybrid-search large-language-models splade qdrant-vector-database semantic-cache retrieval-augmented-generation
-
Updated
Nov 6, 2024 - Python
Semantic cache for your LLM apps in Go!
-
Updated
May 17, 2024 - Go
Redis Database offers unique capability to keep your data fresh while serving through LLM chatbot
redis openai text-to-sql vector-search vector-database langchain semantic-cache langchain-python langsmith redisvl
-
Updated
Jul 16, 2024 - Python
This repository contains sample code demonstrating how to implement a verified semantic cache using Amazon Bedrock Knowledge Bases to prevent hallucinations in Large Language Model (LLM) responses while improving latency and reducing costs.
agent aws demo bedrock rag aws-blog llm semantic-cache llm-agent amazon-bedrock amazon-bedrock-agents amazon-bedrock-knowledge-bases
-
Updated
Feb 3, 2025 - Jupyter Notebook
Improve this page
Add a description, image, and links to the semantic-cache topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the semantic-cache topic, visit your repo's landing page and select "manage topics."