A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
-
Updated
Jun 30, 2025 - Python
#
semantic-cache
Here are 91 public repositories matching this topic...
Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.
python search redis mcp openai embedding redis-search vector-search huggingface vector-database large-language-models llm anthropic semantic-cache retrieval-augmented-generation llmcache
-
Updated
Jul 6, 2026 - Python
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
docker self-hosted model-serving gpu-monitoring fastapi llm openai-proxy semantic-cache local-llm ollama llm-proxy ollama-api ai-gateway llm-router self-hosted-ai ai-cache
-
Updated
May 10, 2026 - Python
Reliable and Efficient Semantic Prompt Caching with vCache
machine-learning consistency cache chatbot openai llama gpt verified memcache correctness semantic-search similarity-search rag vector-search guarantees vector-database llm vllm semantic-cache llm-memory
-
Updated
Dec 17, 2025 - Python
Redis integration for Google Agent Development Kit (ADK) - Memory, Sessions, Search Tools, MCP
redis memory semantic-search adk long-term-memory vector-search hybrid-search semantic-cache mcp-server agent-memory session-memory google-adk adk-python redis-agent-memory
-
Updated
Jun 29, 2026 - Python
Unified multi-layer caching library for AI/agent pipelines — LangChain, LangGraph, AutoGen, CrewAI, Agno, A2A
agent embeddings caching-strategies autogen rag caching-memory agno langchain semantic-cache langchain-python crewai langgraph aiagents llm-cache ai-cache gptcache-alternative
-
Updated
Jun 4, 2026 - Python
Transparent, transport-layer semantic cache for LLM API calls, powered by Redis 8 Vector Sets.
-
Updated
Jul 2, 2026 - Python
ToolOps is a framework-agnostic middleware SDK that treats every tool call as a first-class operation. By wrapping your tools in a single decorator, you instantly upgrade them with industrial-grade caching, resilience, and observability.
python agent redis tools ai cache prometheus python3 retry cache-storage python-sdk circuit-breaker resilience ai-agents opentelemetry langchain semantic-cache valkey agent-tools agentic-ai
-
Updated
May 30, 2026 - Python
High-performance LLM query cache with semantic search. Reduce API costs 80% and latency from 8.5s to 1ms using Redis + Qdrant vector DB. Multi-provider support (OpenAI, Anthropic).
redis embeddings openai cost-optimization rag fastapi vector-database qdrant semantic-cache llm-caching
-
Updated
Dec 2, 2025 - Python
AI real-estate automation platform: Telegram bot, RAG, apartment search, CRM workflows, voice agent, Langfuse observability, and Dockerized AI runtime.
real-estate python docker redis telegram-bot crm ai-agents aiogram rag fastapi voice-ai hybrid-search livekit qdrant llm semantic-cache kommo langfuse langgraph bge-m3
-
Updated
Jul 6, 2026 - Python
Enhance LLM retrieval performance with Azure Cosmos DB Semantic Cache. Learn how to integrate and optimize caching strategies in real-world web applications.
-
Updated
Mar 22, 2024 - Python
OpenAI-compatible LLM gateway: routes to the cheapest model meeting latency/quality targets, with SSE streaming, semantic caching, per-key rate limiting, and cost tracking.
redis postgres api-gateway rate-limiting gemini server-sent-events openai fastapi groq llm llmops semantic-cache
-
Updated
Jun 2, 2026 - Python
Multi-agent LangGraph assistant for Montreal urban mobility — RAG, semantic caching, and a predictive ML collision model on FastAPI.
python machine-learning assistant multi-agent copilot mobility rag fastapi ai-agent llm semantic-cache chromadb langgraph
-
Updated
Apr 16, 2026 - Python
Redis Vector Similarity Search, Semantic Caching, Recommendation Systems and RAG
redis vector vector-search llm semantic-cache redis-vector-search retrieval-augmented-generation dalle-3
-
Updated
Apr 3, 2024 - Python
A ChatBot using Redis Vector Similarity Search, which can recommend blogs based on user prompt
python redis chatbot vector-search vector-database sentence-transformers huggingface-transformers large-language-models llm generative-ai semantic-cache redis-vector-search llmcache
-
Updated
Sep 30, 2023 - Python
Optimized RAG Retrieval with Indexing, Quantization, Hybrid Search and Caching
quantization hnsw huggingface hybrid-search large-language-models splade qdrant-vector-database semantic-cache retrieval-augmented-generation
-
Updated
Nov 6, 2024 - Python
Semantic cache layer for LLM APIs — embed prompts locally, find near-matches, skip redundant LLM calls.
-
Updated
Mar 10, 2026 - Python
fastapi-semcache: Semantic caching for APIs & LLMs with pgvector, Redis, FastAPI middleware, and standalone proxy mode.
redis middleware async embeddings openai voyage cohere api-cache fastapi llm pgvector semantic-cache ollama
-
Updated
Jun 8, 2026 - Python
A universal open protocol for LLM semantic caching and cross-platform alignment (v0.1). High-efficiency semantic hashing based on S³ topology.
-
Updated
Apr 3, 2026 - Python
Enterprise RAG backend: hybrid retrieval (Qdrant + Elasticsearch), RRF fusion, cross-encoder reranking, RBAC, two-tier caching, guardrails, and grounded citations — streamed over SSE. FastAPI + Python. A prototype-scale rebuild of a real system-design case study.
python elasticsearch rbac enterprise-search reranking claude rag fastapi vector-search guardrails hybrid-search qdrant llm anthropic semantic-cache retrieval-augmented-generation
-
Updated
Jun 25, 2026 - Python
Improve this page
Add a description, image, and links to the semantic-cache topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the semantic-cache topic, visit your repo's landing page and select "manage topics."