aqstack/mimir

mimir is a drop-in proxy that caches LLM API responses using semantic similarity, reducing costs and latency for repeated or similar queries.

语言：Go · GitHub 星标：94 · Fork：33

话题：caching · cost-optimization · golang · kubernetes · llm · openai · proxy · semantic-cache

在 GitHub 上查看原仓库