juhun32/bucket
semantic caching system for LLMs. performs edge-based vectorization in the browser and uses a go backend synchronized with AWS S3 to serve cached AI responses, cutting API costs, latency, and potential carbon emissions.
正在读取项目信息…
semantic caching system for LLMs. performs edge-based vectorization in the browser and uses a go backend synchronized with AWS S3 to serve cached AI responses, cutting API costs, latency, and potential carbon emissions.