vectorch-ai/ScaleLLM

A high-performance inference system for large language models, designed for production environments.

语言：C++ · GitHub 星标：498 · Fork：41

话题：cuda · efficiency · gpu · inference · llama · llama3 · llm · llm-inference

在 GitHub 上查看原仓库