modelize-ai/LLM-Inference-Deployment-Tutorial

Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inference engine.

语言：Python · GitHub 星标：19 · Fork：1

话题：gpt · inference · llama · llm · llm-inference · model-serving · transformer · tutorial

在 GitHub 上查看原仓库