lumia431/photon_infer

A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching

语言：C++ · GitHub 星标：124 · Fork：7

话题：ai-infra · continuous-batching · inference-engine · llm-inference · modern-cpp · paged-attention · vllm

在 GitHub 上查看原仓库