AXERA-TECH/ax-llm

Explore LLM model deployment based on AXera's AI chips, It provides OpenAI‑compatible APIs and supports AX620E, AX650 and AX637 series chips.

语言：C++ · GitHub 星标：170 · Fork：34

话题：axera · edge-computing · gemma2 · huggingface · internvl2 · llama3 · llm · minicpm

在 GitHub 上查看原仓库