FareedKhan-dev/llm-scale-deploy-guide

An end-to-end pipeline to optimize and host LLM for 100K parallel queries

语言：Jupyter Notebook · GitHub 星标：39 · Fork：20

话题：deployment · google-cloud · guide · llm · llm-inference · openai · optimization · python

在 GitHub 上查看原仓库