LowinLi/transformers-stream-generator

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

语言：Python · GitHub 星标：95 · Fork：18

话题：gpt · stream-generator · text-generation

在 GitHub 上查看原仓库