zkry/tiktoken.el

tiktoken.el is an Emacs Lisp port of OpenAI's tiktoken library for BPE tokenization

语言：Emacs Lisp · GitHub 星标：13 · Fork：5

话题：artificial-intelligence · emacs-lisp · large-language-models · natural-language-processing

在 GitHub 上查看原仓库