jasondew/tiny_llm

A decoder-only transformer language model in pure Elixir stdlib. No Nx, no autodiff, no tokenizer. 15,104 parameters, every gradient by hand. Companion to the talk "the llama who chases the dogs".

语言：Elixir · GitHub 星标：7 · Fork：0

话题：attention · elixir · from-scratch · machine-learning · transformer

在 GitHub 上查看原仓库