ChaitanyaK77/Building-a-Small-Language-Model-SLM-

This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.

语言：Jupyter Notebook · GitHub 星标：79 · Fork：23

话题：gpu-computing · llm · small-language-models · tokenization · transformer

在 GitHub 上查看原仓库