di37/gemma3-270M-tinystories-pytorch

A complete PyTorch implementation of Google's Gemma3 270M language model, featuring sliding window attention, RoPE positional encoding, and efficient training infrastructure.

语言：Python · GitHub 星标：49 · Fork：7

在 GitHub 上查看原仓库