Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character. Comments URL: https://news.ycombinator.com/item?id=47655408 Points: 305 # Comments: 25
Originalartikel: Zum Artikel