---
id: "1884576523862331845"
user: "alve_om"
name: "Om Alve"
status: ok
url: "https://x.com/alve_om/status/1884576523862331845"
---

So I pre-trained an LLM from scratch this week, yes, pretrained not finetuned. This is how it went - A thread 🧵