Original · 2059739380785271033 · vitalik.eth @VitalikButerin · 2026-05-27 · en X

Citaba a · 2039577760935657677 · vitalik.eth @VitalikButerin · 2026-04-02 · en X

My self-sovereign / local / private / secure LLM setup, April 2026

https://t.co/zmG8wrg7pQ

Updates since then:

* Deepseek v4 is out. There *is* a 2-bit quant that can run within 90 GB ( https://t.co/X3AFAsiH02 ), and it works, however it's only fast on Apple hardware (I've head ~35 tok/s). On AMD, it's ~7 tok/s. IMO actually taking the effort to properly support more

RT @VitalikButerin: Updates since then:

* Deepseek v4 is out. There *is* a 2-bit quant that can run within 90 GB ( https://t.co/X3AFAsiH02…