// channel ✦
Education
Concepts explained properly. From attention to RLHF to eval design — written to be understood, not to impress.
2 dispatches in this channel
Education
What Is Mixture of Experts? The Architecture Behind the New Wave of Models
Mixture of Experts (MoE) is the dominant architecture in modern open-weights models. Here's how it works, why it matters, and what tradeoffs it introduces.
3 min read
Education
Transformers, Explained Like You're Building One
A builder's walkthrough of the transformer: tokens, attention, layers, and the training loop — with the intuition you need to actually reason about models.
1 min read