Transformer

A Transformer is, at the time of writing(2026-08), the most popular architecture for building Large Language Models.

Intuition

Rongzhou's Transformer is a super charged next word prediction algorithm provides a short intuition for Transformers.

Interestingly, as the author explains himself, the story doubles as a live demonstration of Transformers, as parts of the story were co-authored by a Transformer model.