Machine Learning

1 article tagged Machine Learning.

An attention diagram showing how the word 'sat' attends to 'cat' and 'mat' most strongly in the sentence 'The cat sat on the mat.'

Apr 18, 20265 min read

Transformers, as I teach them

Strip away the math and what's left is surprisingly clean. Here's the mental model I use when I teach transformers, the architecture behind every modern LLM, to students who've never written a line of machine learning.