No public sessions are scheduled right now —
get in touch to arrange one.
LLMs Unplugged is a set of hands-on teaching resources that demonstrate
how large language models work—no computers or coding required. You count
word patterns in a text, record them as tally marks on grid paper or physical
piles of paper cutouts, then roll dice to generate new text from those patterns.
After building a Language modelA system that predicts what text comes next based on patterns learned from training data. Your hand-built grid or cutouts spread is a language model.View in glossary
by hand, something clicks: you see that tools like ChatGPTOpenAI's chatbot, and probably the most well-known LLM product. On this site we often use "ChatGPT" as shorthand for any modern LLM chatbot---the concepts apply equally to Claude, Gemini, DeepSeek and others. The underlying principles are the same regardless of which product you use.View in glossary
work using the same basic principles, just at a vastly larger scale.
Since ChatGPT arrived in November 2022,
(most) everyone's using Language modelA system that predicts what text comes next based on patterns learned from training data. Your hand-built grid or cutouts spread is a language model.View in glossary
, yet most people have no real mental model of what's actually
happening under the hood. Understanding how these systems
work—not through metaphor or handwaving but through direct
experience—is what we're all about. These resources don't tell
you or your students what to think about the role of AI in society;
they give you a grounding for having that discussion, informed by
having done it yourself. No coding, no maths beyond counting and
percentages, and it works from primary school to the boardroom. More
in the FAQ.
Who made this?
LLMs Unplugged is a Cybernetic Studio project created by Dr. Ben Swift (PhD
Computer Science, 2012) at the ANU School of Cybernetics. But if you're
worried that you'll need a PhD in Computer Science to understand
it, rest assured—the whole point of these resources is to demonstrate
that you don't. There's more on the lineage, from CS Unplugged back to Shannon,
on the about page.
Contact
If you have questions, success stories about using these materials, or
would like to discuss adaptations or improvements you've made, get in
touch at ben.swift@anu.edu.au. If you'd like to hear about what cool stuff is going on at the
School of Cybernetics, then sign up for the mailing list.