Skip to main content

LLMs Unplugged Understand AI by building it from scratch, with pen, paper, and dice

Hands-on teaching resources that demonstrate how large language models (LLMs) work—no computers or coding required.

Workshop participants around a table of paper tokens, reaching towards a glowing die

No public sessions are scheduled right now — get in touch to arrange one.

LLMs Unplugged is a set of hands-on teaching resources that demonstrate how large language models work—no computers or coding required. You count word patterns in a text, record them as tally marks on grid paper or physical piles of paper cutouts, then roll dice to generate new text from those patterns. After building a Language model A system that predicts what text comes next based on patterns learned from training data. Your hand-built grid or cutouts spread is a language model. View in glossary by hand, something clicks: you see that tools like ChatGPT OpenAI's chatbot, and probably the most well-known LLM product. On this site we often use "ChatGPT" as shorthand for any modern LLM chatbot---the concepts apply equally to Claude, Gemini, DeepSeek and others. The underlying principles are the same regardless of which product you use. View in glossary work using the same basic principles, just at a vastly larger scale.

Where do you want to start?

Not sure? Start with My First Language Model—the classic LLMs Unplugged lesson, in lengths from 60 minutes to two hours.

What's new in LLMs Unplugged?

See all news →

Understanding AI through hands-on experience

Why does this matter?

Since ChatGPT arrived in November 2022, (most) everyone's using Language model A system that predicts what text comes next based on patterns learned from training data. Your hand-built grid or cutouts spread is a language model. View in glossary , yet most people have no real mental model of what's actually happening under the hood. Understanding how these systems work—not through metaphor or handwaving but through direct experience—is what we're all about. These resources don't tell you or your students what to think about the role of AI in society; they give you a grounding for having that discussion, informed by having done it yourself. No coding, no maths beyond counting and percentages, and it works from primary school to the boardroom. More in the FAQ.

Ben Swift

Who made this?

LLMs Unplugged is a Cybernetic Studio project created by Dr. Ben Swift (PhD Computer Science, 2012) at the ANU School of Cybernetics. But if you're worried that you'll need a PhD in Computer Science to understand it, rest assured—the whole point of these resources is to demonstrate that you don't. There's more on the lineage, from CS Unplugged back to Shannon, on the about page.

Connecting and sharing ideas

Contact

If you have questions, success stories about using these materials, or would like to discuss adaptations or improvements you've made, get in touch at ben.swift@anu.edu.au. If you'd like to hear about what cool stuff is going on at the School of Cybernetics, then sign up for the mailing list.