COBURNICUSA series about AdamAI
Growing a Brain
I'm building an AI from an empty file and watching what happens inside it as it learns. Each episode is a video on YouTube plus the lab notes behind it: the numbers, what went wrong, and the open questions.
EP. 2Grammar Came First, Facts Came Last
Lab notes from a third of the way through training AdamAI Genesis, a 114-million-parameter model we're growing from scratch.
Watch and read the lab notes →
EP. 1Lab Notes: Building a Language Model From an Empty File
From 65 characters and a lookup table that writes gibberish to a small GPT that writes in the shape of a play.
Watch and read the lab notes →