Part 2 ยท LLMs

What is a Large Language Model?

An LLM is an enormous neural network trained on massive amounts of text. Before anything else, let's kill the biggest myth.

Myth โœ—

Not a Database

ChatGPT doesn't store Wikipedia, articles, or a giant text file. It cannot "search" its own memory for a specific fact.

Reality โœ“

A Massive Equation

It is a gigantic mathematical equation with billions of variables called weights or parameters. GPT-4 has ~1.7 trillion.

Analogy

The Chef Analogy

Like a chef who has tasted every dish in the world. They don't memorize recipes โ€” they internalize flavor profiles (weights).