Skip to main content

Prompting is just telling it enough of the story.

The blank always fills with the most likely word. Prompt engineering is the plain act of telling a long enough story that the word you wanted becomes the likely one. You have done it since you learned to talk.

Ben Schmidt, PhD · ·6 min read

Read this and notice how fast it happens. We always finish each other’s ____. You did not decide anything. Before you chose to, your mind had already dropped a word into the blank, and it was almost certainly this one:

We always finish each other's ______

sentences

your brain filled in

Of course it was. Across everything you have ever heard, sentences is the most common way that phrase ends. Frozen built a gag on it because the reflex is that reliable. And a language model does the exact same thing you just did: hand it those five words and almost nothing else, and it returns the single most common continuation. That is the boring answer, the canned answer, the average of everyone who ever finished that sentence. Most of the time, the average is junk.

Now change the story

#

Two students are working through a brutal homework set, every night, for weeks. One of them is unreal at math and hopeless at writing. The other is the mirror image. So every night they trade: she explains the proof, he fixes her paragraphs, and somehow the impossible assignment keeps getting done. We always finish each other’s ____.

We always finish each other's ______

homework

now your brain says

Same five words. Nothing about the phrase changed. The blank moved because everything in front of it moved. You did not get smarter in the last paragraph. You got context, and the context made a different word the obvious one.

One more, faster. I could really go for a cold ____. You are already holding a drink, probably a beer. Now: she had been running for four hours in the August sun and crossed the finish line barely upright, and the first thing out of her mouth was, I could really go for a cold ____.

I could really go for a cold ______

beer

cold open

...four hours in the sun, and she said, I could really go for a cold ______

glass of water

after the story

That is the entire game

#

This is prompting. All of it. A model completes the most likely next word given everything that came before it. With no story, it gives you the median: the safe, the generic, the average of the whole internet, which is almost always the junk answer. With a story, it gives you the completion that fits the story. “Prompt engineering” is this and nothing more: putting enough in front of the blank that the word you actually wanted becomes the likely one. There is no secret syntax and no magic phrasing. There is the setup, and the setup does all the work.

Most blanks have more than one answer

#

Look back at that first blank. Sentences was the reflex, but it was never the only word that fit.

We always finish each other's ______

sentences · homework · thoughts · problems

all of these fit

Any of them reads fine. That is not a glitch in your head, it is the nature of the blank: most of them do not have one right answer, they have a field of plausible ones. A model works the same way, and it does not always take the top of the field. It samples from it. Ask it the exact same thing twice and it can hand you a different word each time, because there was never a single answer to land on, only a spread of likely ones.

This is why the same prompt can return two different responses, and why people call the output random. It is not random the way a coin is random. It is a pick from a field, and the field was wide because the prompt left it wide. That is exactly what the story narrows. The more of it you supply, the tighter the field gets, until the word you wanted is not just likely, it is nearly the only one left standing. A thin prompt is a wide blank and a coin toss. A full story is a narrow blank and a word you can almost count on. Same mechanism, turned up.

Some blanks are facts, not defaults

#

But not every blank moves, and this is the part worth slowing down for. Roses are red, violets are ____.

Roses are red, violets are ______

blue

no story changes this one

No scene you invent will get a competent model to answer that differently, because blue is not a default it is guessing at. It is a fact it actually holds, and context cannot bully a model out of something it truly knows. That line is the whole skill. When the model is guessing the median, your story steers it. When it genuinely knows, your story cannot move it, and it should not. And the dangerous case is the third one: when the model does not know, but answers with the same flat confidence it used for blue. Learning to feel the difference between a default, a fact, and a confident guess is the actual craft. It looks nothing like memorizing prompt templates.

You are the same machine

#

Here is the uncomfortable half. This is also how you work. You do not produce a sentence from nothing either. Every word you say is the most likely next word given a lifetime of context: every conversation, every book, every argument you lost. The reason your next sentence is good and a cold model’s is garbage is not that you are wiser. It is that you are running on an enormous story and the model was handed five words. Give a model the lifetime and the gap closes fast.

Which is exactly why the thing you never wrote down is the thing the machine cannot reconstruct. The reasoning behind a decision, the constraint that forced your hand, the option you already tried and rejected: that is the story, and the story is the intelligence. Most of yours was never moved anywhere it could be supplied to anyone, human or machine.

So when someone sells you prompt engineering as a new literacy, look hard at what they are charging for: the willingness to tell the story before you ask the question. The blank always fills with the most likely word. That is not a flaw to be trained around, it is the entire mechanism, and your only job, the whole job, is to make the word you want the most likely one. You have been doing it since you learned to talk. They just call it prompting now.

The AI & Learning Field Report

Field notes on AI and how people actually learn.

What is real, what is hype, and what the evidence actually says. The reports land here first; subscribers get them in their inbox. No spam, no funnel theater.