Language Models Intermediate

Reasoning Model

A language model that works through steps before it answers

Key points
  • A reasoning model works through a long stretch of intermediate steps before it produces an answer.
  • It's trained so that spending more time before answering raises the odds of getting it right.
  • What shows up on screen is one polished answer, but an unseen process sits behind it.
  • The tradeoff is slow and expensive. For a simple question, it's actually a worse deal.
  • A process that sounds convincing still isn't guaranteed to be correct. Reasoning at length doesn't make the answer right.
Contents

1The analogy

The night before a show, backstage runs the same scene over and over. The lighting cues get reordered, the spot where a line trips up gets found and fixed, and if something feels off, it goes back to the top for another pass. The audience in their seats never sees any of this. What they get is one polished performance.

A reasoning model works the same way. Given a question, it doesn't write the answer straight away — it runs through several passes backstage first. It checks each condition one at a time, backs up when something doesn't line up, tries a different order. Only the result of all that gets sent up as the answer.

A long rehearsal means the curtain rises late. Nobody rehearses all day for a two-line greeting. The same tradeoff shows up whenever a reasoning model gets used.

2In detail

It runs itself through one more pass before answering

An ordinary language model starts writing the first piece of an answer the moment it gets a question. There's no going back if an earlier line turns out wrong, so opening in the wrong direction drags the rest along with it. That's where oddly wrong answers on hard problems tend to come from.

A reasoning model writes a long stretch to itself before it starts the answer. It breaks the problem into pieces, checks each condition, plugs a middle value back in, and backs up to try a different path when something's off. Only once that's done does it write out a polished answer for the user.

There's no separate mechanism bolted on underneath. It's still choosing the next piece one at a time — it's just spending those pieces on checking its own work first, instead of on the answer.

The longer it works, the better the answer gets

A reasoning model's character comes from how it's trained. Instead of a person writing out the correct steps line by line, it's taught by rewarding whichever of several self-generated solution paths lands on the right final answer. The model then picks up, on its own, the habit of raising its odds of being right — checking once more, backing up when something looks doubtful, verifying by a different method.

That training hands a reasoning model a dial nothing else has: how long to run before writing the answer. Turn that dial up and the middle process gets longer, and accuracy climbs on harder problems. Answer quality can effectively be bought without retraining anything.

It doesn't climb forever, though. Past a certain point, only time grows while the answer stays the same. Thinking longer about a fact it doesn't know still doesn't make it known.

What's shown backstage is just a summary

Plenty of services don't show the middle process in full. Instead, short summaries stream by: "checking," "trying a different method." What actually happened runs far longer, sometimes stalls or loops in place, and sometimes contains parts that contradict the final answer.

This process costs too, in the amount it's billed for. A two-line answer on screen can sit behind text dozens of times longer generated out of view. That's usually where a bill that seems oddly large next to a short answer comes from.

Not every question needs a rehearsal

A reasoning model clearly wins on problems where several conditions must hold at once, where each step's calculation feeds the next, or where missing one condition wrecks the whole answer. Scheduling, calculations with tangled rules, or tracking down a bug in code all fall here.

On the flip side, translation, polishing a sentence, summarizing material, a quick fact check — anything that lands in one pass — barely benefits. The wait for the answer just multiplies, and cost climbs right along with it. This is exactly why newer services try to gauge a question's difficulty and adjust how long to think automatically.

3More precisely

A reasoning model isn't a different kind of machine with a different structure. It's the same kind of language model, with training and usage layered on top that make it generate a long intermediate process before answering. Reinforcement learning that rewards whether the final answer was correct is what gets used here, rather than a person writing out each correct step by hand.

The analogy breaks down somewhere. In a rehearsal, a person knows what went wrong and fixes it; a model's middle process isn't fixing things while already knowing the right answer. It's closer to continuing to write text shaped like a check. That's how a model can write "double-checked, this is correct" in the middle and still land on a wrong answer. The process summary shown on screen isn't really a record of calculation that happened underneath, either — it's closer to being one more piece of generated text in its own right, produced the same way the final answer is. That's the reason a logical-looking process shouldn't be trusted to mean the calculation actually flowed in that order.

4Try it yourself

5Common misconceptions

  • It's easy to think a reasoning model thinks the way a person does, but actually it's the same act of picking the next piece one at a time, just spent on a middle process instead of the answer.

  • It's easy to think a long process means a correct answer, but actually a long, plausible-sounding process landing on a wrong conclusion happens all the time.

  • It's easy to think a reasoning model is always the better choice, but actually on simple tasks it's just slower and more expensive.

7One-line summary

In shortA reasoning model works through a long process backstage before it shows an answer, and the price for that is more time and more cost.

Spotted an error or have a better analogy? Suggest an edit · Last updated2026-09-02