Tinker“ buyers see how much is␣left before the” and 4 tokens of room.
Chapter 5 of 7
The length is fixed
Before the first pass, the frame needs a size. Larkspur’s team tries one release-note phrase at several reply lengths.
This chapter: What happens when a reply’s length is set before it is written?
About this chapter
You will learn
- Why the frame’s size is chosen first
- How the model shapes a reply to fit it
- Which replies suit a fixed length
Words you’ll meet
- Reply length
- How many blank slots the frame holds. The model fills every one, no more and no fewer.
- End-of-text token
- A token that marks where a reply ends. Real models pad a long frame with it.
Step 1 of 3
The is set before the first pass: the frame holds exactly that many blanks, and every one gets a token.
Predict first.