Tinker Diffusion language models

by Samy (Kondasamy Jayaraman) · drawn with Colorfigures by April Zhu

Loading the toy masked model

Customer answers: “ years, to meet tax rules.↵↵Q:”

Chapter 7 of 7

Workbench: speed per kind of reply

Larkspur will use the vendor’s model for several kinds of reply, each with its own bar. The team needs a setting per kind.

This chapter: How many tokens a pass, and which remasking, does each kind of reply need?

About this chapter

You will learn

  • How to pick tokens a pass for each kind of reply
  • Why the fewest passes that pass every bar wins
  • Why the answer differs per kind

Words you’ll meet

Plan
Tokens a pass and a remasking rule for each kind of reply.
Bar
What a reply must keep to pass, set by the team for each kind.
Workbench
The chapter’s free-play bench: change the plan and see every result.

Step 1 of 2

The vendor’s default: 8 tokens a pass, surest first, everywhere. The best clears every in 22 passes.

Change the plan on the .

1 of 3 kinds pass · 6 passesBEST IS 22

Your plan, case by case: one pinned phrase each
CaseSame as carefulRepeats
Customer answers: 8 tokens a pass, surest first · 2 passes · failsBar: at least 16 of 16 the same as careful, at most 15 repeats. Sent to customers as written: only the careful reply, token for token.
“ years, to meet tax rules.↵↵Q:” → “ Wove the a a a cat the the the a fee”1 of 16 · too far5
“ A: Yes, for quality and training. Rec” → “e.. The warehouse.↵↵.↵↵↵Aepe:”5 of 16 · too far4
“ have completed their first three months. Teams” → “: Portal..↵↵↵↵Teesss.↵”4 of 16 · too far7
“ or other equipment.↵↵Security: work” → “ e the travels: theip the theed in the the the the the”1 of 16 · too far5
Release-note drafts: 8 tokens a pass, surest first · 2 passes · failsBar: at most 2 repeats. An editor rewrites them, but stutters waste the editor’s time: at most 2 repeats.
“ keys are created by the customer admin.↵↵A” → “ccessu: the the the customerided to the Portal us::”1 of 163 · too many
“ buyers see how much is␣left before the” → “ sentment.↵↵↵↵↵↵Aepent.↵↵”1 of 166 · too many
Internal notes: 8 tokens a pass, surest first · 2 passes · passesBar: at most 5 repeats. Staff skim them and want them fast: at most 5 repeats.
“ can carry the rated load of␣900 kilogr” → “al..m. The↵nssals....”1 of 165
“ every bay to the floor with the supplied bol” → “id...↵↵↵.mm.␣ods.”3 of 165
“ safety boots and high-visibility” → “ verses. The warehouse.↵↵↵↵Furs..”4 of 164
“ operators may drive forklifts. Cer” → “on... The↵lics... Cms.”3 of 164

Larkspur’s toy masked model: Larkspur mini’s size, trained once on Larkspur’s documents and run live in your browser. It shows the mechanism; its replies are not what a production model writes.

Customer answers
Release-note drafts
Internal notes