Tinker9 rare requests, each answered by one or two documents.
Chapter 4 of 7
The teacher’s mistakes
The point was more rare requests. So the team asks Larkspur mini the rare questions, to write their answers.
This chapter: Can a model write good examples of what it never learned?
About this chapter
You will learn
- Why the teacher’s answers set the ceiling
- Why a sieve can’t catch a fluent wrong answer
- Where real examples must come from
Words you’ll meet
- Teacher
- The model that writes the synthetic data.
- Student
- The model trained on the teacher’s writing.
- Key fact
- The fact an answer must contain to be right, like “180 days”.
Step 1 of 4
The is the model that writes the examples. Here, Larkspur mini answers the 9 rare requests.
Predict first.