TinkerWorst search: “label printer jams”, 0 of 2 right pages in the top 5.“label”: 23 pages · “printer”: 9 pages · “jams”: 0 pages · top: Wren WL-4 Quick Start, p. 1
Chapter 7 of 7
Tune the search box
The team wrote test searches, each with the pages that answer it. Now every setting of the search box is on the bench.
This chapter: Which settings put the most right pages in the top five?
About this chapter
You will learn
- Precision and recall
- Why a blend beats either half
- Why test searches beat hunches
Words you’ll meet
- Precision
- Of the pages a search returns, the share that are right.
- Recall
- Of the right pages, the share the search returns.
Step 1 of 2
22 test searches with 35 right pages. and score each search’s top 5.
Find the best settings.
25 of 35 right pages in the top 5 BEST IS 32
| Search | Right in top 5 | Precision | Recall | Why |
|---|---|---|---|---|
| dock door sensor warranty | 1 of 2 | 20% | 50% | Missed DS-100 Dock Door Sensor Warranty, p. 2: ranked 8 |
| late fee on unpaid invoices | 2 of 2 | 40% | 100% | All found |
| who may drive forklifts | 2 of 2 | 40% | 100% | All found |
| two-step verification | 1 of 1 | 20% | 100% | All found |
| phishing test results | 2 of 2 | 40% | 100% | All found |
| trade-in credit for an old K2 | 1 of 1 | 20% | 100% | All found |
| where are the fire exits | 1 of 1 | 20% | 100% | All found |
| how long are call recordings kept | 1 of 2 | 20% | 50% | Missed Data Retention FAQ, p. 2: ranked 32 |
| label printer jams | 0 of 2 | 0% | 0% | Missed Warehouse Ops Sync, June 2024, p. 4: ranked 9 |
| refunds for subscriptions | 1 of 1 | 20% | 100% | All found |
| Kestrel K3 battery | 2 of 3 | 40% | 67% | Missed Kestrel K3 Launch FAQ, p. 4: ranked 9 |
| who approves purchases for engineering | 0 of 1 | 0% | 0% | Missed Internal Procurement Policy, p. 3: ranked 26 |
| HR-SB | 1 of 1 | 20% | 100% | All found |
| extension 4410 | 1 of 1 | 20% | 100% | All found |
| WR-4 | 1 of 1 | 20% | 100% | All found |
| logging in without a password | 0 of 1 | 0% | 0% | Missed Security Policy, p. 3: ranked 26 |
| money for a place to sleep on work trips | 1 of 2 | 20% | 50% | Missed Travel Policy (2018), p. 2: ranked 98 |
| hotel nightly limit | 1 of 2 | 20% | 50% | Missed Travel Policy (2025), p. 2: no word matched |
| the website was down and nobody could pay | 1 of 1 | 20% | 100% | All found |
| who pays to send back a faulty item | 1 of 2 | 20% | 50% | Missed Returns FAQ, p. 4: ranked 13 |
| Okonkwo-Hale | 2 of 2 | 40% | 100% | All found |
| net 45 | 2 of 2 | 40% | 100% | All found |
A teaching search box: Larkspur’s documents cut into RAG’s 32-word pages, searched as you watch. The right pages for each test search are this site’s labels.