Tinker Observability & error analysis

by Kondasamy Jayaraman · drawn with Colorfigures by April Zhu

Your bins, front left to rightSearch missed the passage: 0 · Answered from an old passage: 0 · Looked up the wrong order: 0 · Ignored what the tool returned: 0 · Promised a refund it can’t give: 0

Chapter 7 of 7

Workbench: a new day

The fix shipped. A new day brings a new queue of thumbs-down traces, and the team wants one fix for the week again.

This chapter: Given a fresh day of failed traces, which one fix should ship?

You will learn

  • Triage: labelling each failed trace with its mode
  • Reading the tally by count and harm together
  • How a wrong label can point you at the wrong fix
Words you’ll meet (1)
Triage
Sorting a queue of problems to decide which to deal with first.

The picture on the left is live. Each step below asks you to do one thing in it; the story continues here as you go.

Step 1 of 4

The fix shipped, and its eval cases joined the suite. A new day brings a new queue: the 9 traces customers marked with a thumbs-down. Open it.