Tinker Diffusion models

by Kondasamy Jayaraman · drawn with Colorfigures by April Zhu

300 dots of pure noise, waiting to develop.

Chapter 2 of 7

Step by step

The pictures come out clean, but each one takes many runs of the denoiser. The team wants to know what fewer would cost.

This chapter: What do you give up when you take fewer steps?

About this chapter

You will learn

  • Why each step is one run of the denoiser
  • Why fewer steps draw a rougher picture
  • Why the step count is a trade of cost against quality

Words you’ll meet

Step
One run of the denoiser: it guesses the clean picture and moves a little toward it.
Roughness
Here, how far the dots land from the hinge’s outline on average. 0 is a perfect drawing.
Cost
Here, how many times the denoiser runs to make one picture.

Step 1 of 3

A toy denoiser trained on the hinge’s outline draws it with 300 dots. Each is one run of the denoiser.

Predict first.

Drop from 50 steps to 5. What happens to the hinge?