Workbench: the context policy

You have every lever now: what goes in, where it sits, what is cached, what is cleared and what is remembered. Larkspur wants one policy for every conversation.

This chapter: Which context policy gives Larkspur good answers for the fewest tokens and the lowest cost?

You will learn

How the policies combine over a whole conversation
Reading answer quality, tokens and cost side by side
Why the policy that sends the most is rarely the best

Words you’ll meet (1)

Context policy: The host’s rules for building each window: what to retrieve, how to keep the history, and where to cache.

The picture on the left is live. Each step below asks you to do one thing in it; the story continues here as you go.

Step 1 of 4

A context policy is the host’s rules for building every window: how documents get in, how the history is kept, and where the cache sits. Larkspur’s first policy was the simplest: every document up front, the full history, no cache. Run it on Mara’s 3 questions.