Answers aren’t actions

In the RAG module you built Larkspur Supply Co.’s assistant: it answers staff questions from company documents. It works. Now the support team wants more. They want it to check an order or issue a refund while a customer is on the phone.

This chapter: Can an assistant that answers from documents tell you where an order is right now?

You will learn

Why a model alone can only write text, never look something up
What happens when you ask it for live data anyway
Who has to do the acting: the software around the model

Words you’ll meet (3)

Model: The language model inside the assistant. It reads text in and writes text out; on its own it cannot open or change anything.
Order system: Larkspur’s live record of every order: customer, items, status and refunds.
Tool: Something the software around the model can run for it, such as looking up an order.

The picture on the left is live. Each step below asks you to do one thing in it; the story continues here as you go.

Step 1 of 5

This is the Larkspur assistant you built in the RAG module. A support lead has a customer on the phone and types a question about an order.