Claude API documentation (opens in a new tab)
The official reference for the tools used in this lesson.
Link
Tokens and context windows
Models read tokens, not characters, and they can only see a fixed window of them. Both your bill and your failures come back to this.
Lesson 1.111m 31sIntermediate26.4k students
Lesson length
11:31What this lesson covers
- Understand tokenisation and why cost is per token
- Budget a prompt against the context window
- Recognise the failure modes of an overflowing context
This lesson sits in LLM Fundamentals, part of Building AI Apps with LLMs. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will
- Understand tokenisation and why cost is per token
- Budget a prompt against the context window
- Recognise the failure modes of an overflowing context
Resources
Personal notes are coming soon.