Caching and inference costs

Coming soon — this article is being prepared. Below are its question, intended outcome, and place in the story.

The question

How can you test cache savings without reusing another user’s context?

What we will work through

Test cache savings without reusing another user’s context.

Before you begin

Previously covered: Authority boundaries.

• Authority boundaries