Prompt caching is a prefix problem
Prompt caching reads cost a tenth of input on most tiers. The prefix that qualifies runs 512 to 4,096 tokens, and that floor picks your cheapest model.
Articles
Blog
Practical notes on building, deploying, and shipping real products for solo devs and small teams.