#latency

1 hack

1.
Enable automatic prompt caching on multi-turn API chats (docs.anthropic.com)
Add a top-level cache_control ephemeral flag so growing conversation prefixes reuse cached tokens and cut API cost and latency.
0 points·13 hours ago·Usage & Limits·intermediate·discuss