> However, we also try to leverage prompt-caching as much as possible to lower c... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		handfuloflight 10 months ago \| parent \| context \| favorite \| on: Launch HN: Codebuff (YC F24) – CLI tool that write... > However, we also try to leverage prompt-caching as much as possible to lower costs and improve latency. Interesting! That does have 5 minute expiry on Claude, and your users can use Codebuff in an unoptimal way. Do you have plans in aligning your users towards using the tool in a way that makes the most use of prompt caches?

jahooma 10 months ago [–]

That's a really great point. Since we manage the context, we should clear the old files if it's been > 5 minutes. Thanks for the idea!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact