Post

OpenAI's 12-hour prompt cache write costs 2.5x input, so two requests 6 hours apart cost more than with the 30m default. It pays from the third reuse. Set request-wide, a chat cost 68% more. https://importstatic.com/ai/openai-12-hour-prompt-caching

importstatic.comTurn on OpenAI's 12-hour prompt cache for the shared prefix onlyOpenAI prompt caching now has a 12-hour lifetime at 2.5x the input price. It pays from the third reuse, and set request-wide it raised a chat's input cost 68%.

0 reposts0 likes

No replies yet.