Please add prompt caching to Jev-style models

Evan Schwartz discusses the importance of adding prompt caching to Jev-style models for enhanced efficiency in handling batch queries in applications like Scour, a personalized content feed. He describes his experimental approach and findings while working with these models and advocates for improvements to their API to support reusable questions, focusing on cost-effective classification and content evaluation.