Bedrock Adds 1-Hour Prompt Caching
AI Impact Summary
Amazon Bedrock is introducing 1-hour prompt caching, which can significantly improve retrieval performance and reduce the number of API calls made to the service. This change is beneficial for applications that rely heavily on prompt generation and retrieval, particularly those requiring fast response times and optimized costs. This capability enhances the overall efficiency of Bedrock for various use cases.
Affected Systems
Business Impact
Improved retrieval performance and reduced API costs for Bedrock applications.
Models affected
- Date
- Date not specified
- Change type
- capability
- Severity
- medium