Amazon Bedrock Adds 1-Hour Prompt Caching
AI Impact Summary
Amazon Bedrock has introduced 1-hour prompt caching, which can improve performance and reduce redundant model calls by storing frequently accessed prompts. This change allows for faster response times and potentially lower API costs, particularly for applications with repetitive queries. This capability is a valuable optimization for Bedrock users.
Affected Systems
Business Impact
Improved application performance and reduced API costs for Bedrock users.
Models affected
- Date
- Date not specified
- Change type
- capability
- Severity
- medium