Groq SDK updates: Prompt caching and annotation support added
AI Impact Summary
Groq has released updated SDKs (v0.33.0 and v0.34.0) introducing prompt caching and annotation support for chat completion messages. This enhancement allows users to optimize prompt performance and better structure their conversations, particularly useful for complex workflows. No immediate action is required for existing users, but developers should explore these new features to improve their applications.
Affected Systems
- Date
- Date not specified
- Change type
- capability
- Severity
- medium