Groq SDK updates: Prompt caching and citation support added
AI Impact Summary
Groq has released updated SDKs (v0.33.0 and v0.34.0) introducing prompt caching and citation support for chat completions. These enhancements improve the efficiency and accuracy of chat applications by allowing for persistent prompt storage and referencing external sources. While these are non-disruptive additions, developers should evaluate their potential to optimize existing chat workflows and improve the reliability of responses.
Affected Systems
- Date
- Date not specified
- Change type
- capability
- Severity
- medium