AWS Bedrock adds token count estimation feature for select models

AI Impact Summary

AWS Bedrock is introducing a token count estimation feature for select models, allowing developers to proactively manage API usage and costs. This additive capability provides a valuable tool for optimizing prompts and planning token budgets, particularly for models like Claude 3 Haiku and Claude 3 Sonnet. Developers can use the CountTokens API to estimate token usage before sending requests, helping to avoid unexpected charges and ensure adherence to rate limits.