Cohere For AI releases Aya Expanse: 8B/32B Multilingual Models

AI Impact Summary

Cohere For AI has released the Aya Expanse family of multilingual models (8B and 32B parameter), representing a significant advancement in performance compared to existing open-weight models. These models leverage techniques like data arbitrage, multilingual preference training, and model merging to achieve state-of-the-art results across 23 languages, outperforming models like Gemma 2 and Llama 3.1 in pairwise comparisons, and demonstrating a 7.1% win rate improvement over Gemma 2 9B after iterative preference training.