Open Arabic LLM Leaderboard 2 updated with native benchmarks

AI Impact Summary

The Open Arabic LLM Leaderboard 2 represents a significant effort to address shortcomings in Arabic LLM benchmarking, driven by community feedback regarding resource limitations, lack of transparency, and the use of non-Arabic-specific benchmarks. The updated leaderboard focuses on natively developed Arabic tasks and datasets to better capture the nuances of the language, mitigating issues like translation mismatches and saturated benchmarks that previously hindered accurate model evaluation. This shift is critical for advancing Arabic NLP research and development.