ARC-AGI-2

"This Week in AI" is now Superintelligence.

Author

Dan Sutera
March 28, 2025 • Estimated Reading Time: 5 minutes

ARC-AGI-2: Finally A New Benchmark!

The TLDR
The ARC Prize Foundation launches ARC-AGI-2, a challenging new AI benchmark emphasizing symbolic interpretation and reasoning. Human accuracy is 100%, while leading AI models like OpenAI's o3 achieve single-digit results.

The ARC Prize Foundation has presented its eagerly awaited new benchmark, ARC-AGI-2 – a fascinating milestone for AI research! What makes this benchmark so special? It specifically tests skills that are easy for humans but extremely difficult for AI systems.

The results so far are remarkable: while even the most advanced AI reasoning systems, such as OpenAIs o3, only achieve single-digit percentages, human participants solve the tasks with a 100% success rate. The benchmark focuses on three key areas: symbolic interpretation, composite reasoning, and contextual rule application. In ARC-AGI-1, OpenAIs o3 has already surpassed the benchmark.

At the same time, the ARC Prize 2025 is starting with a prize pool of $1,000,000! The competition, which begins this week on Kaggle, not only offers a top prize of $700,000 for teams that break the 85% mark, but also further prizes for innovation.

As more and more benchmarks are saturated, the question of new tasks arises. ARC-AGI-2 presents current models with new challenges. The only question is how long the benchmark will survive this time before it is saturated.

Question of the Day

What percentage will the best AI models achieve in ARC-AGI-2 this year?

Login or Subscribe to participate in polls.

Start learning AI in 2025

Keeping up with AI is hard – we get it!

That’s why over 1M professionals read Superhuman AI to stay ahead.

  • Get daily AI news, tools, and tutorials

  • Learn new AI skills you can use at work in 3 mins a day

  • Become 10X more productive

Chart of the Day

DeepSeek v3 0324 is now the highest rated non-reasoning AI model

In The News

OpenAI Adopts Anthropic's MCP Standard

OpenAI announces adoption of Anthropic's Model Context Protocol for external data and software integration. The standard will be implemented across ChatGPT and other OpenAI products.

Kling AI Upgrades Elements with New Features

Kling AI announces a major upgrade to Elements with faster generation and improved image quality. The update introduces new Endframes and Extend features.

Zapier MCP Connects AI to 8,000+ Apps

Zapier launches MCP integration enabling AI assistants to access over 8,000 apps and 30,000 actions. The system requires minimal setup with configurable security controls.

Quote of the Day

Hi All,

Thank you for reading. We would be delighted if you shared the newsletter with your friends! We look forward to expanding the newsletter in the future with even more specialized topics. Until then, follow us on social media to stay up to date.

Cheers,
Dan