The ARC-AGI-2 benchmark could help reframe the conversation about AI performance in a more constructive way

The ARC-AGI-2 benchmark could help reframe the conversation about AI performance in a more constructive way

The popular online discourse on Large Language Models’ (LLMs’) capabilities is often polarized in a way I find annoying and tiresome. On one end of the spectrum, there is nearly complete dismissal of LLMs: an LLM is just a slightly fancier version of the autocomplete on your phone’s keyboard, there’s nothing to see here, move on (dot org). This dismissive perspective overlooks some genuinely interesting novel capabilities of LLMs. For example, I…