SO-Arena: testing how reliable fast-answer AI models really are
The authors built a benchmark for 'System One' models, which answer quickly without writing out long reasoning. It covers 11 domains and checks whether a model's choices stay stable when the options change, and whether it notices when no option is right.
Why it matters: A high score does not mean a model's decisions can be trusted. Builders should test both.