FrontierPhysics: a test of whether AI agents can do real physics research from start to finish
42 physicists built 56 tasks from their own research. Agents must read the literature, plan, run experiments and write a paper, which is checked by automatic tests and expert rubrics.
Why it matters: It gives a sober measure of how far AI 'research agents' really are from doing publishable science.