RightSignal
1 of 6

Your RightSignal

AI

FrontierPhysics: a test of whether AI agents can do real physics research from start to finish

Bingran You, Wenjun Ke, Ria Rosenauer, Bo Liu, Wenbo Chen, Min Chen · Submitted 4 Nov 2026 · 27 upvotes yesterday
Preprint · not peer reviewedTrending

42 physicists built 56 tasks from their own research. Agents must read the literature, plan, run experiments and write a paper, which is checked by automatic tests and expert rubrics.

Key finding: Across 22 models in 26 setups, none passed more than 46 of its 168 attempts. The main weakness was loose reasoning and limited expert intuition, not missing physics knowledge.

Why it matters: It gives a sober measure of how far AI 'research agents' really are from doing publishable science.