AI
Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRand
George Ling, Shanshan Zhong, Lijin Yang, et al. · Submitted 31 Oct 2026 · 48 upvotes yesterday
Preprint · not peer reviewedCode releasedTrending
Testing AI models on full benchmarks is slow and costly, so people test on a small subset. The authors show that random subsets usually work well but sometimes give large errors, and propose BestRand to avoid those rare bad picks.
Key finding: Across more than 70 benchmarks, BestRand cut the risk of large errors by 50.2% and average error by 16.4%, at about half the setup cost of rival methods.
Why it matters: Cheaper, reliable testing helps smaller labs compare models.