Benchmarks

Your Leaderboard Isn’t Measuring What You Think It’s Measuring

Borrowing psychometrics for AI evaluation, and why the borrowed tool doesn’t always survive the trip Every model leaderboard reduces a rich matrix of right and wrong answers into one number: accuracy. It’s simple,…