This same leaderboard lists a bunch of models, including 4o, beating out Opus 4, which seems off.

In my experience Opus 4 isn't as good for day to day coding tasks as Sonnet 4. It's better as a planner

"+100 points" sounds like a lot until you do the ELO math and see that means 1 out of 3 people still preferred Claud Opus 4's response. Remember 1 out of 2 would place the models dead even.

That eval hasn't been relevant for a while now. Performance there just doesn't seem to correlate well with real-world performance.

What does +75 arbitrary points mean in practice? Can we come up with units that relate to something in the real world.