Yhn CultureTelevision first seen 2 d ago, last 7 min ago, peak #3

Most US working hours fall outside AI benchmark coverage

Original: 90% of US working hours are spent on tasks not covered well by AI benchmarks

A new analysis from Mercor's labor index finds that roughly 90% of US working hours are spent on tasks that are not well covered by existing AI benchmarks. The finding suggests current model evaluations measure only a narrow slice of real work, raising questions about how well reported AI capabilities translate to actual jobs.

Why now: It challenges the common assumption that AI benchmarks reflect performance in real-world work.

MercorUnited StatesAI benchmarks

Open on hn →

Evidence

• 90% of US working hours are spent on tasks not covered well by AI benchmarks · speckx · 623

API: https://socialmediatrends-api.osmike.com/v1/trends/2510056