Yhn BusinessEconomy first seen 3 d ago, last 23 min ago, peak #11
Why didn't we get GPT-2 in 2005?
A new essay asks why a GPT-2-class language model could not have been built back in 2005, given that the underlying transformers arrived only in 2017 while computing power and much of the data existed far earlier. The piece examines which ingredients were genuinely missing, from architectures and training techniques to compute economics, and readers are debating how much of recent AI progress was inevitable versus contingent on specific research breakthroughs.
Why now: It challenges assumptions about the timeline of AI progress, prompting debate over whether GPT-2 was technically feasible years earlier.
Rank over time, top of the chart is #1. 14 snapshots from 3 d ago to 23 min ago.
Evidence
- Why didn't we get GPT-2 in 2005? · bilsbie · 26
API: https://socialmediatrends-api.osmike.com/v1/trends/899472