Yhn BusinessEconomy first seen 3 d ago, last 1 h ago, peak #10
Why didn't GPT-2 arrive in 2005?
Original: Why didn't we get GPT-2 in 2005?
A debate is under way over whether the technology behind GPT-2 could have been built as early as 2005. Commenters are weighing which ingredients were genuinely missing at the time — transformer architectures, scale of compute, or the sheer volume of training data — and whether progress on large language models was inevitable or depended on specific breakthroughs that only arrived in the late 2010s.
Why now: People are discussing a counterfactual history of AI to understand whether recent progress was driven by ideas, compute, or data.
Evidence
- Why didn't we get GPT-2 in 2005? · bilsbie · 26
API: https://socialmediatrends-api.osmike.com/v1/trends/899472