search
RAM shortage
Trends
- 1AI agents burning five times more tokens than humans●AI agents use 5x more tokens than humans as cached prompts explode, headed for 10x — agents are mostly rereading what they've already seen, skyrocketing KV cache demand threatens already-worsening RAM shortages
AI agents are consuming roughly five times more tokens than human users, a figure analysts expect to reach ten times as systems scale. Much of this usage comes from agents repeatedly re-reading information they have already processed, driving explosive growth in cached prompts. The resulting surge in KV cache demand is straining memory supplies, compounding an already worsening global RAM shortage and raising costs across the AI industry.
- 2
Memory industry executives, including Micron's CEO, say RAM supplies will only get tighter, with the shortage now expected to persist through 2028. The warning signals continued high prices and limited availability for consumers and data center buyers alike. Commentators are discussing what the prolonged crunch means for PC builders, cloud providers and electronics pricing.