Yhn SportFootball first seen 23 h ago, last just now, peak #1

Running Qwen 3.8 Flash Next on a single RTX 4090

Original: Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s

A newly shared open-source project claims to run Alibaba's Qwen 3.8 Flash Next, a 125-billion-parameter model, on a single consumer RTX 4090 GPU at around 100 tokens per second. If the benchmarks hold up, it would make very large language models practical for hobbyists and local inference without datacenter hardware. Developers in the discussion are examining the approach and questioning the real-world performance figures.

Why now: Running a 125B model at high speed on consumer hardware would be a major breakthrough for local AI inference

QwenAlibabaNvidia RTX 4090StrataGitHub

Open on hn →

Rank over time, top of the chart is #1. 74 snapshots from 11 h ago to just now.

Evidence

• Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s · snehesht · 834

API: https://socialmediatrends-api.osmike.com/v1/trends/988765