MikeTrendsTrends right now

Yhn SportBaseball first seen 12 d ago, last 5 d ago, peak #2

Compiling FlashAttention from SQL: new demo draws attention

Original: Show HN: Automatic deduction of FlashAttention kernel from ~25 lines of SQL

A developer has shown a system that automatically derives a FlashAttention GPU kernel from roughly 25 lines of SQL. The demo, posted on GitHub as part of an xarray-sql project, suggests high-level declarative code can be lowered into optimized attention kernels. Readers are debating how the compiler achieves the transformation and what it means for writing machine learning code without hand-tuned kernels.

Why now: The surprising claim that a famous GPU kernel can be generated automatically from short SQL code is drawing curiosity and skepticism.

FlashAttentionxarray-sqlxqlsystemsHacker News

Open on hn →

Evidence

API: https://socialmediatrends-api.osmike.com/v1/trends/4283000