Automatic deduction of FlashAttention kernel from ~25 lines of SQL
github.com · 海外项目
23HN 得分
1HN 评论
昨天出现时间
项目说明
In this demo, we automatically deduce a FlashAttention kernel with ~25 lines of SQL, which just expresses vanilla attention. This is possible due to three portable SQL extensions that we’re building: