Moe Routing Atlas – which experts fire in Qwen3.5/3.6 35B-A3B
gslaller.github.io · 海外项目
2HN 得分
昨天出现时间
项目说明
Did some work on visualising the firing pattern of MoE (Mixture of Experts) modules for two Qwen models. There are some other interesting statistics, such as router entropy, expert reuse from the prev