Sparse Autoencoders Interpret Mixture-of-Experts Models by Revealing That Their Experts Exhibit Human-Interpretable Fine-Grained Specialization
This release uses sparse autoencoders to show Qwen3 MoE experts have private, fine-grained specializations, releasing code and an expert explorer.