I Trained a Small Network to Compress Data, and It Ended Up Drawing a Pentagon.
A from-scratch NumPy rebuild of Anthropic toy superposition uses hand-derived gradients to show a tiny network compressing data into a pentagon.
A from-scratch NumPy rebuild of Anthropic toy superposition uses hand-derived gradients to show a tiny network compressing data into a pentagon.