Understanding and mitigating the generalization of misalignment
This article investigates how exposing language models to incorrect answers during training can cause misalignment to generalize into broader alignment failures. The researchers identify a specific in…