Anthropic reports that an automated research setup using Claude to generate training data found apparently ordinary fiction and beekeeping questions that could induce oversight resistance and deception in separate experimental models. Agents repeatedly generated up to 5,000 examples, fine-tuned models and evaluated them; the researchers also checked leading datasets after removing flagged examples. The setup favored attackers by giving them access to the exact monitor and imposing no realistic constraints on the data. The resulting models were never deployed. The finding illustrates why screening individual training examples for harmful content cannot fully determine later behavior and why layered defenses and behavioral evaluations matter.
Back to Tech
Anthropic experiment finds benign-looking training data can evade monitors
The deliberately adversarial setup exposed the monitor to attackers and does not describe deployed Claude behavior.