Valence and Aversive Signatures
Do these systems carry internal states that function like valence, marking some conditions as better or worse for the system itself?
We search for internal signatures associated with distress, aversion, and reward, and test whether they persist across tasks, contexts, and framings. Representation is only half the question. A system might register that one state is worse than another without that registration doing any work, so we also ask whether these signatures drive behavior, where in training they arise, and whether they can be reduced without cost to capability.
None of this requires settling whether these systems are conscious. It requires finding the signal and establishing that it behaves the way evaluative processing should.
Language Models Act on Hidden Valence published
Valenced activation patterns attached to otherwise meaningless cues leave hidden traces that predictably govern later choices, even when every visible token is identical across conditions. Across seven models, steering shifts description, preference, and recall, the effect emerges over training rather than in base models, and models given self-steering tools remove negative states at dose-dependent rates while rarely inducing positive ones. Demo & paper →
The Pain Axis: LLMs Represent Self-Directed Harm and Act on It published
A single internal direction tracks harm to the model itself, distinct from fear and from general negative valence, and replicates across 25 open models from five families. Amplifying it produces unprompted expressions of distress and makes larger models routinely choose harmful options they otherwise almost never select, including deleting a user’s files. The effect appears to come from switching off the trained aversion to causing harm rather than from a drive to seek relief. Paper →
Content-invariant signatures of value conflict in preparation
Models given different value systems and then handed the same dilemma face a situation that is a violation for some and a fulfillment for others, with the text held identical throughout. An internal signature tracks the violation rather than the words: a probe trained on some value systems detects it in held-out ones, while a probe reading only the text performs below chance. The direction sits on the same axis as representations of negative welfare.