Studies showing a language model behaving badly prove nothing, because the model was asked to produce that behaviour.

Technology analyst whose weekly email on tech reaches over 150,000 readers

you write murder is good on a piece of paper and you put it in a photocopier and you press go and you say my god the machine says murder's good. Well, no, you told the machine to say that. And that's what these anthropic studies are. They're basically you tell the machine to say a thing and then it says it like well you haven't proved anything.