But, for one, seems that OpenAI and Anthropic running these tests shows they have the same concerns & want to address it. Similarly, as Anthropic mentions, their applications provide additional safety measures in order to mitigate that bad behaviour.

For another.. I wish the argument for "LLMs need to be restricted" was more explicit. LLMs help provide convincing (albeit potentially hallucinated) summaries & reproductions of information you could find elsewhere. I'd expect any such dangerous information could already be found on the internet by a motivated bad actor. -- And, on the flip side, it'd be naive to have no concerns over excessive government control over LLMs.

Though otherwise... I think it's kind of funny that the LLMs, who clearly have a goody-two-shoes personality, can be so easily tricked into discussing the bad actions mentioned. I wonder to what extent that's just reiterating crime fiction.