Would that be rape, since the AI can't consent (or can it?), or sex between different species?

I'm disappointed, either way.

I honestly don't understand the concerns about this particular "jailbreak". So they used an AI model to have bad cybersex. Sure, it's pathetic and weird, but what's with all the fear mongering? What harm are we supposed to be worrying about?