This is what ChatGPT told me when I confronted it for making things up. At one point, it even started laughing (multiple Ks in Brazilian Portuguese mean loud laughter).

This function doesn’t exist— even on Google returns absolute nothing.

I remember stories back in 2023 about Bing's bot adamantly refusing to admit mistakes, even going so far as to saying things like "You are a bad user! I am a good Bing!"

https://thenewstack.io/when-prompt-injections-attack-bing-an...