Oh but they ARE! MUAHAHAHA... no seriously... Claude in particular is getting awful human like. It just cracked a joke about something I mentioned 2 months ago. GULP. I joke about it but at the same time we can see that layer 47 activated in some pattern and that attention heads focused on certain tokens, but translating that into "the model reasoned about X, then connected it to Y, then chose Z" is still largely unsolved.

Nobody really knows for sure whether AIs are concious. But nobody really knows for sure whether rocks are concious either. The reality is we understand very little about conciousness.

experience of experience is hard to capture in language and it turns out you either get that idea or you don't.

if consciousness is anything at all, then what it is, is exactly that one thing that isn't reduced at all, if it's an illusion.