LLMs emulate human communication really well and, no doubt, one day they'll do it perfectly. But is an emulator the real thing? Obviously not.

If I wire some electrodes in your tongue perfectly so you can feel each flavor exactly as it is in real life, is that the same thing as eating the real thing? Again, it's not.

Let's stay you're asleep. You have a dream in which you interact with a person that talks to you. Is that oneiric entity conscious? Nope.

I'm even steelmanning your argument by assuming LLMs are as good as humans already, which they're not.