First time I heard of this was in Blindsight, and every time I use an LLM it just makes me think of the crew talking to Rorschach.

Intelligence without consciousness...

https://www.rifters.com/real/Blindsight.htm

I don;t understand why people have any respect at all for Searle's"argument", it's just a bare assertion "machines's can't think", combined with some cheap misdirection. Can anyoneone argue that having Chinese characters instead of bits going in and out is something other than misdirection? Can anyone argue that having a human being acting like a cpu instead of having an actual cpu is something other than cheap misdorection?