But unrelated to chatGPT, what irks me about this line of reasoning is that it makes a special something, "true understanding", to be almost by definition reserved for humans. It's something beyond AI. Just like the "hard problem" of consciousness, which is too "hard" for science, says right there in the name it's supposed to be impossible. Dualism also has something too special, "the spirit", that could not be explained by the material.
It's the same dualist bug returning again and again.
But unrelated to chatGPT, what irks me about this line of reasoning is that it makes a special something, "true understanding", to be almost by definition reserved for humans. It's something beyond AI. Just like the "hard problem" of consciousness, which is too "hard" for science, says right there in the name it's supposed to be impossible. Dualism also has something too special, "the spirit", that could not be explained by the material.
It's the same dualist bug returning again and again.