What the Turing Test is—and what it isn’tTo answer that question, we first need to look at what the Turing Test is, and what it means for an LLM to pass or fail it. What does ChatGPT passing the Turing Test mean? Why Turing selected language as a test for machinesIt feels like it was no accident that Turing chose language as the basis by which his “Imitation Game” would be conducted. “I think [this has] been one of the major lines of criticism” of the Turing Test, says Jones. Tweaking ChatGPT to fool peopleIt also demonstrates another potential issue with the Turing Test: The Chinese Room is clearly designed with the express purpose of fooling the person on the other side of the door—or, to put it another way, it’s a program designed specifically to pass the Turing Test.