Move over, Turing Test. Winograd Schema Challenge in town
Isn't there something better than the Turing test to measure computer intelligence? Is the Turing Test the best we have to judge a machine's capability to produce behavior that requires human thought? Doubt was expressed by many when it was announced that the program Eugene Goostman had fooled 33 percent of judges into thinking the chatbot was a human after five minutes of questioning. Anders Sandberg, a University of Oxford research fellow, said in The Conversation that "Eugene's success in the Turing test may tell us more about how weak we humans are when it comes to detecting intelligence and agency in conversation than about how smart our machines are." Gary Marcus, a professor of cognitive science at New York University, said that "It turns out that you can do a lot of misdirection, answer sarcastically, and evade the fact that you are a computer. So all it really...