Turing Test

Mostly agreed, it is mostly about deception rather than intelligence.   Rarely gives evidence for real reproducible intelligence for broad context. 

ACM OPINION

It's Time for AI to Retire the Turing Test

By Fortune, June 15, 2022

What to make of the strange case of Blake Lemoine? The Google AI engineer made headlines this past week when he claimed one of the company's chatbots had become "sentient." Not only does Google say Lemoine's claims are untrue, but almost every AI expert agrees that the chatbot, which Google calls LaMDA, is not sentient in the way Lemoine says it is.

Is Lemoine the inevitable result of the field's persistent fetishization of the Turing Test as a benchmark? In many actual versions of the Turing Test, humans often simply don't try that hard to stump the machine. And, in many cases, people are eager to deceive themselves into thinking the bots are real.

From Fortune  

View Full Article (May Require Paid Registration)

Google Duplex Calling Will Let You know its an AI

The presentation of the Google Duplex calling service, demonstrated this week and planned for this summer, impressed many as a great idea.   A system that could construct a goal-driven interaction with other people or devices.   So it could, for example, make a reservation at a restaurant, or make complex travel reservations.   Even negotiate something online.   Along the way it was hinted it might solve the Turing AI test, and appear to be human, with a pleasing voice and some contextual reasoning power.  But others pointed out that this could lead to a kind of super robocalling capability,  leading to potentially nightmarish results.    Caution ...

Google: Duplex phone calling AI will identify itself  ... You'll know if you're talking to AI -- we think.    By Richard Lawler, @Rjcc in Engadget: 

Google is then quoted as clarifying this:

" ... We understand and value the discussion around Google Duplex -- as we've said from the beginning, transparency in the technology is important. We are designing this feature with disclosure built-in, and we'll make sure the system is appropriately identified. What we showed at I/O was an early technology demo, and we look forward to incorporating feedback as we develop this into a product. ... " 

Imposter Syndrome and the Turing Test

How a Famous Robot Test Can Help You Beat Impostor Syndrome  by Kelton Reid in Copyblogger

Points to a 2012 Atlantic article on using the Turing Test to discern (or fool) people, or even ourselves into determining who we are.   Fascinating piece,  especially with regard to how an intelligent dialog is considered part of the test process.  Which is different than just asking a question and determining if people can answer it correctly.  Its not just what you know, but how you can adjust that knowledge to contextual needs.    Also harder for AI to reproduce.

" ... In the words of sociologists, what they're now studying is called "interactional expertise." The easiest way to understand what interactional expertise entails is to contrast it with a more common idea, contributory expertise. Contributory experts are the typical array of professionals (physicists, chemists, lawyers, economists, musicians etc.) who develop specialized knowledge and skill through formal education and long experience. ... "  

Beyond the Turing Test

Video overview:  https://vimeo.com/226955559

Carissa Schoenick discusses "Moving Beyond the Turing Test with the Allen AI Science Challenge"

(http://cacm.acm.org/magazines/2017/9/220439), a Contributed Article in the September 2017 CACM

Jill Watson at Ga Tech

Have worked with many TA's myself, so this is interesting.  It also relates to chatbots too, lessons to are to be learned here.   As in all tests of this type I wonder about the difference between providing value to someone versus fooling them.  Not the same thing. The goal can sculpt the results.    Read the full piece.

Jill Watson, Round Three.
The Georgia Institute of Technology (Georgia Tech) is beginning its third semester using a virtual teaching assistant (TA) system, called Jill Watson, in an online course about artificial intelligence (AI).

Jill, which is implemented on IBM's Watson platform, was first used last spring to successfully answer particular types of frequently asked questions without the help of humans.

Georgia Tech professor Ashok Goel told the students at the beginning of the semester some of their TAs may or may not be computers. "Then I watched the chat rooms for months as they tried to differentiate between human and artificial intelligence," Goel says.   ... " 

Full list of advisory systems being followed.

Hacking the Turing Test

The Turing test is a measure of 'intelligence'  which came out of the AI era, has a number of flaws.  In the CACM: 

" ... The test currently can't determine if a person is talking to another human being or a robot if the person being interrogated simply chooses to stay silent, new research shows.

While it's not news that the Turing test has flaws, the new study highlights just how limited the test is for answering deeper questions about artificial intelligence, said study co-author Kevin Warwick, a computer scientist at Coventry University in England.  .... " 

Turing Test for Creative Intelligence

How can we determine a machine or system is more than just intelligent, but also creative?    A place for a Turing test.