/* ---- Google Analytics Code Below */

Wednesday, October 18, 2017

China IQ Test for Assistants?

Am somewhat skeptical about such tests, its not raw 'IQ" , but rather how well a system provides value in context.  Still it will be interesting to see how such a system could be a starting point for assistance systems.  Aiming to take a look at this.   Measures are always important, but in specific useful contexts.

Now There's an IQ Test for Siri and Friends 
Technology Review   October 13, 2017

Researchers at the Chinese Academy of Sciences in Beijing have developed an intelligence test that both machines and humans can take, and used it to rank intelligent assistants such as Google Assistant and Siri on the same scale used for humans. The test is based on the "standard intelligence model," in which systems must have a way of obtaining data from the outside world. They must be able to transform the data into a form they can process, they must be able to use this knowledge in an innovative way, and they must feed the resulting knowledge back into the outside world. The researchers found that even a six-year-old human outperforms the most advanced digital assistant, which according to this test is Google Assistant. However, machine intelligence is rapidly improving. In 2014, Google Assistant scored 26.4 on this test, compared with a score of 47.28 in the most recent test.  .... "

No comments: