Its actually not too often that assistants speak gibberish, they more often just admit to not knowing what was asked, when a human would understand readily. That's usually better to diminish risk. See my previous posts on Common Sense reasoning, which we worked on in the enterprise. The idea of a challenge is good, it will at least scope the problem in contextual and current terms. See the examples at the link below. Also the notes on what 'fundamental limitations' are.
AI assistants don’t have the common sense to avoid talking gibberish
A new test could prove that when it comes to language, today’s best AI systems are fundamentally limited. by Will Knight in Technology Review
Siri and Alexa are clearly far from perfect, but there is hope that steady progress in machine learning will turn them into articulate helpers before long. A new test, however, may help show that a fundamentally different approach is required for AI systems to actually master language.
Developed by researchers at the Allen Institute for AI (Ai2), a nonprofit based in Seattle, the Arc Reasoning Challenge (ARC) will pose elementary-school-level multiple-choice science questions. Each question will require some understanding of how the world works. .... "
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment