Intriguing thought, not sure it actually is the same as what we did and called a 'Concierge' model, linking appropriately to other smart agents or people. More like Facebook's attempt to include humans within the now defunct Facebook M. Interesting experiment with the examples. Once again using Amazon's Mechanical Turk to crowd source. And again our own experience was that the careful setup is key.
Crowd Workers, AI Make Conversational Agents Smarter
Carnegie Mellon News, By Byron Spice
Researchers at Carnegie Mellon University (CMU) have developed Evorus, a chatbot system that recruits crowd workers on demand from Amazon Mechanical Turk to answer questions from users, with the crowd workers voting on the best answer. Evorus also tracks the questions that have been asked and answered, and over time, it will begin to suggest these answers for subsequent questions.
The researchers also developed a process by which the artificial intelligence (AI) can help to approve a message with less crowd worker involvement. During a five-month deployment, Evorus worked with 80 users and 181 conversations, and its automated responses to questions were chosen 12 percent of the time, crowd voting was reduced by almost 14 percent, and the cost of crowd work for each reply to a user's message dropped by 33 percent. The researchers will present Evorus in April at the ACM Conference on Human Factors in Computing Systems (CHI 2018) in Montreal, Canada. .... "
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment