AI Model Digests Video to Learn Sign Language
New Atlas
Paul McClure, May 24, 2023
A tool developed by researchers at Spain’s Barcelona Supercomputing Center and the Universitat Politècnica de Catalunya (UPC) uses artificial intelligence (AI) to improve sign language translation. The researchers fed a transformer-style machine learning model more than 80 hours of video in American Sign Language with corresponding English transcripts from the How2Sign dataset. The researchers addressed the variability and complexity of sign languages by pre-processing the video data to extract spatiotemporal information via the Inflated 3D Networks technique. They found the model produced meaningful translations, although they agreed, "There is still room for improvement."
No comments:
Post a Comment