Meet the Digital Avatar Making the Asian Games More Inclusive
Point your index finger forward, then sweep your thumb up – you've just signed "hello", according to Alibaba Cloud's sign language translator named Xiaomo. She says hi back.
But Xiaomo isn't human. She's a digital avatar who will provide two-way translation between Mandarin and Chinese sign language during the upcoming Asian Para Games taking place in Hangzhou over the last week of October.
Her cloud and AI-powered services will be accessible to hearing-impaired Asiad participants via payment platform Alipay to ask people for directions, view event schedules and more.
Xiaomo took nearly two years to develop, according to algorithm engineer Zhang Bang.
"I'm very proud to see our research being applied to solving real-life problems and having a real impact on people," he told Alizila in an interview.
Watch the video to meet Xiaomo.
Below is a transcript of this video, edited for clarity and brevity
Zhang Bang: My name's Bang Zhang, an engineer in Alibaba Cloud.
My daily work is more in the field of fundamental research, research about computer vision, multimodalities, and natural language processing. I'm very proud to see our research being applied to solving real-life problems and having a real impact on people.
Xiaomo is a digital avatar who can perform two-way translation between sign language and spoken Chinese in order to support communications between people with hearing difficulties and the wider community.
There are two key components. In the first component, it's about technologies that are related to digital avatars. And the second module is the translation module, which is powered by a large language model.
Building the dataset for the training machine learning model is one of the biggest challenges that we have faced. Building a sign language dataset, which has a very large size with video collections and annotations, is very time-consuming and costly for sure.
It took us almost two years to build such a dataset, thanks to the help of volunteers and sign language practitioners.
The other challenge on the technology side is that, in sign language, one word can have many different meanings. To tackle such a challenge, we leverage a technique called machine translation. It can perform the task of word selection and translation at the same time. It helps us to reduce the ambiguity and enhance the accuracy of the translation.
During the Asian Para Games, participants with hearing impairments can simply open the Alipay app and use Xiaomo to ask for various assistance, including asking for directions, seeking medical help and game viewing.
It would definitely make the Games more inclusive and greatly help communication between individuals with hearing difficulties and other people.
We have already pioneered the use of Xiaomo in museums, tourist spots, cafes and news broadcasts.
In the future, we hope to see Xiaomo assist individuals with hearing impairments to address their needs in public services.
This article was originally published on Alizila, written by Di Wu.
Read previous post:
A Greener Games: How Alibaba Cloud Supports Sustainability at the 19th Asiad
Read next post:
Alibaba Cloud’s AI-powered Tools Drive Sustainability and Inclusiveness at Hangzhou Asian Games
-
-
Alibaba Cloud Community
1,605 posts | 526 followers
Follow
Comments
-
-
Alibaba Cloud Community
1,605 posts | 526 followers
Follow
Related Products
-
Intelligent Robot
A dialogue platform that enables smart dialog (based on natural language processing) through a range of dialogue-enabling clients
Learn More -
ApsaraVideo Media Processing
Transcode multimedia data into media files in various resolutions, bitrates, and formats that are suitable for playback on PCs, TVs, and mobile devices.
Learn More -
Realtime Compute for Apache Flink
Realtime Compute for Apache Flink offers a highly integrated platform for real-time data processing, which optimizes the computing of Apache Flink.
Learn More -
Qoder
From Assisted to Autonomous — Adapting to Every Programming Need
Learn More
More Posts by Alibaba Cloud Community
- The Easiest Way to Try the Latest Models in One Place: Token Plan Starting at $3 for the First Month
- 一個平台輕鬆試用最新 AI 模型:Token Plan 首月低至 $3
- Alibaba Cloud Advances AI Adoption in Malaysia with Nationwide Youth Contest and Industry Collaborations
- Alibaba Cloud Unveils New AI Initiatives at Hong Kong Summit to Advance the City’s AI Ecosystem
- QoderWake: Digital Workers Take the Initiative — No Need to @ Every Time
- What Is Model Thinking Effort? Should You Choose Low, High, or Maximum?
- High-Risk PHP and Node.js Vulnerabilities: A Scan Costs Pennies. A Miss Could Cost a Fortune.
- Alibaba Unveils Qwen4-Max: New AI Teammate for Work, Creativity, and Discovery
- Alibaba Brings Cloud and AI to the First Youth Olympic Games in Africa
- Introducing Qoder Lite: Start creating with Qoder for $10 a month