Researchers at the University of British Columbia create gloves that can turn hand gestures into sound, giving those with hearing and speech disabilities a new way to talk and sing.
Hand gestures can add a lot to a conversation. They can convey excitement and help you describe a scene or object. And, of course, the simple act of lifting a certain finger can quickly let someone know you’re not too happy with them. In all, gestures are an effective form of communication, and now, researchers in Vancouver have found a way to take them to the next level.
A team of engineers from the University of British Columbia has developed a pair of gloves that read hand gestures and convert them to speech and song, potentially giving those with speech and/or hearing disabilities another way to communicate.
The project, called Digital Ventriloquized Actor (DIVA) and led by UBC professor of electrical and computer engineering Sidney Fels, tries to replicate the movements of real vocal cords through the use of hand gestures read by a system of sensors.
The right glove features 3D motion sensors that can detect whether your hand is open or closed. When open, DIVA produces vowel sounds (much like real life, where vowels require the throat and lips to be open), while closing your hand creates consonant sounds. Meanwhile, the left-hand glove has finger contacts that produce stop consonants, such as “b” and “p,” when touched together.
Continue reading the rest of the story on CNET