Interpreter gloves created to recognize sign language

Share this post

Chinese and American engineers have found a way to break down the barriers to communication between people who are deaf and people with no hearing or speech problems. They created a glove that, thanks to a neural network, translates sign language into human speech.

The technology works as follows: sensors and gyroscopes built into the glove track the movement of fingers and hands, and then, using special algorithms, the system online translates them into words and sounds them using a sound device. A few more sensors are added to the translation, which are attached to the human face. This is how mimics are tracked – in sign language it is important in the pronunciation of some words.

So far, the technology can only be used in English. Now it is able to recognize with almost one hundred percent accuracy gestures that correspond to the 600 most common words. Now the “vocabulary” of gloves is expanding and soon it will be possible to use them in everyday life.

It is important that the production equipment is inexpensive, which means that it can be used by a large number of people. The cost of all components is about $50.