TY - GEN
T1 - A Chinese sign language recognition system using leap motion
AU - Xue, Yaofeng
AU - Gao, Shang
AU - Sun, Huali
AU - Qin, Wei
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2017/7/2
Y1 - 2017/7/2
N2 - As an application of Gesture Recognition, Sign Language Recognition (SLR) is able to facilitate those who want to learn a manual communication system and makes it practicable for the majority of normal people, who are ignorant of sign language, to communicate with the group suffering from dysaudia and vice versa. In this paper, focusing on feasibility, we present a Chinese Sign Language (CSL) recognition system using the portable and cost-Affordable Leap Motion sensor and applying kth-Nearest Neighbor (k-NN). Simultaneously, by introducing text to speech, speech synthesis and speech recognition (speech to text) APIs, we bring out a novel design of two-way communication system between normal people and hearing-impaired communities. The experiment result shows that such a CSL recognition system, which currently achieved static sign language interpretation with high accuracy, is able to play a much more significant role in this field.
AB - As an application of Gesture Recognition, Sign Language Recognition (SLR) is able to facilitate those who want to learn a manual communication system and makes it practicable for the majority of normal people, who are ignorant of sign language, to communicate with the group suffering from dysaudia and vice versa. In this paper, focusing on feasibility, we present a Chinese Sign Language (CSL) recognition system using the portable and cost-Affordable Leap Motion sensor and applying kth-Nearest Neighbor (k-NN). Simultaneously, by introducing text to speech, speech synthesis and speech recognition (speech to text) APIs, we bring out a novel design of two-way communication system between normal people and hearing-impaired communities. The experiment result shows that such a CSL recognition system, which currently achieved static sign language interpretation with high accuracy, is able to play a much more significant role in this field.
KW - Chinese sign language
KW - Gesture recognition
KW - Kth-nearest neighbor
KW - Leap Motion
KW - Sign language recognition
UR - https://www.scopus.com/pages/publications/85067011126
U2 - 10.1109/ICVRV.2017.00044
DO - 10.1109/ICVRV.2017.00044
M3 - 会议稿件
AN - SCOPUS:85067011126
T3 - Proceedings - 2017 International Conference on Virtual Reality and Visualization, ICVRV 2017
SP - 180
EP - 185
BT - Proceedings - 2017 International Conference on Virtual Reality and Visualization, ICVRV 2017
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 7th International Conference on Virtual Reality and Visualization, ICVRV 2017
Y2 - 21 October 2017 through 22 October 2017
ER -