Recognition of Finger Spelling of American Sign Language with Artificial Neural Network Using Position/Orientation Sensors and Data Glove

Author

Cemil Oz, Missouri University of Science and TechnologyFollow
Ming-Chuan Leu, Missouri University of Science and TechnologyFollow

Abstract

An American Sign Language (ASL) finger spelling and an alphabet gesture recognition system was designed with ANN and constructed in order to translate the ASL alphabet into the corresponding printed and sounded English letters. The system uses a sensory Cyberglove and a Flock of Birds 3-D motion tracker to extract the gestures. The finger joint angle data obtained from strain gauges in the sensory glove define the hand shape while the data from the tracker describes the trajectory and orientation. The data flow from these devices is controlled by a motion trigger. Then, data is processed by an alphabet recognition network to generate the words and names. Our goal is to establish an ASL finger spelling system using these devices in real time. We trained and tested our system for ASL alphabet, names and word spelling. Our test results show that the accuracy of recognition is 96%.

Recommended Citation

C. Oz and M. Leu, "Recognition of Finger Spelling of American Sign Language with Artificial Neural Network Using Position/Orientation Sensors and Data Glove," Advances in Neural Networks, Springer Verlag, Jan 2005.

The definitive version is available at https://doi.org/10.1007/11427445_25

Department(s)

Mechanical and Aerospace Engineering

Keywords and Phrases

Data Flow; Sensory Cyberglove; American Sign Language

Document Type

Book - Chapter

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2005 Springer Verlag, All rights reserved.

Publication Date

01 Jan 2005