Abstract
In a smart manufacturing system involving workers, recognition of the worker's activity can be used for quantification and evaluation of the worker's performance, as well as to provide onsite instructions with augmented reality. In this paper, we propose a method for activity recognition using Inertial Measurement Unit (IMU) and surface electromyography (sEMG) signals obtained from a Myo armband. The raw 10-channel IMU signals are stacked to form a signal image. This image is transformed into an activity image by applying Discrete Fourier Transformation (DFT) and then fed into a Convolutional Neural Network (CNN) for feature extraction, resulting in a high-level feature vector. Another feature vector representing the level of muscle activation is evaluated with the raw 8-channel sEMG signals. Then these two vectors are concatenated and used for work activity classification. A worker activity dataset is established, which at present contains 6 common activities in assembly tasks, i.e., grab tool/part, hammer nail, use power-screwdriver, rest arm, turn screwdriver, and use wrench. The developed CNN model is evaluated on this dataset and achieves 98% and 87% recognition accuracy in the half-half and leave-one-out experiments, respectively.
Recommended Citation
W. Tao et al., "Worker Activity Recognition in Smart Manufacturing Using IMU and sEMG Signals with Convolutional Neural Networks," Procedia Manufacturing, vol. 26, pp. 1159 - 1166, Elsevier B.V., Jun 2018.
The definitive version is available at https://doi.org/10.1016/j.promfg.2018.07.152
Meeting Name
46th SME North American Manufacturing Research Conference, NAMRC 2018 (2018, Jun. 18-22, College Station, TX)
Department(s)
Mechanical and Aerospace Engineering
Second Department
Computer Science
Research Center/Lab(s)
Intelligent Systems Center
Keywords and Phrases
Activity Recognition; Convolutional Neural Networks (CNN); Deep Learning; IMU; sEMG; Smart Manufacturing
International Standard Serial Number (ISSN)
2351-9789
Document Type
Article - Conference proceedings
Document Version
Final Version
File Type
text
Language(s)
English
Rights
© 2018 The Authors, All rights reserved.
Creative Commons Licensing
This work is licensed under a Creative Commons Attribution-No Derivative Works 4.0 License.
Publication Date
01 Jun 2018
