Keywords and Phrases
Convolutional Neural Network; Cyber Manufacturing; Deep Learning; Skeletal Data; Workforce Training
“Production innovations are occurring faster than ever leading conventional production systems towards cyber manufacturing. Manufacturing workers thus need to frequently learn new methods and skills. In fast-changing, largely uncertain production systems, manufacturers with the ability to comprehend workers’ behavior and assess their operational performance in near real-time will achieve better performance than peers. Recognizing worker actions in near real-time while performing the assembly can serve this purpose. However, reliably recognizing the assembly actions performed by the workers is challenging, because the actions for assembly are complex and workers are not only heterogeneous but sensitive to the variation of the work environment. Moreover, assembly data captured by one category of sensors lack reliability. Therefore, this study proposed multimodal sensor data-based action recognition (ActRgn) with novel fusion methods with improved recognition performance. Myo-armband, a wearable sensor was used to capture both Inertial Measurement Unit (IMU) and electromyography (EMG) signals of assembly workers. Microsoft Kinect, a vision-based sensor, was also utilized to track predefined skeleton joints. Captured sensor data was used to train Convolutional Neural Network (CNN) models. Different techniques are proposed to adopt these trained models to the individual new worker to address the issues of between-subject heterogeneity and within-subject variance. Then, various fusion methods were implemented to integrate the prediction results of independent models to yield the final prediction with improved accuracy. One operation in assembling a Bukito 3D printer, which is composed of seven actions, is used to demonstrate the implementation and assessment of the proposed method. Results from the study have demonstrated that the proposed approach effectively improves the prediction accuracy at both the activity level and the subject level. The work of this study builds a foundation to assess and assist the assembly workers in a cyber manufacturing scenario”--Abstract, page iii.
Dagli, Cihan H., 1949-
Leu, M. C. (Ming-Chuan)
Engineering Management and Systems Engineering
Ph. D. in Systems Engineering
Missouri University of Science and Technology
xiii, 105 pages
© 2021 Md. Al-Amin, All rights reserved.
Dissertation - Open Access
Al-Amin, Md., "Sensor data based adaptive models for assembly worker training in cyber manufacturing" (2021). Doctoral Dissertations. 3047.