Real-Time Tool Detection in Smart Manufacturing using You-Only-Look-Once (YOLO)v5


Computer Vision Plays an Essential Role in Industry 4.0 by Enabling Machinery to Perceive, Analyze, and Control Production Processes. Object Detection, a Computer Vision Technique that Accurately Classifies and Localizes Objects within Images, Has Gained Significant Interest. This Technique Can Be Applied in Various Domains, Including Manufacturing, to Assist in the Detection of Different Tools. in This Paper, You-Only-Look-Once (YOLO)v5 Real-Time Object Detection Technique Has Been Developed and Optimized, to Detect Different Tool Types and their Locations in a Manufacturing Setting. to Train the Neural Network, a Dataset of 3,286 Tool Images from the Internet Has Been Collected and Annotated. to Enhance the Model's Ability in Generalization, Three Augmented Variants of Each Image Have Been Created to Improve Rotation Invariance. the Model's Training Scheme Has Been Further Optimized with Stochastic Gradient Descent after Configuring Different Hyperparameters Such as Learning Rate and Momentum. the Fine-Tuned Model Achieved a Mean Average Accuracy of 98.3 %, Demonstrating the High Precision of the Model in Detecting Different Tool Types and their Locations in Real-Time.


Mechanical and Aerospace Engineering


National Science Foundation, Grant CMMI-1954548

Keywords and Phrases

Object detection; Smart manufacturing; Yolov5

International Standard Serial Number (ISSN)


Document Type

Article - Journal

Document Version


File Type





© 2023 Elsevier, All rights reserved.

Publication Date

01 Aug 2023