PL EN
Integrating YOLOv5, Jetson nano microprocessor, and Mitsubishi robot manipulator for real-time machine vision application in manufacturing: A lab experimental study
 
More details
Hide details
1
Faculty of Integrated Technologies, Universiti Brunei Darussalam, Jalan Tungku Link, BE1410 Brunei Darussalam
 
2
Department of Control Science and Engineering, Opole University of Technology, 76 Proszkowska St., 45-758, Opole, Poland
 
3
Faculty of Mechanical Engineering, Opole University of Technology, 76 Proszkowska St.45758 Opole Poland
 
4
Dipartimento Matematica e Informatica, Università degli Studi di Palermo, Via Archirafi 34, 90123 Palermo, Italy
 
5
Department of Mechanical and Mechatronics Engineering, Faculty of Engineering and Science, Curtin University Malasia, Lot 13149, Block 5 Kuala Baram Land District, CDT 250, 98009 Miri, Sarawak, Malaysia
 
 
Corresponding author
Marian Bartoszuk   

Faculty of Mechanical Engineering, Opole University of Technology, 76 Proszkowska St.45758 Opole Poland
 
 
Adv. Sci. Technol. Res. J. 2025; 19(5):248-270
 
KEYWORDS
TOPICS
ABSTRACT
Efficient detection and rectification of metal components conditions during manufacturing and post-processing manufacturing are crucial for quality control in industries. This paper describes a lab-scale integrated system for real-time and auto-mated metal edge image detection using YOLOv5 machine vision algorithm for automated met-al grinding and chamfering in manufacturing. The YOLOv5 algorithm was compared with VGG-16 and ResNet algorithm for edge detection i.e., sharp edge, chamfer edge, and burrs edge on the metal workpiece. The YOLOv5 algorithm and model were developed and embedded in the NVIDIA Jetson Nano microprocessor. An integrated system connects the NVIDIA Jetson Nano microprocessor with an embedded deep learning image processing model to a Mitsubishi Electric Melfa RV-2F-1D1-S15 robot manipulator to perform the lab-scale manufacturing process for automated grinding and chamfering. The models demonstrates durable performance in detecting the metal edge image for intelligent manufacturing application, achieving a mean average precision 0.854 for ResNet, 0.942 for VGG-16 and 0.957 for YOLOv5, all models across defect classes with minimal misclassifications. The Mitsubishi Electric Melfa RV-2F-1D1-S15 robot manipulator received input from the machine vision system and per-formed an automated grinding and chamfering process accordingly; By integrating camera, embedded deep learning in the microprocessor and robot manipulator, auto-mated grinding and chamfering process in metal edge component can be efficiently rectified. This machine vision technology tailored solution promises to improve productivity and consistency in metal component manufacturing.
Journals System - logo
Scroll to top