With the large-scale application of industrial robots, the safety problems caused by the sudden failures of industrial robots occur from time to time. Traditional fault diagnosis methods based on data analysis have several problems, such as the sensor data are disturbed by the external environment, the communication protocols for different types of robots are complex and not unified, the monitoring systems embedded in the execution systems affect each other, and so on. In this paper, we propose a vision-based fault detection method for industrial robots. According to this method, we perform real-time analysis of operation video from industrial robots. An image segmentation module extracts the body part of an industrial robot, and an image hashing module then generates the posture code describing the movement of the industrial robot. Thus, we can obtain early warnings based on abnormal movements of the robot, which can be detected by the sequence pattern analysis technology. The proposed method does not rely on communication protocols of industrial robots and can monitor industrial robots in a real-time non-contact manner. Besides, the method is easy for deployment at a low cost. We conduct experiments on a collected dataset containing videos of industrial robots. Experiment results show that the proposed method can accurately identify the abnormal actions of industrial robots at an average detection accuracy of 99.15%, which meets the needs of industrial applications in practice.
Cite this paper
Peng, Y. and Chen, D. (2021). Vision-Based Fault Action Detection for Industrial Robots. Open Access Library Journal, 8, e7189. doi: http://dx.doi.org/10.4236/oalib.1107189.
Dong, K. (2019) 2020-2026 Investigation and Analysis of the Current Situation of China’s Industrial Robot Industry and Forecast of Its Development Trend. Mechanical and Electronic Industry, No. 8, 229-333.
Piciarelli, C. and Foresti, G.L. (2011) Surveillance-Oriented Event Detection in Video Streams. Intelligent Systems, 26, 32-41. https://doi.org/10.1109/MIS.2010.38
Krizhevsky, A., Sutskever, I. and Hinton, G. (2012) ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Volume 1, 1097-1105.
He, K.M., Gkioxari, G., Dollár, P. and Girshick, R. (2017) Mask R-CNN. IEEE International Conference on Computer Vision (ICCV), Venice, 22-29 October 2017, 386-397. https://doi.org/10.1109/ICCV.2017.322
Indyk, P. (1998) Approximate nearest Neighbors: Towards Removing the Curse of Dimensionality. Proceedings of the Thirtieth Annual ACM Symposium on Theory of Computing, Dallas, May 1998, 604-613. https://doi.org/10.1145/276698.276876
Weiss, Y., Torralba, A. and Fergus, R. (2008) Spectral Hashing. Proceedings of the 21st International Conference on Neural Information Processing Systems, Vancouver, December 2008, 1753-1760.
Liu, W., Wang, J., Kumar, S., et al. (2011) Hashing with Graphs. Proceedings of the 28th International Conference on Machine Learning, Bellevue, 28 June-2 July 2011, 1-8.