As an important part of railway lines, the healthy service status of track fasteners was very important to ensure the safety of trains. The application of deep learning algorithms was becoming an important method to realize its state detection. However, there was often a deficiency that the detection accuracy and calculation speed of model were difficult to balance, when the traditional deep learning model is used to detect the service state of track fasteners. Targeting this issue, an improved Yolov4 model for detecting the service status of track fasteners was proposed. Firstly, the Mixup data augmentation technology was introduced into Yolov4 model to enhance the generalization ability of model. Secondly, the MobileNet-V2 lightweight network was employed in lieu of the CSPDarknet53 network as the backbone, thereby reducing the number of algorithm parameters and improving the model’s computational efficiency. Finally, the SE attention mechanism was incorporated to boost the importance of rail fastener identification by emphasizing relevant image features, ensuring that the network’s focus was primarily on the fasteners being inspected. The algorithm achieved both high precision and high speed operation of the rail fastener service state detection, while realizing the lightweight of model. The experimental results revealed that, the MAP value of the rail fastener service state detection algorithm based on the improved Yolov4 model reaches 83.2%, which is 2.83% higher than that of the traditional Yolov4 model, and the calculation speed was improved by 67.39%. Compared with the traditional Yolov4 model, the proposed method achieved the collaborative optimization of detection accuracy and calculation speed.
References
[1]
Zhao, S.S., He, N. and Cao, S. (2018) Railway Fastener State Detection Algorithm Based on SIFT Feature. Transducer and Microsystem Technologies, 37, 148-150 154. https://doi.org/10.13873/j.1000-9787(2018)11-0148-03
[2]
Lowe, D.G. (2004) Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 60, 91-110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
[3]
Wang, Q., Li, B.L., Hou, Y., et al. (2018) An Improved LBP Feature for Rail Fastener Identification. Journal of Southwest Jiaotong University, 53, 893-899. https://doi.org/10.3969/j.issn.0258-2724.2018.05.003
[4]
Kalal, Z., Mikolajczyk, K. and Matas, J. (2012) Tracking Learning Detection. IEEE Transactions on Pattern Analysis & Machine Intelligence, 24, 1409-1422. https://doi.org/10.1109/TPAMI.2011.239
[5]
Gibert, X., Patel, V.M. and Chellappa, R. (2017) Deep Multitask Learning for Railway Track Inspection. IEEE Transactions on Intelligent Transportation Systems, 18, 153-164. https://doi.org/10.1109/TITS.2016.2568758
[6]
Gibert, X., Patel, V.M. and Chellappa, R. (2015) Sequential Score Adaptation with Extreme Value Theory for Robust Railway Track Inspection. IEEE International Conference on Computer Vision Workshop (ICCVW), Santiago, 7-13 December 2015, 131-138. https://doi.org/10.1109/ICCVW.2015.27
[7]
Niu, S.L., Li, B., Wang, X.G., et al. (2020) Defect Image Sample Generation with GAN for Improving Defect Recognition. IEEE Transactions on Automation Science and Engineering, 17, 1611-1622. https://doi.org/10.1109/TASE.2020.2967415
[8]
Xu, G.Y., Li, J.Y., Bai, T.B., et al. (2022) Detection Method of Track Fastener State Based on Improved Mask R-CNN. China Railway Science, 43, 44-51. https://doi.org/10.3969/j.issn.1001-4632.2022.01.06
[9]
Liu, Y.T., Zhang, T., Wang, X., et al. (2020) Research on Railway Fastener Status Detection Using Faster R-CNN.Journal of Dalian Minzu University, 22, 202-207. https://doi.org/10.13744/j.cnki.cn21-1431/g4.2020.03.003
[10]
Gao, J.L., Bai, T.B., Yao, D.C., et al. (2022) Detection of Track Fastener Based on Improved YOLOv4 Algorithm. Science Technology and Engineering, 22, 2872-2877. https://doi.org/10.3969/j.issn.1671-1815.2022.07.042
[11]
Zhang, Z.N., Zheng, S.B. and Li, L.M. (2021) SSD-Based Track Fastener Rapid Spring Status Detection. Computer & Digital Engineering, 49, 1560-1565. https://doi.org/10.3969/j.issn.1672-9722.2021.08.011
[12]
Bochkovskiy, A., Wang, C.Y. and Liao, H.Y.M. (2020) YOLOv4: Optimal Speed and Accuracy of Object Detection. https://doi.org/10.48550/arXiv.2004.10934
[13]
Wang, J., Luo, L.F., Ye, W., et al. (2020) A Defect-Detection Method of Split Pins in the Catenary Fastening Devices of High-Speed Railway Based on Deep Learning. IEEE Transactions on Instrumentation and Measurement, 69, 9517-9525. https://doi.org/10.1109/TIM.2020.3006324
[14]
Chen, Q. and Xiong, Q. (2020) Garbage Classification Detection Based on Improved YOLOV4. Journal of Computer and Communications, 8, 285-294. https://doi.org/10.4236/jcc.2020.812023
[15]
Zhang, H., Cisse, M., Dauphin, Y.N., et al. (2017) Mixup: Beyond Empirical Risk Minimization. arXiv:1710.09412. https://doi.org/10.48550/arXiv.1710.09412