The development of artificial intelligence technology has promoted the rapid improvement of human-computer interaction. This system uses the Kinect visual image sensor to identify human bone data and complete the recognition of the operator’s movements. Through the filtering process of real-time data by the host computer platform with computer software as the core, the algorithm is programmed to realize the conversion from data to control signals. The system transmits the signal to the lower computer platform with Arduino as the core through the transmission mode of the serial communication, thereby completing the control of the steering gear. In order to verify the feasibility of the theory, the team built a 4-DOF robotic arm control system and completed software development. It can display other functions such as the current bone angle and motion status in real time on the computer operation interface. The experimental data shows that the Kinect-based motion recognition method can effectively complete the tracking of the expected motion and complete the grasping and transfer of the specified objects, which has extremely high operability.
References
[1]
Matsen, F., Lauder, A., Rector, K., Keeling, P. and Cherones, A.L. (2016) Measurement of Active Shoulder Motion Using the Kinect, a Commercially Available Infrared Position Detection System. Journal of Shoulder and Elbow Surgery, 25, 216-223.
https://doi.org/10.1016/j.jse.2015.07.011
[2]
Wang, P., Liu, H.Y., Wang, L.H. and Gao, R.X. (2018) Deep Learning-Based Human Motion Recognition for Predictive Context-Aware Human-Robot Collaboration. CIRP Annals—Manufacturing Technology, 67, 17-20.
https://doi.org/10.1016/j.cirp.2018.04.066
[3]
Kumar, S.H. and Sivaprakash, P. (2013) New Approach for Action Recognition Using Motion Based Features. 2013 IEEE Conference on Information & Communication Technologies, Thuckalay, Tamil Nadu, India, 11-12 April 2013, Article No. 13653652. https://doi.org/10.1109/CICT.2013.6558292
[4]
Zhao, W.B. (2016) A Concise Tutorial on Human Motion Tracking and Recognition with Microsoft Kinect. Science China (Information Sciences), 59, 237-241.
https://doi.org/10.1007/s11432-016-5604-y
[5]
Ning, W.J. (2017) Research and Application of Sports Demonstration Teaching System Based on Kinect. Proceedings of the 6th International Conference on Social Science, Education and Humanities Research (SSEHR 2017), Jinan, China, 18-19 October 2017, 570-574. https://doi.org/10.2991/ssehr-17.2018.126
[6]
Xiang, C.K., Hsu, H.H., Hwang, W.Y. and Ma, J.H. (2014) Comparing Real-Time Human Motion Capture System Using Inertial Sensors with Microsoft Kinect. Ubi-Media Computing and Workshops (UMEDIA), 7th International Conference, Ulaanbaatar, Mongolia, 12-14 July 2014, 53-58.
https://doi.org/10.1109/U-MEDIA.2014.25
[7]
Faria, D.R., Premebida, C. and Nunes, U. (2014) A Probabilistic Approach for Human Everyday Activities Recognition Using Body Motion from RGB-D Images. The 23rd IEEE International Symposium on Robot and Human Interactive Communication, Edinburgh, UK, 25-29 August 2014, 732-737.
https://doi.org/10.1109/ROMAN.2014.6926340
[8]
Tseng, Y.-W., Li, C.-M., Lee, A. and Wang, G.-C. (2013) Intelligent Robot Motion Control System Part I: System Overview and Image Recognition. 2013 International Symposium on Next-Generation Electronics, Kaohsiung, Taiwan, 25-26 February 2013, 1-5.
[9]
Vantigodi, S. and Radhakrishnan, V.B. (2014) Action Recognition from Motion Capture Data Using Meta-Cognitive RBF Network Classifier. Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), 2014 IEEE Ninth International Conference, Singapore, 21-24 April 2014, 1-6.
https://doi.org/10.1109/ISSNIP.2014.6827664
