This study evaluates the development of a testing process for the automotive software domain, highlighting challenges stemming from the absence of adequate processes. The research demonstrates the application of Design Science Research methodology in developing, an automotive software testing process—ProTSA, using six functional testing modules. Additionally, the study evaluates the benefits of implementing ProTSA in a specific Original Equipment Manufacturer (OEM) using an experimental single-case approach with industry professionals’ participation through a survey. The study concludes that combining testing techniques with effective communication and alignment is crucial for enhancing software quality. Furthermore, survey data indicates that implementing ProTSA leads to productivity gains by initiating tests early, resulting in time savings in the testing program and increased productivity for the testing team. Future work will explore implementing ProTSA in cybersecurity, over-the-air software updates, and autonomous vehicle testing processes.
References
[1]
Mossinger, J. (2010) Software in Automotive Systems. IEEE Software, 27, 92-94. https://doi.org/10.1109/MS.2010.55
[2]
Navet, N. and Lion, F.S. (2009) Automotive Embedded Systems Handbook. CRC Press.
[3]
Sommerville, I. (2011) Software Engineering. Pearson.
[4]
Lochau, M., Lity, S., Lachmann, R., Schaefer, I. and Goltz, U. (2014) Delta-Oriented Model-Based Integration Testing of Large-Scale Systems. Journal of Systems and Software, 91, 63-84. https://doi.org/10.1016/j.jss.2013.11.1096
[5]
Warren, T. (2024) Software-Related Recalls and the Auto Industry’s Ongoing Evolution. https://www.wardsauto.com/industry-news/software-related-recalls-and-auto-industry-s-ongoing-evolution
[6]
Knauf Industries Automotive (2024) Automobile Construction. Cars with a Defined Software Package—A New Phenomenon in the Automotive Industry. https://knaufautomotive.com/pt-br/carros-com-um-pacote-de-Software-definido/
[7]
Pretschner, A., Broy, M., Kruger, I.H. and Stauner, T. (2007) Software Engineering for Automotive Systems: A Roadmap. Proceedings of the Future of Software Engineering, Minneapolis, 23-25 May 2007, 55-71. https://doi.org/10.1109/FOSE.2007.22
[8]
Delamaro, M., et al. (2007) Introduction to Software Testing. Campos.
[9]
Killian, R. (2021) What Is a TUV Certification? https://blog.1000bulbs.com/home/what-is-tuv-certification#:~:text=A%20TUV%20certification%20means%20a%20sampling%20of%20the,looked%20for%20a%20UL%20wet%20location%20safety%20rating
[10]
Institute of Electrical and Electronics Engineers (1990) 610.12-1990-IEEE Standard Glossary of Software Engineering Terminology.
[11]
Redmill, F., et al. (2022) Sysml Open Source Project: What Is SysML? Who Created SysML? https://sysml.org/?msckid=45dcb1bece6211eca1163fb9a4534962
[12]
Bahig, G. and El-Kadi, A. (2017) Formal Verification of Automotive Design in Compliance with ISO 26262 Design Verification Guidelines. IEEE Access, 5, 4505-4516. https://doi.org/10.1109/ACCESS.2017.2683508
[13]
Synopsys (2021) What Is ASIL (Automotive Safety Integrity Level)? https://www.synopsys.com/automotive/what-is-asil.html
[14]
Arcanjo, R.R., Martins, L.E.G. and Fernandes, D.L.G. (2024) Verification and Validation of Embedded Software in an Automotive Context: A Systematic Literature Review. Multidisciplinary Scientific Journal Knowledge Core, 3, 207-250. https://doi.org/10.32749/nucleodoconhecimento.com.br/computer-science/embedded-software
[15]
Rajabli, N., Flammini, F., Nardone, R. and Vittorini, V. (2020) Software Verification and Validation of Safe Autonomous Cars: A Systematic Literature Review. IEEE Access, 9, 4797-4819. https://doi.org/10.1109/ACCESS.2020.3048047
[16]
Haghighatkhah, A., Banijamali, A., Pakanen, O.-P., Oivo, M. and Kuvaja, P. (2017) Automotive Software Engineering: A Systematic Mapping Study. Journal of System and Software, 128, 25-55. https://doi.org/10.1016/j.jss.2017.03.005
[17]
Dresch, A., Lacerda, D.P. and Antunes, J.A.V. (2015) Design Science Research: A Method for Science and Technology Advancement. Springer.
[18]
Jotform Blog (2023) Questions and Examples for Surveys Using the Likert Scale. https://www.jotform.com/pt/blog/exemplo-de-pesquisa-em-escala-likert/
[19]
Iqbal, D., Abbas, A., Ali, M., Khan, M.U.S. and Nawaz, R. (2020) Requirement Validation for Embedded Systems in Automotive Industry through Modeling. IEEE Access, 8, 8697-8719. https://doi.org/10.1109/ACCESS.2019.2963774
[20]
Kriebel, S., et al. (2018) Improving Model-Based Testing in Automotive Software Engineering. Proceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice, Gothenburg, 27 May-3 June 2018, 172-180. https://doi.org/10.1145/3183519.3183533
[21]
Jordan, C.V., Mäurer, F., Löwenberg, S. and Provost, J. (2019) Framework for Flexible, Adaptive Support of Test Management by Means of Software Agents. IEEE Robotics and Automation Letters, 4, 2754-2761. https://doi.org/10.1109/LRA.2019.2918486
Mercedes-Benz do Brasil (2023) Product Line. https://www.mercedes-benz-trucks.com.br/caminhoes/
[24]
Vieira, H. (2024) Learn about the Importance of the Software Development Life Cycle (SDLC) and It’s Stages. https://www.objective.com.br/insights/sdlc/
[25]
Da Rocha, A.R.C., et al. (2001) Software Quality: Theory and Practice. Prentice-Hall, 303 p.
[26]
Galdino, T.S. (2010) The Importance of Testing in the Software Production Process. Faculty of Technology, Americana, Sao Paulo. https://ric.cps.sp.gov.br/bitstream/123456789/1709/1/20102S_GALDINOThiagoSecomandi_TCCPD1002.pdf
[27]
Marques, L.R. (2015) Application of Quality Tools in the Diagnosis of Critical Success Factors in Industrial Projects: A Case Study in an Automotive Company. Monograph: Specialization in Production Engineering-Federal Technological University of Parana. https://portaldeinformacao.utfpr.edu.br/Record/riut-1-18822/Description#tabnav
