Integration Test Procedures for a Collision Avoidance Decision Support System Using STPA

¹ Norwegian University of Science and Technology, Trondheim, Norway
² Gdynia Maritime University, Gdynia, Poland
³ Gdańsk University of Technology, Gdańsk, Poland

DOI: 10.12716/1001.17.02.14

Previous paper - Contents - Next paper

ABSTRACT: The transition from conventionally manned to autonomous ships is accompanied by the development of enhanced Decision Support Systems (DSS) for navigators. Such systems need to consider interactions among hardware, software, and humans and their potential effects on system performance, which require rigorous testing to verify the system's safe decision-making ability and operational limits. Testing requirements for verification are aimed at 1) assessing the system's reliability and failure handling performance, and 2) integration testing. This work uses the System-Theoretic Process Analysis (STPA) to develop integration tests for a novel DSS. STPA is a structured methodology to identify hazards from multiple sources, including hardware or software failures, system interactions, and human errors. The objectives of the study are to develop and assess the feasibility of integration test procedures based on STPA. The stability monitoring subsystem from the DSS is analyzed as a case study. The results are used to suggest functional and performance integration test procedures.

KEYWORDS:

REFERENCES

M. Gil, K. Wrobel, J. Montewka, F. Goerlandt, A bibliometric analysis ´ and systematic review of shipboard Decision Support Systems for accident prevention, Safety Science 128 (2020) 104717. doi:10.1016/j.ssci.2020.104717. - doi:10.1016/j.ssci.2020.104717

IEEE, IEEE Standard for System, Software, and Hardware Verification and Validation, Technical Report, 2017. Conference Name: IEEE Std 1012-2016 (Revision of IEEE Std 1012-2012/ Incorporates IEEE Std 1012-2016/Cor1-2017).

DNV, Rules for Classification: Ships, Technical Report DNV-RU-SHIP, 2022.

DNV, Class Guideline: Autonomous and remotely operated ships, Technical Report DNV-CG-0264, DNV, 2021.

R. Skjetne, O. Egeland, Hardware-in-the-loop testing of marine control system, Modeling, Identification and Control: A Norwegian Research Bulletin 27 (2006) 239–258. doi:10.4173/mic.2006.4.3. - doi:10.4173/mic.2006.4.3

O. Smogeli, J. E. Skogdalen, Third Party HIL Testing of Safety Critical Control System Software on Ships and Rigs, OnePetro, 2011. doi:10. 4043/22018-MS. - doi:10.4043/22018-MS

T. A. Pedersen, J. A. Glomsrud, E.-L. Ruud, A. Simonsen, J. Sandrib, B.-O. H. Eriksen, Towards simulation-based verification of autonomous navigation systems, Safety Science 129 (2020) 104799. doi:10.1016/j. ssci.2020.104799. - doi:10.1016/j.ssci.2020.104799

K. Wrobel, J. Montewka, P. Kujala, Towards the development of a system-theoretic model for safety assessment of autonomous merchant vessels, Reliability Engineering & System Safety 178 (2018) 209–224. doi:10.1016/j.ress.2018.05.019. - doi:10.1016/j.ress.2018.05.019

N. Leveson, J. Thomas, STPA Handbook, https://psas.scripts.mit.edu/home/get file.php?name=STPA handbook.pdf, 2018.

R. Patriarca, M. Chatzimichailidou, N. Karanikas, G. Di Gravio, The past and present of System-Theoretic Accident Model And Processes (STAMP) and its associated techniques: A scoping review, Safety Science 146 (2022) 105566. doi:10.1016/j.ssci.2021.105566. - doi:10.1016/j.ssci.2021.105566

N. A. Zikrullah, H. Kim, M. J. van der Meulen, G. Skofteland, M. A. Lundteigen, A comparison of hazard analysis methods capability for safety requirements generation, Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability 235 (2021) 1132–1153. doi:10.1177/1748006X211003463, publisher: SAGE Publications. - doi:10.1177/1748006X211003463

R. Yang, I. B. Utne, Towards an online risk model for autonomous marine systems (AMS), Ocean Engineering 251 (2022) 111100. doi:10.1016/ j.oceaneng.2022.111100. - doi:10.1016/j.oceaneng.2022.111100

B. Rokseth, I. B. Utne, J. E. Vinnem, A systems approach to risk analysis of maritime operations, Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability 231 (2017) 53–68. doi:10.1177/1748006X16682606. - doi:10.1177/1748006X16682606

B. Rokseth, I. B. Utne, J. E. Vinnem, Deriving verification objectives and scenarios for maritime systems using the systems-theoretic process analysis, Reliability Engineering & System Safety 169 (2018) 18–31. doi:10.1016/j.ress.2017.07.015. - doi:10.1016/j.ress.2017.07.015

B. Rokseth, O. I. Haugen, I. B. Utne, Safety Verification for Autonomous Ships, MATEC Web of Conferences 273 (2019) 02002. doi:10.1051/ matecconf/201927302002, publisher: EDP Sciences. - doi:10.1051/matecconf/201927302002

N. Leveson, Engineering a Safer World: Systems Thinking Applied to Safety, Engineering systems, MIT Press, Cambridge, Mass, 2011. - doi:10.7551/mitpress/8179.001.0001

NTSB, Capsizing of Roll-on/Roll-off Vehicle Carrier Golden Ray, St. Simons Sound, Brunswick River, near Brunswick, Georgia, September 8, 2019 (2020).

H. Kim, S. Haugen, I. B. Utne, Assessment of accident theories for major accidents focusing on the MV SEWOL disaster: Similarities, differences, and discussion for a combined approach, Safety Science 82 (2016) 410– 420. doi:10.1016/j.ssci.2015.10.009. - doi:10.1016/j.ssci.2015.10.009

E. V. Lewis, Principles of naval architecture, 2nd revision (3rd ed.) ed., Society of Naval Architects and Marine Engineers, Jersey City, 1988. OCLC: ocm37002765.

P. Krata, T. Hinz, S. A. Dugan, M. Marley, J. Montewka, Prediction and Evaluation of an Angle of Heel due to Turning Maneuver of Small Training Ships: Comparison of Dynamic Analysis and Static Design Criteria, in: Proceedings of the 15th International Symposium on Practical Design of Ships and Other Floating Structures, 2022.

J. Montewka, P. Krata, T. Hinz, M. Gil, K. Wrobel, Probabilistic model estimating the expected maximum roll angle for a vessel in the turn (2022) 10.

K. Wrobel, M. Gil, P. Krata, K. Olszewski, J. Montewka, On the use ´ of leading safety indicators in maritime and their feasibility for Maritime Autonomous Surface Ships, Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability (2021) 1748006X211027689. doi:10.1177/1748006X211027689, publisher: SAGE Publications. - doi:10.1177/1748006X211027689

M. Gil, J. Montewka, P. Krata, T. Hinz, S. Hirdaris, Determination of the dynamic critical maneuvering area in an encounter between two vessels: Operation with negligible environmental disruption, Ocean Engineering 213 (2020) 107709. doi:10.1016/j.oceaneng.2020.107709. - doi:10.1016/j.oceaneng.2020.107709

M. Gil, A concept of critical safety area applicable for an obstacleavoidance process for manned and autonomous ships, Reliability Engineering & System Safety 214 (2021) 107806. doi:10.1016/j.ress. 2021.107806. - doi:10.1016/j.ress.2021.107806

K. H. Chua, S. Coutinho, A. Norahim, D. Konovessis, Development of Recommendations for Digital Testing of MASS Navigation Safety prior to Sea Trials, Journal of Physics: Conference Series 2311 (2022) 012025. doi:10.1088/1742-6596/2311/1/012025. - doi:10.1088/1742-6596/2311/1/012025

T. A. Pedersen, A. Neverlien, J. A. Glomsrud, I. Ibrahim, S. M. Mo, M. Rindarøy, T. Torben, B. Rokseth, Evolution of Safety in Marine Systems: From System-Theoretic Process Analysis to Automated Test Scenario Generation, Journal of Physics: Conference Series 2311 (2022) 012016. doi:10.1088/1742-6596/2311/1/012016. - doi:10.1088/1742-6596/2311/1/012016

C. M. Hirata, A. M. Ambrosio, Combining STPA With CoFI to Generate Requirements and Test Cases for Safety-Critical System, IEEE Systems Journal 16 (2022) 6635–6646. doi:10.1109/JSYST.2022.3200586, conference Name: IEEE Systems Journal. - doi:10.1109/JSYST.2022.3200586

L. Santiago Caamano, M. Miguez Gonzalez, S. Allegue Garcia, V. Diaz Casas, Evaluation of onboard stability assessment techniques under real operational conditions, Ocean Engineering 258 (2022) 111841. doi:10.1016/j.oceaneng.2022.111841. - doi:10.1016/j.oceaneng.2022.111841

Citation note:

Dugan S., Skjetne R., Wróbel K., Montewka J., Gil M., Utne I.B.: Integration Test Procedures for a Collision Avoidance Decision Support System Using STPA. TransNav, the International Journal on Marine Navigation and Safety of Sea Transportation, Vol. 17, No. 2, doi:10.12716/1001.17.02.14, pp. 375-381, 2023

BibTeX EndNote

Authors in other databases:

Spencer Dugan: Scholar icon

x3HS4J0AAAAJ