Abstract

Human operators play a major role in maintaining the safety of complex systems. Although operator error is a major cause of hazardous events, operators also contribute to resilience by preventing, mitigating, and recovering from hazardous events. A key factor underlying this resilience is situation awareness—the ability of the operators to understand their environment and each other to achieve desired system functions. This remains true for fully and partially-autonomous systems, where operational responsibility is shared with designed technical functionality that also relies on (a form of) situation awareness to conduct operations. Distributed situation awareness (DSA) theory, which defines situation awareness as a system property, is best suited to represent situation awareness in systems that share situation awareness properties among (human and non-human) agents. This work proposes a framework to computationally simulate DSA to enable the study of operational resilience in complex engineered systems. Specifically, this framework enables the modeling of hazardous scenarios related to DSA in an integrated behavioral simulation. This approach advances existing DSA modeling approaches, which analyze situation awareness-related constructs alone, by enabling the analysis of the dynamic interactions between DSA-related constructs and other system elements (e.g., software glitches, human error, etc.) and their effects on overall system behavior. This framework is demonstrated using an aircraft taxiway example, where it is used to model taxiing conflicts arising due to lack of vision and poor communications from the air traffic controller. This demonstration shows the potential of using simulations to understand DSA-related hazards and thus inform the design of resilience.

References

1.
Institute of Medicine
,
2000
,
To Err is Human: Building a Safer Health System
,
The National Academies Press
,
Washington, DC
, Errors in Health Care: A Leading Cause of Death and Injury, pp.
26
48
.
2.
Högberg
,
L.
,
2013
, “
Root Causes and Impacts of Severe Accidents at Large Nuclear Power Plants
,”
Ambio
,
42
(
3
), pp.
267
284
.
3.
Endsley
,
M. R.
,
1995
, “
A Taxonomy of Situation Awareness Errors
,”
Human Factors Aviat. Oper.
,
3
(
2
), pp.
287
292
.
4.
Jones
,
D. G.
, and
Endsley
,
M. R.
,
1996
, “
Sources of Situation Awareness Errors in Aviation
,”
Aviat., Space, Environ. Med.
,
67
(
6
), pp.
507
512
.
5.
Sneddon
,
A.
,
Mearns
,
K.
, and
Flin
,
R.
,
2006
, “
Situation Awareness and Safety in Offshore Drill Crews
,”
Cogn., Technol. Work
,
8
(
4
), pp.
255
267
.
6.
Endsley
,
M. R.
,
2001
, “
Designing for Situation Awareness in Complex Systems
,”
The Second International Workshop on Symbiosis of Humans, Artifacts and Environment
,
Kyoto, Japan
, pp.
1
14
.
7.
Naderpour
,
M.
,
Nazir
,
S.
, and
Lu
,
J.
,
2015
, “
The Role of Situation Awareness in Accidents of Large-Scale Technological Systems
,”
Process Saf. Environ. Prot.
,
97
, pp.
13
24
.
8.
Walker
,
G. H.
,
Stanton
,
N. A.
,
Kazi
,
T. A.
,
Salmon
,
P. M.
, and
Jenkins
,
D. P.
,
2009
, “
Does Advanced Driver Training Improve Situational Awareness?
Appl. Ergon.
,
40
(
4
), pp.
678
687
.
9.
Broughton
,
E.
,
2005
, “
The Bhopal Disaster and Its Aftermath: A Review
,”
Environ. Health
,
4
(
1
), p.
6
.
10.
Salmon
,
P. M.
,
Walker
,
G. H.
, and
Stanton
,
N. A.
,
2016
, “
Pilot Error Versus Sociotechnical Systems Failure: A Distributed Situation Awareness Analysis of Air France 447
,”
Theor. Issues Ergon. Sci.
,
17
(
1
), pp.
64
79
.
11.
Brat
,
G. P.
,
Yu
,
H.
,
Atkins
,
E.
,
Sharma
,
P.
,
Cofer
,
D.
,
Durling
,
M.
, and
Meng
,
B.
, et al.,
2023
, “Autonomy Verification & Validation Roadmap and Vision 2045.” NASA. https://ntrs.nasa.gov/citations/20230003734
12.
Hay
,
J.
,
Craven
,
P.
,
Merrel
,
B.
,
Williams
,
P.
, and
Wusk
,
G.
,
2022
, “Resiliency in Future Cislunar Space Architectures.” NASA, https://ntrs.nasa.gov/citations/20220018492.
13.
Woods
,
D. D.
,
2015
, “
Four Concepts for Resilience and the Implications for the Future of Resilience Engineering
,”
Reliab. Eng. Syst. Saf.
,
141
, pp.
5
9
.
14.
Gorod
,
A.
,
Gandhi
,
S. J.
,
Sauser
,
B.
, and
Boardman
,
J.
,
2008
, “
Flexibility of System of Systems
,”
Global J. Flexible Syst. Manage.
,
9
(
4
), pp.
21
31
.
15.
Maier
,
M. W.
,
2014
, “The Role of Modeling and Simulation in System of Systems Development,”
Modeling and Simulation Support for System of Systems Engineering Applications
,
L. B.
Rainey
, and
A.
Tolk
, eds.,
John Wiley & Sons, Ltd
,
Hoboken, NJ
, pp.
11
41
.
16.
Dekker
,
S.
,
Hollnagel
,
E.
,
Woods
,
D.
, and
Cook
,
R.
,
2008
,
Resilience Engineering: New Directions for Measuring and Maintaining Safety in Complex Systems
,
Lund University School of Aviation
,
Lund, Sweden
.
17.
Roth
,
E. M.
,
Multer
,
J.
, and
Raslear
,
T.
,
2006
, “
Shared Situation Awareness as a Contributor to High Reliability Performance in Railroad Operations
,”
Organ. Stud.
,
27
(
7
), pp.
967
987
.
18.
Endsley
,
M. R.
,
1995
, “
Toward a Theory of Situation Awareness in Dynamic Systems
,”
Human Factors
,
37
(
1
), pp.
32
64
.
19.
Endsley
,
M.
, and
Jones
,
W.
,
2001
, “A Model of Inter and Intra-Team Situation Awareness: Implications for Design,”
New trends in Cooperative Activities: Understanding System Dynamics in Complex Environments
,
M.
McNeese
,
E.
Salas
, and
M.
Endsley
, eds.,
Human Factors and Ergonomics Society
,
Santa Monica, CA
.
20.
Stanton
,
N. A.
,
Stewart
,
R.
,
Harris
,
D.
,
Houghton
,
R. J.
,
Baber
,
C.
,
McMaster
,
R.
, and
Salmon
,
P.
, et al.,
2006
, “
Distributed Situation Awareness in Dynamic Systems: Theoretical Development and Application of an Ergonomics Methodology
,”
Ergonomics
,
49
(
12–13
), pp.
1288
1311
.
21.
Salmon
,
P. M.
,
Stanton
,
N. A.
,
Walker
,
G. H.
, and
Jenkins
,
D. P.
,
2017
,
Distributed Situation Awareness: Theory, Measurement and Application to Teamwork
, 1st ed.,
CRC Press
,
London
.
22.
Salmon
,
P. M.
, and
Plant
,
K. L.
,
2022
, “
Distributed Situation Awareness: From Awareness in Individuals and Teams to the Awareness of Technologies, Sociotechnical Systems, and Societies
,”
Appl. Ergon.
,
98
, p.
103599
.
23.
Stanton
,
N. A.
,
2016
, “
Distributed Situation Awareness
,”
Theor. Issues Ergon. Sci.
,
17
(
1
), pp.
1
7
.
24.
Kitchin
,
J.
, and
Baber
,
C.
,
2016
, “
A Comparison of Shared and Distributed Situation Awareness in Teams Through the Use of Agent-Based Modelling
,”
Theor. Issues Ergon. Sci.
,
17
(
1
), pp.
8
41
.
25.
Nazir
,
S.
,
Sorensen
,
L. J.
,
Overgård
,
K. I.
, and
Manca
,
D.
,
2014
, “How Distributed Situation Awareness Influences Process Safety”.
26.
Stewart
,
R.
,
Stanton
,
N. A.
,
Harris
,
D.
,
Baber
,
C.
,
Salmon
,
P.
,
Mock
,
M.
,
Tatlock
,
K.
,
Wells
,
L.
, and
Kay
,
A.
,
2008
, “
Distributed Situation Awareness in an Airborne Warning and Control System: Application of Novel Ergonomics Methodology
,”
Cogn., Technol. Work
,
10
(
3
), pp.
221
229
.
27.
Fioratou
,
E.
,
Flin
,
R.
,
Glavin
,
R.
, and
Patey
,
R.
,
2010
, “
Beyond Monitoring: Distributed Situation Awareness in Anaesthesia
,”
Brit. J. Anaesth.
,
105
(
1
), pp.
83
90
.
28.
Alhaider
,
A. A.
,
Lau
,
N.
,
Davenport
,
P. B.
,
Morris
,
M. K.
, and
Tuck
,
C.
,
2018
, “
Distributed Situation Awareness in Patient Flow Management: An Admission Case Study
,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol.
62
,
SAGE Publications Sage CA
,
Los Angeles, CA
, Paper No. 1, pp.
563
567
.
29.
Macquet
,
A.-C.
, and
Stanton
,
N. A.
,
2014
, “
Do the Coach and Athlete Have the Same “Picture” of the Situation? Distributed Situation Awareness in an Elite Sport Context
,”
Appl. Ergon.
,
45
(
3
), pp.
724
733
.
30.
Alhaider
,
A. A.
, and
Lau
,
N.
,
2020
, “
Resilience to the COVID-19 Pandemic: A Distributed Situation Awareness Perspective
,”
2020 Resilience Week (RWS)
,
Salt Lake City, UT
,
Oct. 19–23
, IEEE, pp.
126
132
.
31.
Tan
,
J. J.
,
Otto
,
K. N.
, and
Wood
,
K. L.
,
2017
, “
Relative Impact of Early Versus Late Design Decisions in Systems Development
,”
Des. Sci.
,
3
, p.
e12
. doi:10.1017/dsj.2017.13
32.
Stanton
,
N. A. D.
,
Salmon
,
P. D.
, and
Walker
,
G. H. D.
,
2018
,
Systems Thinking in Practice: Applications of the Event Analysis of Systemic Teamwork Method
,
CRC Press
,
Boca Raton, FL
.
33.
Chatzimichailidou
,
M. M.
, and
Dokas
,
I. M.
,
2016
, “
Introducing RiskSOAP to Communicate the Distributed Situation Awareness of a System About Safety Issues: An Application to a Robotic System
,”
Ergonomics
,
59
(
3
), pp.
409
422
.
34.
Ishimatsu
,
T.
,
Leveson
,
N. G.
,
Thomas
,
J.
,
Katahira
,
M.
,
Miyamoto
,
Y.
, and
Nakao
,
H.
,
2010
, “
Modeling and Hazard Analysis Using STPA
,”
4th IAASS Conference
,
Huntsville, AL
,
May 19–21
.
35.
Hollnagel
,
E.
,
2017
,
FRAM: The Functional Resonance Analysis Method: Modelling Complex Socio-Technical Systems
, 1st ed.,
CRC Press
,
London
.
36.
Hulse
,
D. E.
,
2020
, “
A Computational Framework for Resilience-Informed Design
,” Ph.D., thesis. https://ir.library.oregonstate.edu/concern/graduate_thesis_or_dissertations/dj52wc60h.
37.
Hulse
,
D.
,
Walsh
,
H.
,
Dong
,
A.
,
Hoyle
,
C.
,
Tumer
,
I.
,
Kulkarni
,
C.
, and
Goebel
,
K.
,
2021
, “
FMDTOOLS: A Fault Propagation Toolkit for Resilience Assessment in Early Design
,”
Int. J. Prognost. Health Manage.
,
12
(
3
), pp.
0
0
.
38.
Irshad
,
L.
, and
Hulse
,
D.
,
2022
, “
Can Resilience Assessments Inform Early Design Human Factors Decision-Making?
IFAC-PapersOnLine
,
55
(
29
), pp.
61
66
.
39.
Irshad
,
L.
, and
Hulse
,
D.
,
2022
, “
Resilience Modeling in Complex Engineered Systems With Human-Machine Interactions
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol.
86212
,
American Society of Mechanical Engineers
, p.
V002T02A024
.
40.
Artman
,
H.
, and
Garbis
,
C.
,
1998
, “
Team Communication and Coordination as Distributed Cognition
,”
9th Conference of Cognitive Ergonomics
,
NA
.
41.
Hutchins
,
E.
,
1995
,
Cognition in the Wild
,
MIT Press
,
Cambridge, MA
.
42.
Kitchin
,
J.
, and
Baber
,
C.
,
2017
, “
The Dynamics of Distributed Situation Awareness
,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol.
61
,
Sage Publications Sage CA
,
Los Angeles, CA
, Paper No. 1, pp.
277
281
.
43.
Stanton
,
N. A.
,
Plant
,
K. L.
,
Revell
,
K. M.
,
Griffin
,
T. G.
,
Moffat
,
S.
, and
Stanton
,
M.
,
2019
, “
Distributed Cognition in Aviation Operations: A Gate-to-Gate Study With Implications for Distributed Crewing
,”
Ergonomics
,
62
(
2
), pp.
138
155
.
44.
Stanton
,
N. A.
, and
Harvey
,
C.
,
2017
, “
Beyond Human Error Taxonomies in Assessment of Risk in Sociotechnical Systems: A New Paradigm With the EAST ‘Broken-Links’ Approach
,”
Ergonomics
,
60
(
2
), pp.
221
233
.
45.
Yusuf
,
S. M.
, and
Baber
,
C.
,
2022
, “
Formalizing Distributed Situation Awareness in Multi-agent Networks
,”
IEEE Trans. Human-Mach. Syst.
,
52
(
6
), pp.
1166
1175
.
46.
Bruneau
,
M.
,
Chang
,
S. E.
,
Eguchi
,
R. T.
,
Lee
,
G. C.
,
O’Rourke
,
T. D.
,
Reinhorn
,
A. M.
,
Shinozuka
,
M.
,
Tierney
,
K.
,
Wallace
,
W. A.
, and
Von Winterfeldt
,
D.
,
2003
, “
A Framework to Quantitatively Assess and Enhance the Seismic Resilience of Communities
,”
Earthq. Spectra
,
19
(
4
), pp.
733
752
.
47.
Miller-Hooks
,
E.
,
Zhang
,
X.
, and
Faturechi
,
R.
,
2012
, “
Measuring and Maximizing Resilience of Freight Transportation Networks
,”
Comput. Oper. Res.
,
39
(
7
), pp.
1633
1643
.
48.
Hosseini
,
S.
,
Barker
,
K.
, and
Ramirez-Marquez
,
J. E.
,
2016
, “
A Review of Definitions and Measures of System Resilience
,”
Reliab. Eng. Syst. Saf.
,
145
, pp.
47
61
.
49.
Leveson
,
N. G.
, and
Thomas
,
J. P.
,
2023
, “
Certification of Safety-Critical Systems
,”
Commun. ACM
,
66
(
10
), pp.
22
26
.
51.
Pahl
,
G.
, and
Beitz
,
W.
,
2013
,
Engineering Design: a Systematic Approach
,
Springer Science & Business Media
,
London, UK
.
52.
Hulse
,
D.
,
Mbaye
,
S.
, and
Irshad
,
L.
,
2024
, “
Defining a Modelling Language to Support Functional Hazard Assessment
,”
ASME 2024 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Washington, DC
,
Aug. 25–28
.
53.
Irshad
,
L.
,
Ahmed
,
S.
,
Demirel
,
H. O.
, and
Tumer
,
I. Y.
,
2019
, “
Computational Functional Failure Analysis to Identify Human Errors During Early Design Stages
,”
ASME J. Comput. Inf. Sci. Eng.
,
19
(
3
), p.
031005
.
54.
Andrade
,
S. R.
, and
Hulse
,
D. E.
,
2022
, “
Evaluation and Improvement of System-of-Systems Resilience in a Simulation of Wildfire Emergency Response
,”
IEEE Syst. J.
,
17
(
2
), pp.
1877
1888
.
55.
Leveson
,
N.
,
Daouk
,
M.
,
Dulac
,
N.
, and
Marais
,
K.
,
2003
, “
Applying STAMP in Accident Analysis
,”
Second Workshop on the Investigation and Reporting of Incidents and Accidents, IRIA 2003
,
Williamsburg, VA
,
Sept. 16–19
, pp.
177
198
.
56.
Hulse
,
D.
, and
Irshad
,
L.
,
2022
, “
Using Degradation Modeling to Identify Fragile Operational Conditions in Human-and Component-Driven Resilience Assessment
,”
IEEE/AIAA 41st Digital Avionics Systems Conference (DASC)
,
Portsmouth, VA
,
Sept. 18–22
, IEEE, pp.
1
10
.
57.
Cabral
,
S.
,
2023
,
Southwest and FedEx Planes Nearly Collide at Texas Airport
,
BBC
.
You do not currently have access to this content.