During the CIEHF Human Factors in Aviation Safety Conference in London we presented our new tool for assessing the planning for safety culture within organizations, as part of our Aviation Safety Metrics research. A list of publications for this research can be found here: https://lnkd.in/eAchuCi

1. INTRODUCING THE AVIATION
ACADEMY SAFETY CULTURE
PREREQUISITES (AVAC-SCP)
TOOL
S. Piric
Lecturer Researcher
Amsterdam University of Applied Sciences

2. ABOUT THE AVIATION ACADEMY
Dr. Nektarios Karanikas, Project Lead
Steffen Kaspers, PhD candidate
Alfred Roelen, Researcher
Selma Piric, Researcher
Robbert van Aalst, Researcher
Robert Jan de Boer, Lector
The Aviation Academy provides a 4-
year BSc. course.
1300 students total
Education, applied research
Various research activities, including
safety, MRO and Data Mining
Professional Courses

3. MEASURING AVIATION SAFETY

4. CURRENT CHALLENGES FOR AVIATION
COMPANIES
• Small – Medium Enterprises: lack of adequate
operational data to monitor safety
• Large companies: operational data is available, but
they need leading metrics of better quality
• How to move from compliance-based to performance-
based monitoring?
4

5. 5

6. RESEARCH PHASES
Phase 1:
Current
Situation
Phase 2:
Development
of new safety
metrics
Phase 3:
Application of
metrics and
validation
Phase 4:
Development
of the tool
December
2019
September
2015

7. PHASE 1: CURRENT SITUATION &
PRACTICE
• Safety metrics can be split into two groups:
• Safety process metrics (proactive): SMS activities
• Safety outcome metrics (reactive): occurrence reports, (serious)
incidents, safety performance
• There is no proven consistent relationship
• How to find out whether SMS activities have the desired
effect?
• Challenge: Develop metrics that will be more
representative of SMS/operational processes and safety
outcomes.
7

8. PHASE 2: DEVELOPING NEW SAFETY
METRICS
8
Work as
Imagined (WAI)
Work as Done
(WAD)
WAI - WAD
System
Performance
Safety performance negatively affected by gap between what must be
done, and what is actually done.
The effects of the gap between Work-As-Imagined and Work-As-Done on
safety outcomes has not yet been sufficiently examined.

9. 6 NEW METRICS DEFINED
• SMS Assessment tool
• System complexity
• Risk control effectiveness
• Resource utilization
• Work-as-Done vs. Work-as-Imagined on process level
• Safety Culture Prerequisites
9

10. SAFETY CULTURE PREREQUISITES
10

11. SAFETY CULTURE
• The Aviation Academy of the
Amsterdam University of Applied
Sciences reviewed safety culture
literature across various industries:
• Identified 37 conditions (prerequisites)
for safety culture development;
• Example prerequisite:
• In cases of mistakes/errors that led to
adverse outcomes, support to employees
for their reintegration is provided.
11

12. MEASURING SAFETY CULTURE
• Current safety culture measurement tools:
• Do not reflect all prerequisites for safety culture.
• Usually measure subjective perceptions of the workforce:
• Can this be used to provide organizations with guidance on action points for
improving their safety culture?
12

13. PREREQUISITES TOOL
• 70 items reflecting the prerequisites
• Categorized in one of the 6 categories
• General prerequisites
• Just culture
• Reporting culture
• Informative culture
• Flexible culture
• Learning culture
13

14. WHAT MAKES THIS TOOL UNIQUE?
• The goal of the tool is not to measure safety culture, it aims to gain
insights in the plans that an organisation has in place to foster safety
culture;
• Provides actionable items that any organisations can use in order to
improve their planning for safety culture;
• Objectiveness;
• The tool is based upon academic research;
• Reviewed by knowledge experts and companies against various
quality criteria.
14

15. ANALYSING SAFETY CULTURE PREREQUISITES
15
Prerequisites in Documentation analysis:
which are currently present? 70 items
Survey questions checking for implementation:
To what extent is the behaviour present? 70 items
Perception of the employees:
Rate the perceived safety culture:
6 items

16. DOCUMENTATION OF SAFETY CULTURE
16

17. ANALYSING SAFETY CULTURE PREREQUISITES
17
Prerequisites in Documentation analysis:
which are currently present? 70 items
Survey questions checking for implementation:
To what extent is the behaviour present? 70 items
Perception of the employees:
Rate the perceived safety culture:
6 items

18. IMPLEMENTATION OF SAFETY CULTURE
18

19. ANALYSING SAFETY CULTURE PREREQUISITES
19
Prerequisites in Documentation analysis:
which are currently present? 70 items
Survey questions checking for implementation:
To what extent is the behaviour present? 70 items
Perception of the employees:
Rate the perceived safety culture:
6 items

20. PERCEPTION OF SAFETY CULTURE
20

21. ANALYSING SAFETY CULTURE PREREQUISITES
21
Prerequisites in Documentation analysis:
which are currently present? 70 items
Survey questions checking for implementation:
To what extent is the behaviour present? 70 items
Perception of the employees:
Rate the perceived safety culture:
6 items
Distance between
Work-as-Imagined
& Work-as-Done
Distance between
Perception &
Work-as-Imagined

22. IN SHORT
• The Aviation Academy Safety Culture Prerequisite Tool provides an
insight into planning for safety culture in any company regardless of
size or industry;
• Provides actionable items;
• Based on academic literature, and expert and industry reviews.
• Next steps: Apply and validate alternative safety metrics
• We’re always looking for research partners!
22

23. THANK YOU
23
http://www.amsterdamuas.com/aviation