Professional Documents
Culture Documents
Cody Fleming
SYSTEMS ENGINEERING
RESEARCH LABORATORY
SERL
Goals of this Talk
1. How does regulation work in aviation?
– ARP 4761, others
2
SERL
ARP 4761
3
SERL
Development & Certification Process
Development and Design Guidance
[ARP-4754A, 2010]
• Methods
– FTA, FMEA
– Zonal, CCA, DD, MA
7
SERL
Agenda
• ARP4761 Process
• ARP4761 Application
• STPA Results
• 4761 and STPA
• Future
8
4761 – Wheel Brake System
SERL
Shut Off
BSCU Isolation
Selector
Valve Valve
A
Brake System N L
O T
Annunciation R E
M R
A N
L A
Selector T
Valve E
AS
Shut Off Accumulator
Anti Skid Valve
CMD/
Meter
Anti Skid
Valve
Mech. Pedal Position
Meter
Valve
Wheel
9
SERL
Aircraft FHA
1 2 Failure Condition 3 4 Effect of Failure Condition on 5 V&V
Function (Haz Description) Phase Aircraft/Crew Classificat’n
Decelerate Loss of Deceleration Landing/ See Below
Aircraft on Capability RTO/…
the a. Unannuciated loss Landing/ Crew is unable to decelerate the Catastrophic Aircraft
Ground of deceleration RTO aircraft resulting In a high speed Fault
capability overrun Tree
b. Annunciated loss of Landing Crew selects a more suitable airport, Hazardous Aircraft
deceleration notifies emergency ground support Fault
capability and prepares occupants for landing Tree
overrun.
c. Unannunciated loss Taxi Crew is unable to stop the aircraft on Major
of deceleration the taxi way or gate resulting In low
capability speed contact with terminal, aircraft,
or vehicles
d. Annunciated loss of Taxi Crew steers the aircraft clear of any No Safety
deceleration obstacles and calls for a tug or Effect
portable stairs
Inadvertent Takeoff Crew is unable to takeoff due to Catastrophic Aircraft
Deceleration after Vl application of brakes at the same time Fault
(Takeoff/RTO as high thrust settings resulting in a Tree
decision speed) high speed overrun
10
SERL
Aircraft FHA
1 Function 2 Failure Condition 3 4 Effect of Failure 5
(Haz Description) Phase Condition on Aircraft/Crew Classificat’n
11
SERL
PSSA
• Continuation of FHA on “systems”
12
SERL
PSSA
Loss of Aircraft
Preliminary Fault Tree LOSSOFAC
UNLSSPDBR UNANLSSWB
PROB: PROB:
5.00E-07 (0) 5.00E-07 (0) 13
SERL
Derived Safety Requirements
Safety Requirement Design Decisions Remarks
1. Loss of all wheel braking More than one hydraulic The overall wheel brake
(unannunciated or system required to achieve system availability can
annunciated) during landing the objective (service reasonably satisfy this
or RTO shall be less than experience). Dual channel requirement. See PSSA FTA
5E-7 per flight. BSCU and multimode brake below.
operations.
2. Asymmetrical loss of Separate the rudder and The wheel braking system
wheel braking coupled with nose wheel steering system will be shown to be
loss of rudder or nose wheel from the wheel braking sufficiently independent
steering during landing system. Balance hydraulic from the rudder and nose
shall be less than 5E-7 per supply to each side of the wheel steering systems.
flight. wheel braking system. System separation between
these systems will be shown
in the zonal safety analysis
and particular risk analysis
14
SERL
Derived Safety Requirements
Safety Requirement Design Decisions Remarks
1. The primary and Install hydraulic supply to Compliance will be shown
secondary system shall be the brakes in front and by ZSA and PRA. (Editor's
designed to preclude any behind the main gear leg. Note: In this example only
common threats (tire burst, for the main gear bay zone
tire shred, flailing tread, and the tire burst
structural deflection). particular risk.).
2. The primary and Choose two different Compliance will be shown
secondary system shall be hydraulic systems to by CMA.
designed to preclude any supply the brakes,
common mode failures emergency braking without
(hydraulic system, electrical power.
electrical system,
maintenance, servicing,
operations, design,
manufacturing, etc.).
15
SERL
SSA
• Continuation from PSSA
16
SERL
SSA Detectable BSCU 1
Failure Causes Bad Data
Which is Provided to
Normal System MV
BSCU1DETD
Computer-related FTA
2.00E-09
BSCU 1 Power Supply BSCU 1 Power Supply BSCU 1 Monitor BSCU 1 Command Channel
Motor Stuck Valid Failure Causes Bad Channel Always CPU or I/O Failure/Error
Data Reports Valid Causes Bad Data
BS1PSMOFV BSCU1PSF BSCU1MORV BSCU1CDF
PROB: 2.00E-02 (1) PROB: 5.00E-08 (1)
2.00E-02 5.00E-08
RATE: 2.00E-07 /H RATE: 1.20E-05 /H
EXPO: 1.00000 H EXPO: 0.004167 H
Budgeted F.R. Budgeted F.R.
BSCU 1 Validity Monitor BSCU 1 Monitor BSCU 1 Failure Causes BSCU 1 Command
Failed Valid Due to Channel Design Error Loss of Braking Channel I/O Failure
Hardware Failure Commands Causes Bad Data
BSCU1MOFV BSCU1CMDE BSCU1CPUBD BSCU1I/OF
PROB: 2.00E-02 (1) PROB: 0.00E+00 (0) 3.12E-08 PROB: 1.88E-08 (1)
RATE: 2.00E-07 /H Level B RATE: 4.50E-06 /H
EXPO: 1.00000 H EXPO: 0.4167 H
Budgeted F.R. Budgeted F.R.
BSCU 1 Command BSCU 1 CPU Function
Channel CPU Design Error Causes
Hardware Failure Bad Data
Causes Bad Data
BSCU1FAILS BSCU2FAILS
PROB: 3.13E-08 (1) PROB: 0.00E+00 (0)
RATE: 7.50E-06 /H Level A
EXPO: 0.4167 H
Budgeted F.R. 17
SERL
Computer-related FTA
BSCU 1 Monitor
Channel Always
Reports Valid
BSCU1MORV
2.00E-02
18
SERL
Safety Assessment Elements
Probability 1.0 1.0E-3 1.0E-5 1.0E-7 1.0E-9
(Quantitative)
FHA Development Level D Level C Level B Level A
Assurance
Level
PSSA
SSA
• Flow into DO-178 (software) and DO-
254 (hardware)
• Those documents provide guidance in
how to achieve the different levels (a
discussion for another time)
19
SERL
Agenda
• Motivation
• ARP4761 Process
• ARP4761 Application
• STPA Results
• 4761 and STPA
• Future
20
SERL
Control Structure
Other Aircraft
Crew, left/right Sensory inputs
Systems
Main Wheel
Bogie Assy
21
SERL
Unsafe Control Actions
Control Action Not providing Providing causes Too soon, too late, Stopped too soon,
Flight Crew: causes hazard hazard out of sequence applied too long
CREW.1 CREW.1a1 CREW.1b1 CREW.1c1 CREW.1d1
Not providing Manual braking Manual braking Manual braking
Manual braking
manual braking provided with applied before stopped too soon
via brake pedals during landing or insufficient pedal touchdown causes before safe taxi
RTO while autobrake pressure, resulting wheel lockup, loss of speed reached,
not providing inadequate control, tire burst resulting in over-
braking (or deceleration during speed or overshoot
insufficient braking), landing
leading to overshoot
CREW.1b2 CREW.1c1 CREW.1d2
Manual braking Manual braking Manual braking
provided with applied too late to applied too long,
excessive pedal avoid collision or resulting in stopped
pressure, resulting in conflict with another aircraft on runway
loss of control, object or active taxiway
passenger/crew
injury, brake
overheating, brake
fade or tire burst
during landing
22
SERL
Unsafe Control Actions
Control Action Not providing Providing causes Too soon, too late, Stopped too soon,
BSCU: causes hazard hazard out of sequence applied too long
BSCU.1 BSCU.1a1 BSCU.1b1 BSCU.1c1 BSCU.1d1
Braking pressure Braking pressure Braking pressure Reduced
Command
not provided during commanded applied before deceleration if
Braking RTO (to V1), excessively, touchdown, brake pressure is
Pressure resulting in inability resulting in rapid resulting in tire released during
to stop within deceleration and burst, loss of landing roll before
available runway injury in pushback control, injury, TBD taxi speed
length other damage attained
BSCU.1a2 BSCU.1b2 BSCU.1c2 BSCU.1d2
Brake pressure not Braking pressure Braking pressure Stop on runway if
provided during applied applied too long brake pressure not
landing roll, inappropriately after touchdown, released during
resulting in during takeoff, resulting in landing roll after
insufficient resulting in insufficient TBD taxi speed
deceleration and inadequate deceleration and attained
potential overshoot acceleration potential loss of
control, overshoot
… …
23
SERL
BSCU (Brake Comp.) Analysis
Flawed Control Unsafe Control Action: BSCU.1b2
Algorithm: Braking pressure applied inappropriately during takeoff, resulting in inadequate acceleration
Algorithm for
determining that aircraft Manual braking
has lifted off is incorrect pressure incorrectly
Due to… applied or misread
Algorithm for
determining pilot
braking... Controller: BSCU
Incomplete or inaccurate process model:
Flawed Control BSCU is unaware that aircraft is in V1 speed incorrect or misread
Algorithm: takeoff phase (but may still have correct Ground/airspeed incorrect or misread
Brake apply signal Algorithm for WOW and air/groundspeed readings and Flight mode incorrect or misread
given during takeoff determining when it is too thus applies brakes)
late to apply brakes Proc Model Variables: Flight Mode
Mismatch in data format;
Command to close during takeoff is BSCU is unaware that aircraft has passed
valve (and release Mismatch in units (Eng v
incorrect, i.e. incorrect V1 speed
brake) is given to Met)
computation of V1 speed Proc Model Variables: Groundspeed
Sensor readings are too
incorrect valve; e.g. BSCU incorrectly assesses that aircraft
to Green sys. during slow (BSCU computes at
Flawed Control has left ground
alternate mode 100Hz but sensor
Algorithm: Proc Model Variables: Altitude, WOW
updates at 1Hz)
BSCU is
braking...
unaware thatIncomplete
Controller: BSCU
aircraft is process
or inaccurate in model:
Flawed Control BSCU is unaware that aircraft is in 1V speed incorrect or misread
takeoff phase
Brake apply signal
Algorithm:
Algorithm for
(but may WOW stillandhave
takeoff phase (but may correct
still have correct
air/groundspeed readings and
Ground/airspeed incorrect or misread
Flight mode incorrect or misread
WOW and
given during takeoff
air/groundspeed
determining when it is too
late to apply brakes readings and
thus applies brakes)
Proc Model Variables: Flight Mode
Mismatch in data format;
Command to close during takeoff is BSCU is unaware that aircraft has passed
thus
valve (and release
brake) is given to
appliesincorrect, brakes)
i.e. incorrect V speed
1
Mismatch in units (Eng v
Met)
computation of V speed
1 Proc Model Variables: Groundspeed
Sensor readings are too
Proc
incorrect valve; e.g.
to Green sys. during
Model Variables:
Flawed Control
Flight
BSCU Mode
incorrectly
has left ground
assesses that aircraft
slow (BSCU computes at
BSCU isAlgorithm:
alternate mode 100Hz but sensor
unaware that aircraft has passed
Proc Model Variables: Altitude, WOW
updates at 1Hz)
V1 speed
Actuator: Meter valves
Sensor: Caliper and WOW Sensors
Hydraulic pressure measurement error
Proc
Signal to release Model Variables:
brakes mis-read/not Groundspeed
* Meter valve position
incorrectly read Weight on wheels incorrect or misread
[Thornberry 2014] 26
SERL
Agenda
• ARP4761 Process
• ARP4761 Application
• STPA Results
• 4761 and STPA
• Future
27
A Note on “Annunciation”
SERL
28
SERL
STPA and 4761 FMEA
• Where is the pilot in 4761?
– The only relevant thing to pilot is “unannunciated”,
• Why?
– It is not just because FTAs and other methods
29
SERL
STPA and 4761
• What about software?
31
SERL
Agenda
• ARP4761 Process
• ARP4761 Application
• STPA Results
• 4761 and STPA
• Future
32
SERL
Next Few Months
33
SERL
Longer Term
34
SERL
References
1. NTSB Case Number: DCA13IA037, Interim Factual Report Boeing
787-8, JA829J, Japan Airlines (Boston, Massachusetts, January 7,
2013), National Transportation Safety Board, Office of Aviation
Safety, March 7, 2013
2. Boeing 787 Program Information “About the Dreamliner” (accessed
20 March 2014)
http://www.boeing.com/boeing/commercial/787family/background.pag
e?
3. Boeing 787 Wikipedia page (accessed 20 March 2014)
http://en.wikipedia.org/wiki/Boeing_787_Dreamliner
4. ARP 4761: Guidelines and Methods for Conducting the Safety
Assessment Process on Civil Airborne Systems and Equipment.
Warrensdale: SAE International, 1996. Print.
5. 787 picture
6. The Unwanted Blog, http://up-ship.com/blog/?p=6045, May 01, 2010
7. Ross & Tweedie, The Telegraph, UK
http://www.telegraph.co.uk/technology/9231855/Air-France-Flight-
447-Damn-it-were-going-to-crash.html, April 28, 2012, Getty Images
35
SERL
BSCU (Brake Comp.) Analysis
Flawed Control Unsafe Control Action: BSCU.1b2
Algorithm: Braking pressure applied inappropriately during takeoff, resulting in inadequate acceleration
Algorithm for
determining that aircraft Manual braking
has lifted off is incorrect pressure incorrectly
Due to… applied or misread
Algorithm for
determining pilot
braking... Controller: BSCU
Incomplete or inaccurate process model:
Algorithm:
Sensor: Caliper and WOW Sensors
Flawed Control BSCU is unaware that aircraft is in
V speed incorrect or misread
Ground/airspeed incorrect or misread
takeoff phase (but may still have correct
1
Brake apply signal Algorithm for WOW and air/groundspeed readings and Flight mode incorrect or misread
given during takeoff determining when it is too thus applies brakes)
Hydraulic pressure measurementMismatch
late to apply brakes Proc Model Variables: Flight Mode error in data format;
Command to close during takeoff is BSCU is unaware that aircraft has passed
valve (and release
brake) is given to
Weight on wheels incorrect or misread
incorrect, i.e. incorrect
computation of V1 speed
V1 speed
Mismatch in units (Eng v
Met)
Proc Model Variables: Groundspeed
Sensor readings are too
BSCU incorrectly assesses that aircraft
incorrect valve; e.g.
to Green sys. during Aircraft
Flawed Control
pitches (e.g. due
has left ground
to winds) slow (BSCU computes at
100Hz but sensor
alternate mode Algorithm: Proc Model Variables: Altitude, WOW
resulting in inconsistent weight-on- updates at 1Hz)
38
SERL
Definitions
39
SERL
Definitions
40
SERL
Definitions
41
SERL
Definitions
42
SERL
4761 Objectives
• FHA Outputs
– FHA input function list
– Environmental and Emergency Configuration List
– Derived safety requirements for the design at each
level
– FHA Report
• Functions, failure conditions, phase of ops, …
43
SERL
4761 Objectives
• PSSA Outputs
– Planned compliance with FHA requirements
– Updated FHAs
– Material supporting classification list
– Failure condition list
– Lower level safety requirements (including DALs)
– Qualitative FTAs
– Preliminary CCAs
– Operational requirements
44
SERL
4761 Objectives
• SSA Outputs
– Updated failure condition list or FHA which includes
rationale showing compliance with safety
requirements (qual and quant)
– Documentation showing how req’s for the design of
the system items’ installation have been incorporated
(segregation, protection, etc.)
– Materials used to validate the failure condition
classification
– Maintenance tasks
– Documentation showing how system has been
developed according to DAL
45
SERL
Background
• Aircraft are VERY safe
46
SERL
Background
47
SERL
Past, Present, and Future
48
SERL
Past
[UWB, 2010] 49
SERL
Present
[Bicheno-Brown, 2012] 50
SERL
Present
[Bicheno-Brown, 2012] 51
SERL
Future
52
SERL
A Note on PRA
• Boeing 787 LiCo Batteries
• Prediction/Certification:
– No fires within 107 flight hours
– Followed 4761 certification
paradigm
• Actual experience:
– Within 52,000 flight hours – 2 such
events
– 2.6 x 104 flight hours [NTSB 2013]
[http://upload.wikimedia.org/wikipedia/commons/9/95/Boeing_Dreamliner_battery_original_and_damaged.jpg] 53
SERL
A Note on PRA
• I love the 787 and I continue to cheer it on!