Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... ·...

47
Peter Bunus [email protected] Towards a Model-Based Safety Assessment Process of Safety Critical Embedded Systems

Transcript of Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... ·...

Page 1: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Peter [email protected]

Towards a Model-Based Safety Assessment Process of Safety Critical Embedded Systems

Page 2: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Personal Presentation

Peter Bunus

Product and Technology Manager

Responsible with the Technical Development of RODON, a model-based diagnostics system used by avionics and automotive industry

[email protected]

Part Time (15%) Assistant Professor at the Department of Computer and Information Science, Linköping University, SWEDEN

• Course Leader and Examiner for TDDB84 Design Patterns

• Research on modeling and simulation languages, model-based software development, program static analysis and verification, debugging, diagnosis

• Programming environments

Page 3: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

How to Prevent Failures

Todays lecture will be about how to prevent failures

What is needed to be done during the design process

What can be done after the system is deployed to minimize failure effects

Picture from Radio Nederland Wereldomroep Picture from Radio Nederland Wereldomroep

Picture taken by Janis Krums

Page 4: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Attributes of Dependability

IFIP WG 10.4 definitions

Safety: absence of harm to people and environment

Availability: the readiness for correct service

Integrity: absence of improper system alterations

Reliability: continuity of correct service

Maintainability: ability to undergo modifications and repairs

Page 5: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Maintainability

Page 6: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Models of After Sales Services

Service

priority

Business

model

Terms Example Product

owner

None Disposal Dispose of products when they

fail or need to be upgraded

Razor blades Consumer

Low Ad hoc Pay for support as needed TVs Consumer

Medium-high Warranty Pay fixed price as needed PCs Consumer

Medium-high Lease Pay fixed price for a fixed time;

option to buy product

Vehicles Manufacturer;

High Cost-plus Pay fixed price based on cost

and pre-negotiated marginConstruction leasing company

Very high Performance

based

Pay based on product’s

performanceAircraft Customer

Very high Power by the

hour

Pay for services used Aircraft engines Customer

Page 7: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Geographical Hierarchy

Central repair facility, spare parts warehouse, and distribution center

Regional repair facilities andspare parts distribution centers

Field repair facilitiesand spare partsdistribution centers

Stocks of spare parts on-site with customers

Page 8: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

After Sales Services

Page 9: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Houston – We’ve had a problem

Page 10: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Houston – We’ve had a problem

Page 11: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

What do you think?

Which kind of Services do we need to provide to the Apollo 13 crew members?

Page 12: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754
Page 13: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Model of the NASA ADAPT Satellite System

Page 14: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Model-Based Diagnosis Principles

Observations

Simulation

Observed behavior

Model of the passenger seat system

Diagnostic Reasoner

Corrections repair actions

Actual systemPassenger seat system

Predicted behavior

Diagnosis

Page 15: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

The Diagnostic Problem

Diagnostic Reasoner

DesignStructural Description

Domain KnowledgeComponent

V=i*R

Measurements/Observations

X=6V

DiagnosisRepair Actions

Replace servoValve

Page 16: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Where the Model Comes From?

Page 17: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Traditional Design Flow

Traditional Design FlowCharacterized by a sequential flow, iteration is expensive

Manual code development, paper intensive, error prone, resistant to change

Projects get complex to manage by the end of integration process

Documentation

REQUIREMENTSANALYSIS

Documentation

DESIGN

Documentation &Code and Hardware

IMPLEMENTATION

Documentation &Testing

INTEGRATION &TESTING

Documentation &Testing on Target

VALIDATION

Page 18: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Model-Based Design

DocumentationRequirements & Algorithm Spec &Architecture Spec

REQUIREMENTSANALYSIS

Executable Specification

DESIGN

Executable Specification &Generated Code

IMPLEMENTATION

Simulation & Testing

INTEGRATION &TESTING

Simulation &Testing on Target

VALIDATION

Model-Based Design FlowBuild explicit architectures of predictable systemsGo seamlessly from abstraction to realizations Capitalize on verification activities early and all along the development flow

Page 19: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

ARP 4754 Safety Assessment Diagram

SAE ARP 4754 "Certification Considerations for Highly-Integrated or Complex Aircraft Systems

Page 20: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Frequency of Faults

Page 21: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Traditional Model Development

Platform expert

Domain experts

Technology expert

Domain analysts, Modelers, Designers, Developers

Traditional Development Tools Application

Technology expertise

Platform expertise

Domain expertise

Page 22: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

MDA-Based Modeling and Development

Platform expert

Domain experts

Technology expert

Application Developers

MDA Tools

Application

Technology expertise

Platform expertise

Domain expertise

Implementation expertise

Page 23: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Model-Based Approach to Safety Assessment

SAE ARP 4754 "Certification Considerations for Highly-Integrated or Complex Aircraft Systems

Page 24: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Flexibility in Supporting the Process

Page 25: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Vehicle Verification Stage

FHA

PrelFTA

CCA

To OtherSystems Prel

FTA

CCA

Arch ReqFE & P Budget

To OtherSystems Prel

FTA

CCA

Arch ReqFE & P Budget

HW

SW

FMEA

FMLambdaFE

FMEA

FTACCA

Update

FMEA

FMEA

FTACCA

Update

FTACCA

Update

RequirementIdentification

SystemRequirementIdentification

ItemRequirementIdentification

Item DesignImplementation

ItemVerification

SystemVerification

VehicleVerification

Arch ReqFE Lambda budgetHW LevelSW Level

Page 26: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

The Diagnosis Problem

Page 27: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Traditional Service Process

Page 28: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Tutorial Demo Exterior Lighting

Page 29: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754
Page 30: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Model-Based Diagnostics in Practice

Page 31: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Diagnostic Rules

Resources Diagnostic Engine:

16 Bit μ-processor, 25 Mhz

118 KB Flash memory

Resources Diagnostic Application:

Compiled model < 2KB

Some 20 msec time

Generated by systematic computation

Contains virtually all

Root cause <=> symptom relationships

Applicable in Real Time systems

Finds single & multiple faults

Interfaces exist to various embedded systems exist

Page 32: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Item & System Verification Stage

FHA

PrelFTA

CCA

To OtherSystems Prel

FTA

CCA

Arch ReqFE & P Budget

To OtherSystems Prel

FTA

CCA

Arch ReqFE & P Budget

HW

SW

FMEA

FMLambdaFE

FMEA

FTACCA

Update

FMEA

FMEA

FTACCA

Update

FTACCA

Update

RequirementIdentification

SystemRequirementIdentification

ItemRequirementIdentification

Item DesignImplementation

ItemVerification

SystemVerification

VehicleVerification

Arch ReqFE Lambda budgetHW LevelSW Level

Page 33: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

FMEAMB

The FMEA Process

Engineering

FMEA

FM modeling

Func decomp

Effectmodeling

Design and CADInformation

ReusableFailure Data

R&D

• Traditional FMEA Process.Based on documents andmanual reasoning

• Model Based FMEA providesystematic and quickerfeedback to engineeringautomatically

Page 34: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Tutorial Demo Model and Generated FMEA

Page 35: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Failure Impact on Functions (detected and undetected)

RODON based FMEAdetects recognized and unrecognized failures

Page 36: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Item Design Implementation Stage

FHA

PrelFTA

CCA

To OtherSystems Prel

FTA

CCA

Arch ReqFE & P Budget

To OtherSystems Prel

FTA

CCA

Arch ReqFE & P Budget

HW

SW

FMEA

FMLambdaFE

FMEA

FTACCA

Update

FMEA

FMEA

FTACCA

Update

FTACCA

Update

RequirementIdentification

SystemRequirementIdentification

ItemRequirementIdentification

Item DesignImplementation

ItemVerification

SystemVerification

VehicleVerification

Arch ReqFE Lambda budgetHW LevelSW Level

Page 37: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Train Electrical Door System

Page 38: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Diagnostics Results – Decision Trees

Page 39: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Requirements Identification Stage

FHA

PrelFTA

CCA

To OtherSystems Prel

FTA

CCA

Arch ReqFE & P Budget

To OtherSystems Prel

FTA

CCA

Arch ReqFE & P Budget

HW

SW

FMEA

FMLambdaFE

FMEA

FTACCA

Update

FMEA

FMEA

FTACCA

Update

FTACCA

Update

RequirementIdentification

SystemRequirementIdentification

ItemRequirementIdentification

Item DesignImplementation

ItemVerification

SystemVerification

VehicleVerification

Arch ReqFE Lambda budgetHW LevelSW Level

Page 40: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Early Function Failure Analysis

Page 41: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Early test strategies

Page 42: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Testability and Test Coverage

Page 43: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Models for Reliability Prediction

Page 44: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Model-Based Safety Assessment

The biggest disadvantage of every model-based approach is the model itself

Building models takes time

Finding the right level of abstraction is difficult

Model Reusability can be achieved by development of generic model libraries

Page 45: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Communication with other Systems

RELEXISOGRAPHCFTA

Page 46: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Modeling Challenge

FailureTreeAnalysis

FunctionArchitecture

SystemArchitecture

Page 47: Towards a Model-Based Safety Assessment Process of Safety ...simna73/teaching/REAP/HT09/... · Process of Safety Critical Embedded Systems . Personal Presentation ... SAE ARP 4754

Conclusions

The Safety Assessment community should look closer on integrations issues as well

Common modeling formalism and model-based approach for safety assessment process is important.