U

Development of Reliability Program Standard GEIA-STD-0009

SE SummitMarch 2009

Approved for Public Release; Distribution is unlimited

GEIA-STD-0009, Reliability Program Standard for Systems Design, Development, and Manufacturing

• DSB Task Force on DT&E:– “Ensure programs are formulated to execute a viable systems

engineering strategy from the beginning, including a RAM growth program, as an integral part of design and development.”

– “Develop a military standard for RAM development and testing that can be readily referenced in future DoD contracts”

• Brisk schedule:– 1st DoD-industry WG meeting Oct 07– Formal ballot closed 30 Jun 06, unanimously approved– Final WG meeting 28-29 Jul 08

GEIA = Govt Electronics & Info Technology Assoc

Army Systems Failing Operational Reliability Tests

• 33% of systems met reliability requirements• 47% of systems fail to achieve even ½ of their reliability requirements

Demonstrated Reliability vs Requirements for All Operational Tests

0

100

200

300

400

500

600

700

800

900

1000

0 200 400 600 800 1000

Requirement MTB_

Dem

on

str

ated

MT

B_

1997 - 2006

TheProblem!

DoD O&S CostsLargest Fraction of Life Cycle Costs

Ground Combat Systems

4%

28%

68%

Rotary Wing Aircraft

4%

31%

65%

Surface Ships

1%

39%

60%

Fighter Aircraft

5%

29%

66%

RDT&E

Procurement

O&S

Source: Defense Science Board Task Force on Developmental Test & Evaluation

Color Key:

Observed Problems Addressed?

Description Mil-Std-785B IEEE 1332 SAE JA1000

Estimate and update loads being imposed on sub-assemblies and components

No No No

ID and characterize resulting failure distributions and modes

No

(not explicit)

No

(not explicit)

No

Mitigating resulting failure modes

No

(not explicit)

No

(not explicit)

No

Integrated reliability growth management

Yes

(Task 302)

No

(not explicit)

No

Determine if reliability is seriously off track early

No No No

Reliability case No Yes Yes

GEIA-STD-0009 Reliability Objectives

1. Understand customer/user requirements and constraints

2. Design and redesign for reliability

3. Produce reliable systems/products

4. Monitor and assess user reliability

Before System Testing Begins

After System Testing Begins

Notional Reliability Growth

Virtual failures from engineering- and physics-based models

Potential user failure modes

Failures from component ALT

Failures from subsystem testing

Failures from system testing

Field Failures

Potential manufacturing & workmanship failures

Reliabilit

y Assessment Req’ment

Reliability

Verificatio

n

Characterize operational & environmental loads

Clo

sed

-lo

op

fa

ilure

-m

od

e m

itig

ati

on

Systems Engineering

GEIA-STD-0009 Reliability Growth

Identify failure modes & mechanisms

• Consistent, concise, sample reliability program language for RFP sections:

– C Statement of Work– L Proposal Instructions– M Factors for Evaluation– Evaluation Checklist

• Consists of “what to do”, i.e., top-level objectives and activities that are essential in order to design, build, and field reliable systems

– Distilled from GEIA-STD-0009, Reliability Program Standard for Systems Design, Development and Manufacturing

– Developer remains responsible to identify and propose methods, tools, and a set of Best Practices (i.e., “how to do it”)

• Located at DAU website with overview and URL being included in Defense Acquisition Guidebook, Guide for Integrating Systems Engineering into DoD Acquisition Contracts, and Incorporating Test and Evaluation into DoD Acquisition Contracts

Will cause developers to plan for and resource a reliability “growth

program, as an integral part of design and development”

DoD RIWG Task 1.2 Sample RFP Language

Supports New Army and DoD Policies

RIWG Task 1.4 Standard Evaluation Criteria

• Standard evaluation criteria needed to provide consistent way to evaluate program’s reliability health early in the development process

• RIWG developed Reliability Scorecard that assesses critical reliability activities in the areas of

• Tool developed to view scorecard in Acquisition Community Connection – R&M Interest Area

• Link to be included in DAG• Army T&E Evaluator will use for implementing new Army Reliability

Policy

Reliability Requirements and Planning Training and Development Reliability Analysis Reliability Testing

Supply Chain Management Failure Tracking and Reporting Verification and Validation Reliability Improvements

Supports New Army and DoD Policies

Guidance

• DoD Guide for Achieving Reliability, Availability, and Maintainability, 3 Aug 2005

• Concerning Reliability Assessment and Verification: “Best Practices for Reliability Assessment and Verification”, ITEA Journal, Sep, 2008

• Implementing contractual language developed by DoD Reliability Improvement Working Group– Contractual language will be regularly revised based

on lessons learned• Reliability Scorecard developed by AMSAA and DoD

Reliability Improvement Working Group