No Doubt – The LRAS3/FS3 Story of Mission Assurance · No Doubt – The LRAS3/FS3 Story of...

No Doubt – The LRAS3/FS3 Story of Mission Assurance

Jill BrooksSheleen JohnsonNetwork Centric Systems

11/15/2006

Agenda• Introduction to Raytheon• LRAS3/FS3 Overview• Sound Engineering Processes• Partnership With The Customer• Results Speak For Themselves• Summary

11/15/2006

Introduction to Raytheon• Raytheon is an industry leader in defense and government electronics,

space, information technology, technical services, and business aviation and special mission aircraft

• Network Centric Systems (NCS) develops and produces mission solutions for networking, command and control, battlespace awareness, and air traffic management

11/15/2006

Introduction to Raytheon – continued

IPI CMM-based Internal Process Improvement AssessmentRTIS Raytheon/TI SystemsCMMI CMM Integrated

10x Fault DensityImprovementLevel 3

Level 2

BaldridgeAward

Level 3BaselineValidation

Level 2Repeatable

Level 3Defined

198919911990

1992 1993 1994

Level 4/5Managed/Optimizing

RaytheonAcquisition & Transition

20001995 1996 1997 1999-

2001 2002 2003

Level 410x Fault DensityImprovement

10x Fault DensityImprovementLevel 3Level 3

Level 2Level 2

BaldridgeAward

BaldridgeAward



Level 2Repeatable

Level 3Defined

198919911990

1992 1993 1994



20001995 1996 1997 1999-

2001 2002 2003

Level 2Repeatable

Level 3Defined

198919911990

1992 1993 1994

Level 2Repeatable

Level 2Repeatable

Level 3DefinedLevel 3Defined

198919911990

1992 1993 1994

198919891991199119901990

19921992 19931993 19941994



20001995 1996 1997 1999-

2001 2002 2003





20001995 1996 1997 1999-

2001 2002 200320002000

19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003

Level 4Level 410x Fault DensityImprovement


Level 2Level 2

BaldridgeAward

BaldridgeAward



Level 2Repeatable

Level 3Defined

198919911990

1992 1993 1994



20001995 1996 1997 1999-

2001 2002 2003

Level 2Repeatable

Level 3Defined

198919911990

1992 1993 1994

Level 2Repeatable

Level 2Repeatable


198919911990

1992 1993 1994

198919891991199119901990

19921992 19931993 19941994



20001995 1996 1997 1999-

2001 2002 2003





20001995 1996 1997 1999-

2001 2002 200320002000

19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003

Level 4Level 4

RTIS Integrated Product

Development Process

Software Sigma& Cycle Time

RTIS Policies & Procedures

RTIS Software Operating Instructions

10x Fault DensityImprovement


Level 2Level 2

BaldridgeAward

BaldridgeAward

Self-assessmentSoftware ImprovementTeam Formed



Level 2Repeatable

Level 3Defined

198919911990

1992 1993 1994

Level 2Repeatable

Level 2Repeatable


198919911990

1992 1993 1994

198919891991199119901990

19921992 19931993 19941994



20001995 1996 1997 1999-

2001 2002 2003





20001995 1996 1997 1999-

2001 2002 200320002000

19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003

Level 2Repeatable

Level 2Repeatable


198919911990

1992 1993 1994

198919891991199119901990

19921992 19931993 19941994

Level 2Repeatable

Level 2Repeatable


198919891991199119901990

19921992 19931993 19941994

198919891991199119901990

19921992 19931993 19941994





20001995 1996 1997 1999-

2001 2002 200320002000

19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003





2000200019951995 19961996 1997 1999-1997 1999-

20012001 20022002 2003200320002000

19951995 19961996 1997 1999-1997 1999-20012001 20022002 20032003

Level 4Level 4

Level 4IPI

SW Level 5SE Level 3

2003200320032003200320032003200320032003200320032003200320032004 2003200320032003200320032003200320032003200320032003200320032005 2003200320032003200320032003200320032003200320032003200320032006 2003200320032003200320032003200320032003200320032003200320032007

SW, SE & HWMulti-site

Level 5CMMI

CMMI

11/15/2006

LRAS3/FS3 Overview• The LRAS3/FS3 is a long range reconnaissance and

surveillance multi-sensor suite system with the capability to determine far target location (FTL) coordinates, and to provide real-time target detection, recognition, and identification capability to the scout while permitting 24-hour adverse weather operations. In addition, the FS3 variant provides laser designation of a target for laser guided weapons.

LRAS3/FS3 Product supports scout and fire support missions

11/15/2006

LRAS3/FS3 Overview – continued• FS3 product supports Knight fire support missions. The

LRAS3 product supports scout operations and is operable in both a stationary vehicle mounted configuration and in an autonomous dismounted configuration The host vehicle for the system is the High Mobility Multi-purpose Wheeled Vehicle (HMMWV) and Stryker Armored Vehicle.

LRAS3/FS3 Product supports scout and fire support missions

11/15/2006

• SW engineering processes assessed as CMMI Level 5, in 2003

• Rigorous approach to engineering practices, key examples include:– Requirements Management

• Used DOORs tool to support bi-directional traceability• Ensures that the impact of changes to requirements is understood and

addressed through out the system– Configuration Management

• Used through out the life-cycle of the product from Requirements Definition, through design, implementation, test and maintenance

• A multi-tiered approach that has different requirements for different artifacts and for different points in an artifact’s lifecycle

Engineering process supports Mission Assurance

Sound Engineering Processes

11/15/2006

Sound Engineering Processes –continued• Additional engineering practices that played a key role in the

mission assurance success of LRAS3/FS3: – Peer Reviews

• Not the “glamorous” part of the process, but rigorous application pays off• Verification by Quality Engineering

– Verification, Validation• An iterative approach• Back to basics, back to the requirements

– Quality Engineering• Maintained independence, but an integral part of the program• Ensured adherence to defined processes• Worked with program to find solutions

Engineering process supports Mission Assurance

11/15/2006

Partnership with the Customer

• A series of demonstrations and user juries were conducted to refine the Raytheon understanding of the customer requirements:

– User Jury #1• Combined with PDR (Preliminary Design Review) to ensure requirements

are understood

– User Jury #2• Paper copies of the display screens• End user participation requested (several different ranks)

Demonstrations and User Juries were key tactics

11/15/2006

Partnership with the Customer –continued


11/15/2006


• Demonstrations and user juries (continued):

– Engineering Confidence Test: Demonstration #1• Fire LDM (Laser Designator Module) from external run box• External mounted camera - alleviate delays for packaging/fabrication• Insert filters in front of camera to simulate end system performance

– Program Gate: Demonstration #2• Interim demonstration of more integrated system at longer ranges

– Tactical Demonstration• After completion of the Vehicle Sensor Mount and end system development


11/15/2006


• Customer participation in major reviews

– PDR – Preliminary Design Review– CDR – Critical Design Review – TRR – Test Readiness Review– IPR – Interim Progress Review

– All of these reviews involved customer participation and an agreement regarding actions and authorization to proceed

Formal Reviews were a key tactic

11/15/2006


• Field Service Representative in place to facilitate maintenance issues for deployed systems.

Maintaining systems assumes high priority.

11/15/2006

Results Speak for Themselves

• Software CPI has consistently stayed within organizational limits for several years

Achieved Budget as well as Mission Assurance

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar

CPI FS3 Dev (2002-2003)CPI BB1 Insert (2004-2005)Org Norm 1Org Norm High

11/15/2006

Results Speak for Themselves –continued

• Software SPI has consistently stayed within organizational limits for several years

Achieved Schedule as well as Mission Assurance

0

0.2

0.4

0.6

0.8

1

1.2

1.4


SPI FS3 Dev (2002-2003)SPI BB1 Insert (2004-2005)Org Norm LowOrg Norm High

11/15/2006


• Defect containment metrics for software remained within organizational limits over multiple development efforts

No Doubt – A Mission Assurance Success Story

0

20

40

60

80

100

120


FS3 Dev (2002-2003)BB1 Insert (2004-2005)Org Norm LowOrg Norm High

11/15/2006


• To date, there have been two follow-on software maintenance contracts in addition to development effort to enhance software and hardware


11/15/2006


• Positive feedback from in-theatre user community– Highly positive feedback in multiple

applications– Not originally designed for mounting on

buildings, but modified and used on rooftops to monitor borders / surveillance


11/15/2006



"Best damn investment the Army ever made" ..Army Scout

11/15/2006

Summary

• Sound Engineering Processes coupled with a partnership with the Customer have led to success for the LRAS3/FS3 program, Raytheon, and the Army:

– A program that is within budget and on time

– A product that performs – with no doubt

No Doubt – LRAS3/FS3: A Mission Assurance Success Story

11/15/2006

Contact Information

• Jill Brooks– 972-344-3022– [email protected]

mailto:[email protected]

11/15/2006

Questions

No Doubt – The LRAS3/FS3 Story of Mission Assurance · No Doubt – The LRAS3/FS3 Story of...

Documents

Transcript of No Doubt – The LRAS3/FS3 Story of Mission Assurance · No Doubt – The LRAS3/FS3 Story of...