CMMI SM Transition at Motorola GSG
description
Transcript of CMMI SM Transition at Motorola GSG
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
CMMICMMISMSM Transition at Transition at Motorola GSG Motorola GSG
Daniel Henry, GSG-Canada
Larry McCarthy, GSG-PQE
Sanjay Chitnis, GSG-India
CMMI Technology Conference
Hyatt Regency Tech Center
Denver, Colorado
November 17-20, 2003
SM - CMMI is a service mark of Carnegie Mellon University
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Motorola’s Strategic FocusThe Work TeamThe Person The Home The Auto
Wireless Broadband Internet
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
United States
JapanOther Markets
China
Asia-Pacific
Europe
Latin America
7%
45%
3%6%
11%
14% 14%
45%
personal communications
38%
17%16%
13%8% 7% 1%
semiconductorproducts
global telecomsolutions
commercialgovernmentIndustrialsolutions
integrated electronicsystems
broadbandcommunication
other products
Motorola’s Business
Motorola is a global leader in providing integratedcommunications and embedded electronic solutions.
• $26.679 billion in revenue*• $3.754 billion in r&d expenditures*• 97,000 employees* • 808 patents issued
Source: Motorola 2002 Annual Report
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Benefits of Achieving Higher Maturity
0
100
1 2 3 4 5
Quality60
Cost of Poor Quality
0
100
1 2 3 4 5
Cycle Time
0
1
2
3
4
1 2 3 4 5
Productivity
1 2 3 4 5
Source: Presidential Task Force – 2002 Data
0
Quality
Cycle Time
Productivity
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Motorola’s Process Strategy
• Use process framework(s) based on models of maturity and capability– Motorola Quality System Review (QSR) 1985-2002– SEI Maturity Models (SW-CMM, SE-CMM, CMMI) 1988-present
• Leverage high maturity in software– QSR Subsystem 10 and Motorola Software Assessments – “SEI” Assessments (SPA, CBA IPI, SCAMPI)
• Improve with Six Sigma methods and tools– Six Sigma (first wave)– Digital Six Sigma (2003)
• Extend engineering-related success– Malcolm Baldrige Performance Excellence Awards
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Global Software Group (GSG)
VISION:
Be the premier provider of innovative software products and services to Motorola’s businesses and customers worldwide.
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
CORDOBA
MONTREAL ST. PETERSBURG
TURIN
LIVINGSTON KRAKOW
SYDNEYADELAIDE
PERTH
SCHAUMBURG
FT. LAUDERDALE NANJING
CHENGDU
BEIJING
SINGAPORE
KUALA LUMPURBANGALORE
HYDERABAD
TOKYO
VALPARASIO
GSG Locations
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
GSG Competencies
GSG Core CompetenciesSoftwareProducts
Network Infrastructure
Software
SEI CMM/CMMI Software Quality
Focus
SEI CMM/CMMI Software Quality
Focus
Software TalentWorld-wideLocations
Software TalentWorld-wideLocations
Proven ExpertiseIn Software
Development
Proven ExpertiseIn Software
Development
Motorola Products and
Systems Expertise
Motorola Products and
Systems Expertise
EmbeddedSoftware
Solutions and
Application Software
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
GSG’s Proven Performance
020406080
100
1 2 3 4 5
Quality:Relative Defects After Release
0102030405060
Decreased Cost of Poor Quality: Relative % of Development Effort
0
20406080
100
1 2 3 4 5SEI CMM Process Maturity Levels
Reduced Cycle Time:Relative Cycle Time
0
1
2
3
4
1 2 3 4 5SEI CMM Process Maturity Levels
Increased Productivity:Relative Productivity (X)
SEI CMM Process Maturity Levels SEI CMM Process Maturity Levels 1 2 3 4 5
Source: Presidential Task Force – 2002 Data
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
GSG India Overview
• Opened in 1991 • 1000 engineers • Provides custom software, software products and
system solutions for Motorola Businesses and their customers worldwide
• Assessment history:– SW-CMM Level 5 in 1993
– CMMI Level 5 in May 2003 using CMMI SE/SW/IPPD/SS
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Project Domains (Businesses)
INFRASTRUCTURE BUSINESS
MULTIMEDIA & EMBEDDED BUSINESS
SUBSCRIBER BUSINESS SYSTEM ENGINEERING
BUSINESSES
CDMA1X, UMTS, GSM, Cable Infrastructure system software
Network Management. Infrastructure Tools System Integration Verification & Validation
Multimedia solutions DSP libraries & applications DSP Audio solutions Network processor applications EDA Tools Broadband protocols
System Integration Performance modeling Consultancy
Wireless Applications Wireless Protocols: GSM,
GPRS, CDMA, UMTS User Interface Internet Access Test suites & tools
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Transition Strategy
• Business Goals on Scorecard drives improvement– CMMI-SE/SW/IPPD/SS continuous representation selected– Target Profile and Metrics program to suit business needs
• Direct involvement of ~50% of the organization– Extensive Training for the whole organization
• Reuse from outside sources wherever possible• Automation to support deployment• Use of an SEI transition partner
– Training– Clarifications on interpretation of the model
• Incremental transition using sequenced appraisals– Class C -> Class B -> Class B -> Class A
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Reference: Appraisal Requirements for CMMI (ARC)
Appraisal Sequence
AppraisalType
Class C Class B Class B Class A SCAMPI
Duration Nov 01~Feb 02 June 12-21, 2002 March 17-21, 2003 May 6~15, 2003Objective Gap Analysis for
process assetsIdentify Practice Level Gaps
Readiness Check Benchmark;To establish a baseline
Relative:Cost/DurationConfidenceAccuracy
Low Medium Medium High
Rating? No No No Yes
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Target Profile
0
1
2
3
4
5
Projec
t Plan
ning
Projec
t Mon
itorin
g an
d Con
trol
Suppli
er A
gree
men
t Man
agem
ent
Inte
grat
ed P
rojec
t Man
agem
ent
Risk M
anag
emen
t
Quant
itativ
e Pro
ject M
anag
emen
t
Requir
emen
ts M
anag
emen
t
Requir
emen
ts D
evelo
pmen
t
Techn
ical S
olutio
n
Produ
ct In
tegr
ation
Verific
ation
Valida
tion
Config
urat
ion M
anag
emen
t
Proce
ss a
nd P
rodu
ct Q
uality
Ass
uran
ce
Mea
sure
men
t and
Ana
lysis
Causa
l Ana
lysis
and
Resolu
tion
Decisi
on A
nalys
is an
d Res
olutio
n
Organ
izatio
nal P
roce
ss F
ocus
Organ
izatio
nal P
roce
ss D
efini
tion
Organ
izatio
nal T
raini
ng
Organ
izatio
nal P
roce
ss P
erfo
rman
ce
Organ
izatio
nal I
nnov
ation
and
Dep
loym
ent
Inte
grat
ed T
eam
ing
Organ
izatio
nal E
nviro
nmen
t for
Inte
grat
ion
Inte
grat
ed S
uppli
er M
anag
emen
t
Process Areas
Tar
get
Cap
abili
ty L
evel Target Capability Level
Appraised Capability Level
Profile validated by SCAMPI A
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
CMMI Transition Effort
Effort Distribution of 2578 Staff days (~85 man months)
ManagementManagement
9%9%
DefinitionDefinition
23%23%
TrainingTraining
30%30%
DeploymentDeployment
9%9%
AutomationAutomation
10%10%
AppraisalsAppraisals
19%19%
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Performance Results*
42%35%Cost of Quality (goal set in Q4)
92%
95%
1.17X
1.62X
6.4%
0.72
5.8
8.8
ACTUAL
90%Process Maturity (% of Projects at L5)
95%On Time Delivery (% of Projects)
1.5XProductivity (X Factor)
1.6XCycle Time Reduction (X Factor)
8%Cost of Poor Quality (% of Effort)
0.6In-process Fault (Faults/KAELOC)
6Post release Defect (sigma level)
8.5Customer Satisfaction (scale of 10)
GOAL
* Results include use of practices from CMM/CMMI
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
GSG Canada Overview
• Opened in 1999• ~ 176 engineers• Provides customer software and services for
Motorola businesses and their customers worldwide
• Assessment history:– SW-CMM Level 3 in October 2000 (Motorola Software
Assessment)
– SW-CMM Level 5 in December 2001(CBA-IPI)
– SCAMPI C (SEI SCAMPI method pilot) in July 2003
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Project Domains and Organization
Real TimeEm bedded Systems
System Tools& S im ulation
M obileApplications
W ireless Netw orks& Infrastructures
Operations
ProcessQualityM etricsTools and TechnologyConfiguration M anagem entArchitecture
Softw are Engineering& Technology
Hum an resourcesFinanceFacilities and SecuritySystem Netw ork Adm in
Support
GSG Canada
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Transition Strategy
• Identified GAPS in current process (Q2, 2003)• Performed pilot SEI SCAMPI C (Q3, 2003)
– Focus on Engineering Process Areas– Identify target capability level goals
• Identify assets to re-use (potential of 23+ % effort savings on total transition effort through re-use) – Assets from GSG Centers such as GSG-India– Results from Digital Six Sigma Projects
• Improve process capability levels for RM, RD, TS, VER, PI, DAR, RSKM
• Plan/perform additional SCAMPIs– SCAMPI B to complete capability baseline (Q4, 2003)– Follow-on SCAMPI B in Q2-Q3, 2004
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Target Profile
0
1
2
3
4
5
PROCESS AREA
CA
PA
BIL
ITY
L
EV
EL
CURRENT 0 0 0 1 0 0 1 3 0 1 0
TARGET 3 3 3 3 3 3 3 3 3 1 3 1 1 3 4 1 3 3 3 1 3
OPF OPD OT OEI OPP OID PP PMC SAM IPM RM IT QPM REQM RD TS PI VER VAL CM PPQA MA DAR CAR
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Transition Effort - Estimated
REQM 48 3Requirements Development 250 1Technical Solution 350 1PI 164 3Verification 40 4DAR 175 1RSKM 53 3
Total staff hours 1080 …..excluding training
Hours TCL
Estimated Effort to Reach Target Capability Levels (TCL)
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Other GSG CMMI Activities GSG Malaysia
– Organization• Opened in 1999• ~ 150 engineers• SW-CMM L5 in October 2001
– Strategy used for transition• Gap analysis (Nov 2002)• Reuse process assets from GSG-India• Use SEI Transition Partner for appraisals
– Status / Results• 20-70% reuse from Motorola India assets• ~20 staff months of transition effort over 15 months• CMMI L5 (SW) in October 2003
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Overall Lessons Learned (strengths)
Finding less CMMI gaps than expected within a practicing high maturity (SW-CMM) operation
Reuse of validated assets and learning can significantly reduce time and effort to transition (at high level of maturity)
Use of graduated and integrated appraisals accelerates smooth transition & deployment
Motorola GSG is capturing the cost of transition better than prior costs to implement SW-CMM
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Lessons learned (opportunities)
Plan more time/effort to educate organizations on CMMI to reduce “competition” with current models
Plan time/effort to “unwind” quantitative benefits of high maturity CMMI vs. SW-CMM for ROI
High maturity organizations will (should) transition to new process technology (like CMMI) when ready
Core or common process requires enterprise and organization-level investment
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
What’s next?
Continue to use experience and assets from early adoptors to reduce the time/effort to transition remaining organizations
Extend pilots in non-software engineering disciplines and organizations (Motorola objective)
Continue to document and measure transition costs and returns
Define and use tighter links between CMMI and Digital Six Sigma
MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or service names are the property of their respective owners. © Motorola, Inc. 2003.
Questions & Contact Information
?Sanjay Chitnis, GSG India [email protected]
Daniel Henry, GSG Canada [email protected]
Larry McCarthy, Motorola CMMI Working Group [email protected]