Asd March 2006 Organization Capability Baseline Summary Report HY1 2005-06 1 Organization Capability...

20
March 2006 Organization Capability Baseline Summary Report HY1 2005-06 1 Organization Capability Baselines Summary Report HY1 2005-06 March 2006 0 10 20 30 40 50 60 70 80 90 100 1 2 3 4

Transcript of Asd March 2006 Organization Capability Baseline Summary Report HY1 2005-06 1 Organization Capability...

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 1

Organization Capability Baselines

Summary Report HY1 2005-06

March 2006

0

10

20

30

40

50

60

70

80

90

100

1 2 3 4

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 2

# of Projects Received for Baselining

53%

34%

13%

Development Maintenance Production Support

Data Received for Baselines – Distribution of Project Type

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 3

Cumulative Baselines for all Development Projects

Metric Standard Deviation

MeanLower Bound

Upper Bound

Count

Effort Estimation Variance (%) 5.6 1.9 0.0 9.8 96

Schedule Estimation Variance (%) 3.1 0.6 0.0 6.1 110

Cumulative Defect Removal Efficiency (%) 2.3 99.0 98.0 100.0 55

Review Efficiency (%) 11.3 90.2 83.5 100.0 51

Delivered Defect Density (Defects/KLOC) 0.7 0.4 0.0 1.6 47

Cost of Quality (%) 14.3 25.4 11.1 43.3 77

Cost of Poor Quality (%) 3.4 2.3 0.1 8.3 76

Baseline Period Apr-05 to Sept-05

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 4

Capability Baseline for Development Projects – Effort Variance

-2.00

0.002.00

4.006.00

8.0010.00

Mean LB UB

Process Performance

Effort Variance

Jan03-Apr03 May03-August03 Sep03-Apr04 July04-Mar 05 Apr05-Sep05

0.001.002.003.004.005.006.007.00

Standard deviation Mean

Process Perormance

Effort Variance

Jan03-Apr03 May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

Downward trend in both Standard Deviation and Mean

Mean: 1.0Lower Bound: 0.0Upper Bound: 9.8 Upward rise in UB

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 5

Capability Baseline for Development Projects – Schedule Variance

0.001.002.003.004.005.006.007.008.00

Mean LB UB

Process Performance

Schedule Variance

Jan03-Apr03 May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

0.002.004.006.008.00

10.00

Standard deviation Mean

Process Performance

Schedule Variance

Jan03-Apr03 May03-August03 Sep03-Apr04

July 04 - Mar 05 Apr05-Sep05

Downward trend in both Standard Deviation and Mean

Mean: 0.6Lower Bound: 0.0Upper Bound: 6.1 Downward shift in

UB

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 6

Capability Baseline for Development Projects – DDD

0.000.200.400.600.801.001.201.401.60

Mean LB UB

Process Performance

Delivered Defect Density (Defects / KLOC)

Jan03-Apr03

May03-August03

Sep03-Apr04

July 04 - Mar 05

Apr05-Sep05

0.00

0.20

0.40

0.60

0.80

1.00

1.20

Standard deviation Mean

Process Performance

Delivered Defect Density

Jan03-Apr03

May03-August03

Sep03-Apr04

July 04 - Mar 05

Apr05-Sep05

Upward trend in Standard Deviation while Mean remains constant

Mean: 0.4Lower Bound: 0.0Upper Bound: 1.6 Upward rise in UB

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 7

Capability Baseline for Development Projects – CDRE

0.00

20.00

40.00

60.00

80.00

100.00

Standard deviation Mean

Process Performance

Cuml. Defect Removal Efficiency

Jan03-Apr03 May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

Downward trend in Standard Deviation while Upward trend in Mean

Mean: 99.0Lower Bound: 98.0

Upper Bound:100.0 Upward rise in LB

88.00

90.00

92.00

94.00

96.00

98.00

100.00

Mean LB UB

Cuml. defect removal Efficiency

Jan03-Apr03 May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 8

Capability Baseline for Development Projects– RE

0.00

20.00

40.00

60.00

80.00

100.00

Mean LB UB

Review Efficiency (%)

Jan03-Apr03 May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

0.00

50.00

100.00

Standard deviation Mean

Process Performance

Review Efficiency

Jan03-Apr03 May03-August03 Sep03-Apr04 July 04 - Mar 05

Apr05-Sep05 Jan03-Apr03 May03-August03 Sep03-Apr04

July 04 - Mar 05 Apr05-Sep05

Downward trend in Standard Deviation while Upward trend in Mean

Mean: 90.2Lower Bound: 83.5

Upper Bound:100.0 Upward rise in LB &

UB

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 9

Capability Baseline for Development Projects – COQ

0.00

10.00

20.00

30.00

40.00

50.00

Mean LB UB

Process Performance

Cost of Quality (% of Total Effort)

May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

0.00

10.00

20.00

30.00

40.00

Standard deviation Mean

Process Performance

Cost of Quality

May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

Upward trend in Standard Deviation while downward trend in Mean

Mean: 25.4Lower Bound: 11.1Upper Bound:43.3 Downward shift in

LB

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 10

Capability Baseline for Development Projects – COPQ

0.00

2.00

4.00

6.00

8.00

10.00

Mean LB UB

Cost of Poor Quality (Rework Effort - %)

May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

0.00

1.00

2.00

3.00

4.00

5.00

Standard deviation Mean

Process Perormance

COPQ

May03-August03 Sep03-Apr04 July 04 - Mar 05 Apr05-Sep05

Upward trend in Standard Deviation while downward trend in Mean

Mean: 2.3Lower Bound: 0.1Upper Bound:8.3

Downward shift in LBUpward shift in UB

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 11

Cumulative Baselines for all Maintenance Projects

Baseline Period Apr-05 to Sept-05

MetricStandard Deviation

MeanLower Bound

Upper Bound

Count

Effort Estimation Variance (%) 2.8 1.6 0.0 5.9 201

Schedule Estimation Variance (%) 0.2 0.02 0.0 1.9 197

Cumulative Defect Removal Efficiency (%) 4.4 96.9 92.0 100.0 178

Review Efficiency (%) 4.2 94.7 92.0 100.0 63

Delivered Defect Density (Defects/KLOC) 0.4 0.2 0.0 1.0 123

Pre Release Defect Density (Defects / KLOC) 4.2 4.4 0.6 7.4 42

Cost of Quality (%) 8.2 22.4 15.1 33.9 74

Cost of Poor Quality (%) 2.0 1.7 0.0 5.0 155

Productivity (LOC/PD)

Java / J2EE 13.2 86.9 73.1 99.4 7

AS400 (Lines changed / hr) 0.5 1.1 0.8 1.6 4

C 35.0 46.0 14.0 88.0 11

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 12

Capability Baseline for Maintenance Projects

-5

0

5

10

15

20

Standarddeviation

Mean LB UB

Effort Variance

Jan03-Apr03 May03-August03 September03-April04 July04-March05 April05-Sept05

SEVMean: 0.02LB: 0.0UB: 1.9Variation in the process has come down compared to the previous baseline

EEVMean: 1.6LB: 0.0UB: 5.9Variation in the process has come down compared to the previous baseline

0

2

4

6

8

10

Standarddeviation

Mean LB UB

Schedule Variance

Jan03-Apr03 May03-August03 September03-April04 July04-March05 April05-Sept05

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 13

Capability Baseline for Maintenance Projects

0.0

2.0

4.0

6.0

8.0

Standarddeviation

Mean LB UB

Pre Release Defect Density (Defects / KLOC)

May03-August03 September03-April04 July04-March05 April05-Sept05

0

0.5

1

1.5

2

Standarddeviation

Mean LB UB

Delivered Defect Density (Defects / KLOC)

Jan03-Apr03 May03-August03 September03-April04 July04-March05 April05-Sept05

PRDDMean: 4.4LB: 0.6UB: 7.4An upward shift in the UB is observed. No major changes in Standard deviation & Mean

DDDMean: 0.2LB: 0.0UB: 1.0Variation in the process has reduced, an upward shift in UB is noticed

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 14

Capability Baseline for Maintenance Projects

0

20

40

60

80

100

Standarddeviation

Mean LB UB

Cuml. Defect Removal Efficiency (%)

Jan03-Apr03 May03-August03 September03-April04 July04-March05 April05-Sept05

0

20

40

60

80

100

Standarddeviation

Mean LB UB

Review Efficiency (%)

Jan03-Apr03 May03-August03 September03-April04 July04-March05 April05-Sept05

REMean: 94.7LB: 92.0UB: 100.0Process performance has significantly improved when compared to the previous period

CDREMean: 96.9LB: 92.0UB: 100.0Process performance remains at the same level compared to previous period

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 15

Capability Baseline for Maintenance Projects

0.0

10.020.030.040.0

50.0

Mean LB UB

Process Performance

Cost of Qualify

J uly04-March05 April05-Sept05

0.0

2.0

4.0

6.0

8.0

Mean LB UB

Process Performance

Cost of Poor Quality

July04-March05 April05-Sept05

COPQMean: 1.7LB: 0.0UB: 5.0Significant reduction in COPQ is observed

COQMean: 22.4LB: 15.1UB: 33.9Significant reduction in COQ is observed

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 16

Cumulative Baselines for all Production Support Projects

MetricLower Bound

Upper Bound

Adherence to turnaround time (%) 95.00 98.00

Delivered Defects (% of Work Requests delivered with defects) 0.00 1.72

Baseline Period Apr-05 to Sept-05

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 17

Capability Baselines for Production Support Projects

0

20

40

60

80

100

Low er Bound Upper Bound

Process Performance

Adherence to Turnaround Time

Jan-03 May-03 Sep-03 Apr-04 Sep-05

0

2

4

6

8

Low er Bound Upper Bound

Process Performance

Delivered Defects

Jan-03 May-03 Sep-03 Apr-04 Sep-05

DDLB: 0.0UB: 1.72Upward trend in the UB when compared to the previous baseline period

ATTLB: 95.1UB: 98.0Significant improvement in ATT observed

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 18

Capability Baselines – Enterprise Applications

MetricStandard Deviation

MeanLower Bound

Upper Bound Count

Effort Estimation Variance (%) 13.2 -0.8 0.0 5.8 238

Schedule Estimation Variance (%) 19.6 0.2 0.0 5.3 245

Delivered Defect Density (Defects/KLOC) 0.5 1.0 0.7 1.7 11

Pre-release Defect Density (Defects/KLOC) 0.7 0.5 0.0 1.0 215

Cumulative Defect Removal Efficiency (%) 2.0 89.0 90.0 90.0 13

Review Efficiency (%) 9.7 95.6 95.0 100.0 98

Cost of Quality (%) 5.9 11.5 9.2 16.4 4

Cost of Poor Quality (%) 3.2 2.8 0.3 10.0 30

Baseline Period Apr-05 to Sept-05

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 19

Interpretations based on the data received for baselines for HY1 2005-06

• Increase in range for the Effort Estimation Variance is observed with an upward shift in the upper bound indicating effort overruns in many projects.

• Schedule Estimation Variance has shown downward trend in the UB and reduced standard deviation indicating increased consistency in delivery of projects on-time.

• The mean Delivered Defect density remains the same but standard deviation shows an upward trend indicating that some projects could have abnormally high DDD.

• CDRE and RE have significantly improved when compared with the previous baselines.

• Significant improvements observed in COQ and COPQ in the maintenance projects.

• Data received did not contain adequate data points on Productivity, and hence productivity trend could not be derived.

asd

March 2006 Organization Capability BaselineSummary Report HY1 2005-06 20March 2006

Thank You