Post on 25-Dec-2015
Network Reliability and Interoperability Council
Focus Group 2Network Reliability
PJ Aduskevicz, AT&T
Ross Callon, Juniper
Wayne Hall, Comcast
Network Reliability and Interoperability Council
Focus Group Membership• PJ Aduskevicz, AT&T• Ken Buckley, Federal Reserve Board• Ross Callon, Juniper• Rick Canaday, AT&T• Kevin Cavanagh, AT&T Wireless• Wayne Chiles, Verizon• Joe Craig, Qwest• Victor Devito, AT&T• Sean Donelan, SBC• Bernie Farrell, NCS• David Fears, Cox Communications• Lee Fitzsimmons, Nextel• Brian Goemmer, Western Wireless• Garnet Goins, Nextel• Jeff Goldthorp, FCC• Chris Gunner, Avici Systems• Wayne Hall, Comcast• Bruce Harrod, C&W• John Healy, FCC• Dean Henderson, Nortel Networks• Bob Holley, Cisco• Bruce Johnson, Verisign• Rick Kemper, CTIA• Bill Klein, ATIS• Bernie Ku, WorldCom
• Greg Larson, Exodus/CWUSA• Mike Lecocke, SBC • Chris MacFarland, Allegiance• Spilios Makris, Telcordia• Archie McCain, BellSouth• Dave McDysan, WorldCom• Brian Micene, AT&T Wireless• Denny Miller, Nortel• Erick Mogelgaard, Cox• Chris Oberg, Verizon Wireless• Bonnie Petti, Verizon Wireless• Tom Purcell, Nextel• Karl Rauscher, Lucent• Arthur Reilly, Cisco Systems• Ira Richer, The Telesis Group• Jim Runyon, Lucent• Andy Scott, NCTA• Don Smith, NCS• Ron Stear, C&W• Sandy Stephens, Focal• Jeff Swinton, Conexion Corp.• Whitey Thayer, FCC• Robert Vogel, PanAmSat Corp.• Doug Williams, Comcast Cable
Network Reliability and Interoperability Council
Focus Group Mission Statement
• Define reliability measurements (units) for commercial communications networks (i.e., wireline and wireless transport networks, including satellite and cable) and for the Internet by March 22, 2003.
• Define reasonable, measurable customer-affecting outage reporting thresholds for commercial communications networks (i.e., wireline and wireless transport networks, including satellite and cable) and for the Internet by March 22, 2003.
• Conduct voluntary outage reporting trial, collect data, analyze results, and report on the validity, usefulness, and timeliness of the process and information obtained, and make recommendations for improvement.
• Based on trial results (including information on services affected by an outage), evaluate and report on the reliability of public communications network services in the United States.
• Should the Commission initiate an inquiry or rulemaking with respect to any of the above-mentioned issues, the Focus Group will provide input to the NRIC, which may make formal recommendations as a part of such proceeding(s).
• Evaluate, and report on, the reliability of public telecommunications network services in the United States.
Network Reliability and Interoperability Council
Measurements and Thresholds Teams
Team Leader
Cable Wayne Hall
Wireless Dean Henderson
Internet Ross Callon (data) /Dean Henderson (voice)
Wireline Wayne Chiles /PJ Aduskevicz
Network Reliability and Interoperability Council
Outage Occurs
Determine if Outage Meets Vol.
Trial Criteria
Fax to NCS/NCCOn (703/607-4998 )
Create Initial Report within 3 Days –Mark Company
Proprietary
ConductRoot Cause
Analysis
IdentifyBest Practices
Fax Final Reportwithin 30 DaysMark Company
Proprietary
NCS/NCC Logs Report
Scrub Data per Criteria Established
by FG 2
Scrubbeddata received by FG 2
Analyze ScrubbedData:•By Type/Segment•Impact•Frequency•Root cause for
CommonalityReview BP coverage
Provide status at NRIC VI Council
meetings
Make Recommendations
Monitor Progress
Concur or Provide Input on
Recommendations
Develop Final Report to Include Recommendations
Service Provider NCS/NCC Focus Group 2 NRIC VI andIndustry
If yes
If noLocal Root
Cause Analysis
Initial Final
Collect, Validate, And
Send Data
Initial Final
File Final Report
NRIC VI Voluntary Outage Reporting Trial Process
Approve Scrubbed Report
Network Reliability and Interoperability Council
Voluntary Trial Confidentiality Process Flow protects confidentiality and security
concerns of the source data• Outage reports will be handed off to the NCC• The NCC has earned the trust of the industry in
protecting proprietary information• Company Proprietary marking on submitted outage
reports • Only scrubbed data will be handed off to team for
analysis• Non-Disclosure Agreement
Network Reliability and Interoperability Council
Voluntary Trial Implementation
• Cable, Wireless, and Internet Service Providers
• Data Collection from January 1, 2003 through December 31, 2003
• Initial and Final Report Templates with Field Descriptions Provided
Inter-Domain Routers
PSTN
DSL
Wireless
Cable
Dial-Up
DNS RADIUSDHCP
Core Backbone
Distribution
Service Aggregation
XYZ Corp
Network Reliability and Interoperability Council
Internet/IP ServiceProvider
Network Reliability and Interoperability Council
Outage Reporting Units and ThresholdsTechnology Unit Threshold % Market
RepresentedPositive
Reporting
Cable Cable Modem > 30,000 Customers
> 30 Minutes
64% YES
Wireless Blocked Calls > 90,000 Blocked Calls
> 30 Minutes
82% YES
Internet
Cable Access
DSL Access
Satellite Access
Wireless Access
Dial-Up
Household
Household
Household
Devices
Modem Port
> 30,000 Customers
> 30 Minutes
52% YES
Network Reliability and Interoperability Council
Wireline Measurements and Thresholds
• Charter: “The Committee will prepare and provide recommended requirements for network reliability and network reliability measurements for wireline … networks”
• Review is scheduled to start January of 2003 (Possible recommended Guidelines for current requirements, Changes to current requirements, “Fresh Look”)
• Fire Reporting
• Overall look at the rules
Network Reliability Steering Committee
NRSC
Third Quarter Report
Network Reliability and Interoperability Council
Reliability Reporting – NRSC 3Q02 ReportFCC Reportable Service Outages
(by number of events)
38
54
3229
33
40 41
48
38
35
4240
45
4240
47 4844
4744
35
4852
4844
4341
34
46 47
52 55 52
43
38 39
292832
15
25
35
45
55
65
1Q
93
3Q
93
1Q
94
3Q
94
1Q
95
3Q
95
1Q
96
3Q
96
1Q
97
3Q
97
1Q
98
3Q
98
1Q
99
3Q
99
1Q
00
3Q
00
1Q
01
3Q
01
1Q
02
3Q
02
Quarter
Nu
mb
er
of
Ou
tag
es
Total outages were at the lowest level (126) of any four consecutive quarters since the start of the Baseline Period.
Network Reliability and Interoperability Council
Reliability Reporting – NRSC 3Q02 ReportFCC Reportable Service Outages
(by outage index)
430
265300
318
622
299
618
427
470 555
364
305
481
345
414422
326223
519510
362
411
287
458
246
249
401
376376
440
331
412
300301 286
346
553
675
439
0
100
200
300
400
500
600
700
800
1Q93
3Q93
1Q94
3Q94
1Q95
3Q95
1Q96
3Q96
1Q97
3Q97
1Q98
3Q98
1Q99
3Q99
1Q00
3Q00
1Q01
3Q01
1Q02
3Q02
Quarter
Ou
tag
e In
de
x
The aggregate outage index was at the lowest level (1315) of any four consecutive quarters since the start of the Baseline Period.
Network Reliability and Interoperability Council
Reliability Reporting – NRSC 3Q02 Report
Analysis of the outages for 3Q02 indicates: • Total outages were at the lowest level (126) of any four consecutive
quarters since the start of the Baseline Period. • The aggregated outage index was at the lowest level (1315) of any four
consecutive quarters since the start of the Baseline Period. Based upon analysis of all outages reported from 1Q93
through 3Q02, the NRSC notes that: • There is an increasing trend in the number of CO Power and CCS
outages. • There is an increasing trend in the frequency and aggregated outage
index of Procedural Errors as the root cause of outages. • There is a decreasing trend in the number of Local Switch outages.
Network Reliability and Interoperability Council
Reliability Reporting – NRSC Reports
The NRSC urges all service providers and equipment vendors to review all best practices for application in their operations.
These Best Practices may be found at: http://www.nric.org/
Network Reliability and Interoperability Council
Back Up
Network Reliability and Interoperability Council
Voluntary Trial Process Definitions• Service Provider – Companies who provide Wireless, Satellite,
Cable, Internet and Wireline Services• NCS/NCC (National Communication System/National Coordinating
Center) - Joint industry-government organization and mechanism by which the federal government and telecommunications industry respond to national security and emergency preparedness (NS/EP) telecommunications service requirements.
• Focus Group 2 – A subcommittee of the NRIC VI Network comprised of representatives of industry associations, consultants, and providers for wireline and non-wireline services and equipment.
• NRIC VI – A federal advisory committee that is chartered to evaluate and report on the reliability of public telecomm network services in the US including the reliability of packet switched networks.
Network Reliability and Interoperability Council
Outage Report Data CriteriaFinal Report field Scrub Action
Reporting Carrier/Service Provider
Delete and create outage tag (Service Provider identifier, i.e., Cable,
Wireless, Internet, plus a unique numerical identifier)
Contact Person Delete
Start Date Unchanged
Start Time of Impact Unchanged
Geographic area affected Delete
Estimated number of customers affected Unchanged
Types of Services Affected (if applicable) Unchanged
Duration of Outage (hours and minutes) Unchanged
Apparent or known cause Unchanged
Name of Equipment Involved [OPTIONAL] Delete
Type of Equipment Involved [OPTIONAL] Delete
Specific Part of Network Involved Unchanged
Methods Used to Restore Service [OPTIONAL] Unchanged
Steps Taken to Prevent Recurrence Unchanged
Root Cause and Trouble Found [OPTIONAL] Unchanged
Applicable Best Practice [OPTIONAL] Unchanged
Network Reliability and Interoperability Council
Internet Measurements and ThresholdsType of Internet
AccessCustomer Definition Comments
Cable Household Whether or not actively using it at the time of the incident
DSL Household Whether or not actively using it at the time of the incident
Satellite Household Whether or not actively using it at the time of the incident
Wireless Devices Historical trends will be used
Dial-Up Modem Port Whether or not actively using it at the time of the incident
Network Reliability and Interoperability Council
Reliability Reporting – NRSC 3Q02 ReportIncidents by Failure Category
(CO Power)
2
5
9
1
6
4
3
0
2
13 1
23
55
4
3
5 5
32
12
0
2
87 7 7
4 4
7 7 78
6
3
4
0
2
4
6
8
10
12
1Q
93
3Q
93
1Q
94
3Q
94
1Q
95
3Q
95
1Q
96
3Q
96
1Q
97
3Q
97
1Q
98
3Q
98
1Q
99
3Q
99
1Q
00
3Q
00
1Q
01
3Q
01
1Q
02
3Q
02
Quarter
Nu
mb
er
of
Ou
tag
es
There is an increasing trend in the number of CO Power outages.
Network Reliability and Interoperability Council
Reliability Reporting – NRSC 3Q02 ReportIncidents by Failure Category(Common Channel Signaling)
8
5
7 7
3
7
2 2
5 52
32
5
1
45
12
1
544
54
77
667
10
14
88
9
77
8 10
0
2
4
6
8
10
12
14
16
1Q
93
3Q
93
1Q
94
3Q
94
1Q
95
3Q
95
1Q
96
3Q
96
1Q
97
3Q
97
1Q
98
3Q
98
1Q
99
3Q
99
1Q
00
3Q
00
1Q
01
3Q
01
1Q
02
3Q
02
Quarter
Nu
mb
er
of
Ou
tag
es
There is an increasing trend in the number of CCS outages.
Network Reliability and Interoperability Council
Reliability Reporting – NRSC 3Q02 ReportProcedural Error Attributed Outages
(by number of events)
10111113
14
2019
19
15
29
1617
11
15
18
25
16
1510
26
20
19
13
18
1213
1213
11
13
911
6
16
1413 13
9
20
0
5
10
15
20
25
30
35
1Q
93
3Q
93
1Q
94
3Q
94
1Q
95
3Q
95
1Q
96
3Q
96
1Q
97
3Q
97
1Q
98
3Q
98
1Q
99
3Q
99
1Q
00
3Q
00
1Q
01
3Q
01
1Q
02
3Q
02
Quarter
Nu
mb
er
of
Ou
tag
es
There is an increasing trend in the frequency of Procedural Errors as the root cause of outages.
Network Reliability and Interoperability Council
Reliability Reporting – NRSC 3Q02 ReportProcedural Error Attributed Outages
(by outage index) There is an increasing trend in the aggregated outage index of Procedural Errors as the root cause of outages.
349
155
186
59
166
96
170
150
172
143133
94 565670
206207198
130
82
126
171
119
5354
184
129122
107112
229
132
82
9893
9067
29
55
0
50
100
150
200
250
300
350
400
1Q93
3Q93
1Q94
3Q94
1Q95
3Q95
1Q96
3Q96
1Q97
3Q97
1Q98
3Q98
1Q99
3Q99
1Q00
3Q00
1Q01
3Q01
1Q02
3Q02
Quarter
Ou
tag
e In
dex
Network Reliability and Interoperability Council
Reliability Reporting – NRSC 3Q02 ReportIncidents by Failure Category
(Local Switch)
32
4
0
2
4
899
14 14
10
12
10
88
1110
12
2
446665
45
4665
32
7 7 5
2
6
0
2
4
6
8
10
12
14
16
1Q
93
3Q
93
1Q
94
3Q
94
1Q
95
3Q
95
1Q
96
3Q
96
1Q
97
3Q
97
1Q
98
3Q
98
1Q
99
3Q
99
1Q
00
3Q
00
1Q
01
3Q
01
1Q
02
3Q
02
Quarter
Nu
mb
er
of
Ou
tag
es
There is a decreasing trend in thenumber of Local Switch outages.