Post on 27-Apr-2018
NPCR FeedbackData Evaluation Reports
& Data Quality Indicators
Tara Hylton, FL DOHBrad Wohler, FCDS
July 28, 2005
CDCNAACCRNPCR
FCDS
NPCR Reports• Standard Status Report
• Quality• Completeness• Timeliness
• Submission Summary Report• Single & Inter-field Errors• % of Over-rides
• Data Quality Indicators• Core Surveillance Data• Advanced Surveillance Data
Standard Status Report• % Completeness
• @ 12 & 24 months
• Unresolved Dups• % DCO• % Missing Data
• Age, Sex, Race & County
• % Passing Edits
Standard Status Report
12 Months 2003 92.37 0.00 0.00 0.00 0.02 0.42 0.00 100.002002 102.95 0.00 2.93 0.00 0.02 0.56 0.00 100.002001 105.31 0.00 2.82 0.01 0.04 0.53 0.00 100.002000 105.09 0.00 3.26 0.01 0.03 0.57 0.00 100.001999 104.32 0.00 3.50 0.00 0.02 0.52 0.00 100.001998 102.28 0.00 3.68 0.01 0.00 0.52 0.00 100.00
90.00 N/A N/A N/A N/A N/A N/A 97.0095.00 <=1 <=3 <=2 <=2 <=3 <=2 99.00NPCR 24 Month Standard
24+ Months
STANDARDNPCR 12 Month Standard
Percent Death
Certificate Only
Cases
Percent Passing Core
Single and Inter-field
Edits
Percent Missing or UnknownCore Data Elements
Age Sex Race County
NPCR Standards Grouping
Diagnosis Year**
Percent Completeness Adjusted for Duplicates*
Unresolved Duplicates Rate (per
1,000)
Submission Summary Report• records (#, %) with errors• % of Over-Rides
• 10 fields• Age/site/morph• Seqno/dxconf• Site/lat/seqno• Site/type• Histology• Report source• Ill-define site• Leuk, lymphoma• Site/behavior• Site/lat/morph
Submission Summary Report 2005
n % n % n % n % n % n %Total Records with Errors 0 0.00 0 0.00 0 0.00 0 0.00 0 0.00 0 0.00
Total Errors 0 - 0 - 0 - 0 - 0 - 0 -
2000 1999 1998Edit Name
2003 2002 2001
Submission Summary Report 2005
Age/Site/ SeqNo/ Site/Lat/ Site/TypeMorph DxConf SeqNoAge, Diagnostic Site/Histology/ Primary Site, 1 = 2 = Diagnostic 3 = Both
Diagnosis Primary Site, Confirm, Seq Laterality/ Morphology- Morphology-- Confirmation, 1 and 2Year Morphology Num--Central Sequence Type Check Type&Behavior Behavior Code Apply2003 0.11 0.54 0.11 0.63 0.02 0.00 0.002002 0.08 0.55 0.09 0.45 0.05 0.00 0.002001 0.08 0.55 0.05 0.46 0.03 0.00 0.002000 0.07 0.53 0.09 0.41 0.06 0.00 0.001999 0.06 0.53 0.08 0.41 0.06 0.00 0.001998 0.07 0.57 0.02 0.39 0.05 0.00 0.00
0.19 0.73 0.23 1.84 0.08 0.00 0.00SEER OVER-RIDE FLAG QUALITY MEASURES**
Histology
Submission Summary Report 2005 cont.
Report Ill-define Leuk, Site/ Site/Lat/Source Site Lymphoma Behavior Morph Percentage
Type of Report Seq Num-- Diagnostic Primary Site, Laterality, of RecordsDiagnosis Srce(DC),Seq Central, Primary Confirmation, Behavior Primary Site, with Over-
Year Num--Central Site, Morph Histologic Type Code Morphology Ride Flags*2003 0.02 0.42 0.01 0.00 0.01 1.622002 0.04 0.39 0.02 0.00 0.00 1.622001 0.01 0.41 0.03 0.00 0.01 1.562000 0.00 0.50 0.00 0.00 0.01 1.671999 0.00 0.50 0.00 0.00 0.00 1.641998 0.00 0.50 0.00 0.00 0.01 1.60
0.14 0.51 0.07 0.01 0.00SEER OVER-RIDE FLAG QUALITY MEASURES**
Data Quality Indicators• 24 month data• Core & Advanced items• Graphs
• 7 indicators
• Comparison across NPCR
Data Quality Indicators 2005 Core
NPCR Avg
Not in US but NOS (998) 0.08 0.05 0.03 0.04 0.05 0.28 Unknown (999, blank) 62.33 62.54 62.52 62.39 63.12 60.57
Year (<1850 or >2003, blank) 0.01 0.00 0.01 0.01 0.00 0.01
Spanish/Hispanic Origin (9, blank) 0.54 0.42 0.92 1.03 0.99 11.21
Unknown (99, blank) 8.38 7.51 6.09 5.75 5.21 76.75 Analytic Cases only 4.76 3.87 2.75 2.69 1.96
2001 2002
Patient Socio-demographic Birthplace [250]
Birthdate [240]
Race and Ethnicity [190]
Primary Payer at Diagnosis [630]
1999 20001998
Data Quality Indicators 2005 Core
NPCR Avg
Month (99, blank) 0.00 0.00 0.00 0.00 0.00 0.48 Analytic Cases Unknown Month 0.02 0.02 0.01 0.02 0.00
Other/Ill Defined Sites (C76.0 - C76.8) 0.06 0.04 0.05 0.05 0.05 0.08 Unknown Primary Site (C80.9) 2.68 2.80 2.67 2.40 2.37 2.43
Non-specific Neoplasms (8000 - 8001) 5.74 5.70 5.75 5.32 5.38 3.70 Non-specific Neoplasms (8002 - 8005) 0.04 0.02 0.03 0.02 0.02 0.02 Analtyic Cases Neoplasms (8000-8005) 2.00 1.95 2.04 2.08 2.05
Tumor CharacteristicsDate of Diagnosis [390]
Topography [400]
Morphology [420]
2000 2001 20021998 1999
Data Quality Indicators 2005 Core
NPCR Avg
Not Microscopically Confirmed (5, 6, 7, 8) 3.00 2.91 3.11 2.97 3.12 3.45 Unknown (9) and Blank 0.31 0.32 0.53 0.40 0.31 1.26
Two or more (01 - 35) 24.99 24.99 24.11 24.03 23.14 18.37 Unspecified (99) 0.00 0.00 0.00 0.00 0.00 0.00
VIN III, VAIN III, AIN III 0.00 0.00 0.00 0.00 0.00 0.00
Grade [440] (9, blank) excludes DCO, C80.9 35.42 35.21 36.22 35.65 35.15 32.32 Analytic cases excludes DCO, C80.9 32.81 33.12 34.28 34.33 34.41 Laterality [410] paired organs only Only 1 side and side NOS (3) 0.10 0.13 0.11 0.10 0.16 0.38 Unknown (9, blank) 3.93 3.96 4.11 3.81 3.87 2.61 Analytic cases Unknown laterality 2.20 2.23 2.35 2.23 2.25
2000 2001 2002
Diagnostic Confirmation [490] excludes DCOTumor Characteristics continued
1998
Sequence Number--Central [380]
Reportable Cancers
1999
Tumor Miscellaneous
Data Quality Indicators 2005Advanced
NPCR Avg
Not Tracted (000000) 0.00 0.00 0.00 0.00 0.00 4.26 Tracted, but Not Available (999999) 0.00 0.00 0.00 0.00 0.00 1.22 Blank 0.57 0.70 1.26 2.20 9.01 49.60 Invalid Codes 0.30 0.30 0.34 0.29 0.25 0.17
Blank 0.57 0.70 1.26 2.20 9.01 26.32 Unknown (9) 0.00 0.00 0.00 0.00 0.03 2.63
Blank 0.00 0.00 0.00 0.00 0.00 0.00 Unknown (999) 0.00 0.00 0.00 0.00 0.00 0.07 Out of State Resident (998) 0.00 0.00 0.00 0.00 0.00 0.02 Valid County Recode (000) 0.00 0.00 0.00 0.00 0.00 3.68
Substate Geography Census Tract [130]
Census Tr Cert [365]
County at Diagnosis [90]
2001 20021998 1999 2000
Data Quality Indicators 2005Advanced
NPCR Avg
Blank 0.00 0.00 0.00 0.00 0.00 58.55 Surgery, NOS (90) 4.46 3.79 3.20 1.28 1.06 0.37 Unknown (99) 4.52 4.45 4.54 3.68 3.89 1.24 Analytic Cases Unknown 0.77 0.76 0.89 0.79 0.84
Blank 0.00 0.00 0.00 0.00 0.00 74.15 Unknown (9) 97.65 94.94 86.19 16.46 16.60 7.65 Analytic Cases Unknown (excludes brain, CNS, lymphomas, leukemias and misc)
Blank 0.00 0.00 0.00 0.00 0.00 74.15 Unknown (9) 96.74 93.41 83.27 4.01 4.08 5.33 Analytic Cases Unknown 98.47 95.11 84.87 0.81 0.88
1998 1999
First Course Treatment
98.49 95.33 84.89
RX Summ Surg Prim Site [1290]
RX Summ Scope Reg LN Sur [1292]
1.14 1.37
2000 2001 2002
RX Summ Surg Oth Reg/Dis [1294]
Data Quality Indicators 2005Advanced
NPCR Avg
Blank 0.00 0.00 0.00 0.00 0.00 2.26
Year (invalid) 0.00 0.00 0.00 0.00 0.00 0.02 Year (unknown or missing year) 0.00 0.00 0.00 0.00 0.00 2.31
Blank 0.00 0.00 0.00 0.00 0.00 19.61 Death Cert. Avail., But No COD (7797) 0.00 0.00 0.00 0.00 0.00 1.42 Death Certificate Not Available (7777) 0.00 0.00 0.00 0.00 0.00 4.50
Vital Status and Cause of Death Vital Status [1760] (blank)
Date of Last Contact [1750] decedents only
Cause of Death [1910]
1998 1999 2000 2001 2002
% Other, Ill-defined, and NOS Primary Site [400]All Sites Combined*, Both Genders
Individual State Registries and NPCR Registries Combined, 2001 diagnosis year
0
1
2
3
41 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 FL 44 45 46
NP
CR
State registries
Per
cen
tag
e
Unknown primary site (C80.9) Other and ill-defined (C76.0-76.8)
*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.
% Non-specific Morphology [420]All Sites Combined*, Both Genders
Individual State Registries and NPCR Registries Combined, 2001 diagnosis year
0
2
4
6
8
101 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 FL 44 45 46
NP
CR
State registries
Per
cen
tag
e
Non-specific neoplasms (8000-8005)
*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.
% Unknown Diagnostic Confirmation or Not Microscopically Confirmed [490]All Sites Combined*, Both Genders
Individual State Registries and NPCR Registries Combined, 2001 diagnosis year
0
2
4
6
8
101 2 3 4 5 6 7 8 9
FL 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46
NP
CR
State registries
Per
cen
tag
e
(9) Unknown (5,6,7,8) Not microscopically confirmed
*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder. Death certificate only cases were also excluded.
% Unknown or Unspecified Laterality [410] Paired Organs Only, All Sites Combined*, Both Genders
Individual State Registries and NPCR Registries Combined, 2001 diagnosis year
0
2
4
6
8
10
12
14
161 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 FL 36 37 38 39 40 41 42 43 44 45 46
NP
CR
State registries
Per
cen
tag
e
(9) Paired site, but no information concerning laterality; midline tumor (3) Only one side-side unspecified
*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.
% Unknown Race [160] All Sites Combined*, Both Genders
Individual State Registries and NPCR Registries Combined, 2001 diagnosis year
0
1
2
3
4
51 2 3 4 5 6 7 8 9 10
11
12
13
14
15
16
17
18
FL 20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
NP
CR
State registries
Per
cen
tag
e
Unknown
*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.
% Death Certificate Only [500]All Sites Combined*, Both Genders
Individual State Registries and NPCR Registries Combined, 2001 diagnosis year
0
1
2
3
4
5
61 2 3 4 5 6 7 8 9 10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
FL 38
39
40
41
42
43
44
45
46
NP
CR
State registries
Per
cen
tag
e
Death certificate only
*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder.
% Unknown Summary Stage 2000 [759]All Sites Combined*, Both Genders
Individual State Registries and NPCR Registries Combined, 2001 diagnosis year
0
5
10
15
20
251 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 FL 39 40 41 42 43 44 45
NP
CR
State registries
Per
cen
tag
e
Unknown
*Invasive cases only, excludes basal and squamous cell carcinomas of the skin except when these occur on the skin of the genital organs and in situ cancers except urinary bladder. Death certificate only, pathology laboratory only, and unknown primary site cases were also excluded.
Conclusions
• Florida é Quality Data
• Generally unremarkable
• Room for improvement
Conclusions
• Site/lat/morphology • paired organs w/ insitu behavior
• Analytic cases• Unknown payor
• é % Unknown birthplace