Melissa FieldSenior Information Analyst

21 May 2012

PRIMHD NGO Reports & Data Quality

Presentation Outline

Part 1:• PRIMHD NGO reports • Running PRIMHD NGO reports in InfoviewPart 2:• PRIMHD Data quality• Issues impacting reports• Audit Reports• Case Study – Wellink

PRIMHD NGO reports

• Four reports developed in conjunction with the PRIMHD NGO Advisory Group

• Each have different time periods– NGO Demographics – 12 monthly– NGO Activities – monthly– NGO Outcomes – 3 monthly– NGO Referrals – 6 monthly

NGO Demographics

• Table 1 & 2– Clients seen by team, age, ethnicity and sex with

DHB population comparisons• Table 3

– Clients seen by another NGO and/or DHB and with contact and average length of stay (ALOS) information

• Table 4 – Average length of stay (ALOS) by Team

NGO Activity

• Table 1– Clients seen by NGO of Service, Team Type

and Team Name, showing Bed nights, Face to Face contacts and Other contacts

• Table 2– Clients seen nationally by Team Type showing

Bed nights, Face to Face contacts and Other contacts

NGO Outcomes

• Table 1– Clients referred by NGO Team Type, DHB

Team Type, DHB Team Name, Average Admission HoNOS, Average Discharge HoNOS and Average change in HoNOS

NGO Referrals

• Table 1– Clients with their “Referral From” sources, by

NGO of Service, Team Type and Team Name• Table 2

– Clients with their “Referral To” sources, by NGO of Service, Team Type and Team Name

Business Objects Infoview

• To request Infoview access or to log in to Infoview go to:http://busobjxi.moh.health.nz/MOH.html

Logging on

• Go to http://busobjxi.moh.health.nz/MOH.html

Key points to note

• Be mindful of how up to date your PRIMHD data submissions are– “No data to fetch” or a blank report may

indicate no data has been submitted for that time period

• You do not need to wait for report to run – It’s ok to log out of Infoview or your machine

and log back on later

NGOs reporting to PRIMHD

• As at 27/04/2011 we had the following number of NGOs reporting to PRIMHD:

• This is a huge number of organisations reporting – thank you!

• There are 30 NGOs yet to go live.

FTP PRIMHD Online Total88 147 235

PRIMHD Compliance Details - FTP

• Full PRIMHD Compliance for NGOs submitting via FTP is awarded upon:– Successful completion of test scripts– File of at least one month’s worth of data achieving 98%– Satisfying a set of basic data quality checks

• Once reporting to PRIMHD, checks and monitoring by MoH continue to ensure on-going data quality.

• Note PRIMHD Compliance ≠ NGO Provider Completeness. If data is missing from your system or is not submitted, your PRIMHD data will be incomplete, even if you have full compliance.

Issues Impacting Reports• Data Quality Issues

– Zero length bednights– Incomplete volumes– Duplicated data – referrals and activities– Some teams not reporting– Error records – data not in PRIMHD

• Interpretation Issues– Is the report counting clients or activities?– What time period is it for?– Which organisation?– When was the report run – has the DM refreshed?

Audit Reports

• MoH developed a set of audit reports that can be run to show the data that makes up the reports.

• These can be valuable when trying to reconcile local data to the aggregated reports.

• Please feel free to request these to help verify your data.

On-going Work

• PRIMHD has been a steep learning curve for both MoH and NGOs.

• We have made a lot of progress and we are still learning as we continue to work with organisations.

• The following slides give details of a case study showing our work with one NGO.

Wellink Case Study (1)

• Background Details• The Wellink Trust (Wellink) achieved full PRIMHD

Compliance in July 2010.• The data quality checks to grant full compliance have been

increased significantly in the last year to try to catch any data quality issues before an NGO’s data goes into production.

• For Wellink a lot of data quality investigation was done after they had been given full compliance, and this highlighted several issues.

Wellink Case Study (2)

• MoH and Wellink worked closely together to resolve data quality issues:

Zero Length Bednights• Bednights starting and ending on the same day were being

reported by residential teams, giving a zero bednight count and affecting activity volumes.

• MoH worked with Wellink to identify the incorrect reporting and advise what was needed to address the issue.

• Wellink has made extract changes and is now correctly reporting bednights, meaning their activity volumes in PRIMHD are correctly reflecting the services provided.

Wellink Case Study (3)

Duplicate and overlapping referrals• Wellink had reported a number of duplicate or overlapping

referrals, where the same client had more than one referral for the same team at the same time.

• MoH worked with Wellink to identify the duplicate referrals and advise what was needed to address the issue.

• Wellink has made extract changes to remove the duplicates, meaning their referral volumes in PRIMHD are correctly reflecting the services provided.

• On-going monitoring continues to show no further duplicates are being submitted by Wellink which is great news!

Wellink Case Study (4)

Duplicate activity records• Wellink had reported a number of duplicate activity records,

where the exact activity details for a client were reported more than once.

• MoH worked with Wellink to identify the duplicate activities and advise what was needed to address the issue.

• Wellink has made extract changes to remove the duplicates, meaning their activity volumes in PRIMHD are correctly reflecting the services provided.

• On-going monitoring shows the number of activity duplicates from Wellink in PRIMHD remains very low.

Wellink Case Study (5)

Long Duration Contacts• Wellink had reported a few contact activities with very long

durations - some of these looked like 24 hour clock errors (e.g. starts at 08.45 and ends at 21.00).

• MoH worked with Wellink to identify the long duration activities.

• Wellink has corrected this data.• Ongoing monitoring shows that there are no contacts from

Wellink in PRIMHD with very long durations.

Wellink Case Study (6)

• MoH and Wellink – also worked together on:

Team Detail Updates• MoH updated Wellink’s PRIMHD Team Details to ensure

the team names on the reports matched their local names.

Record Deletions• MoH deleted some data from PRIMHD on Wellink’s behalf,

following a system change which altered their referral numbering.

Audit Reports• MoH provided audit reports to Wellink to help with their

reconciliation of the PRIMHD reports to their local data.

PRIMHD Contact details

Data or report enquiries:Melissa Field

Senior Information AnalystEmail Melissa_Field@moh.govt.nz

Ph (04) 816 3310

Data Quality enquiries:Senior Data Quality Analyst/Auditor

Ph (04) 816 3349