National Maternity Survey 2013 Webinar

December 12th 2012

Survey development: stage oneConsultation with NHS trusts-Ten randomly selected NHS Trusts across seven SHA’s were consulted. They took part in a one hour interview or telephone call and were asked to provide feedback on the questionnaire, the attributing of responses in 2010 and the survey process.Feedback from past cognitive testing-Testing of overarching questions took place in 2011. The questions were tested within the maternity questionnaire and feedback was also collected on all questions. This was fed into the survey development.Consultation with stakeholders-Consulted with a number of organisations including DH, NCT, NPEU, RCM, Birth Choice UK, Bliss.

Survey development: stage twoFocus groups with new mums-Two focus groups conducted in London with new mums focusing on their experiences and the importance of different aspects of their experience.•Cognitive testing-The proposed new questionnaire has been thoroughly tested with 26 new mums across different Boroughs of London and Oxford.•Sampling questionnaire-As part of the development we sent a sampling questionnaire to trusts find out whether trusts can identify if they provided antenatal and postnatal care to women who gave birth at their trust. This has formed the basis of further decisions.

Survey development: final stage•What has this resulted in?-A redeveloped questionnaire with a strong focus on patient experience. Questions which are not understood, can be collected in other ways or do not provide actionable or clear information have been removed.-Some of the proposed new questions are focusing on continuity of care, communication (including listening), respecting decisions and choice. -We have proposed adding existing questions from the 2007 survey such as cleanliness and respect and dignity back into the questionnaire.

The questionnaire is not finalised at this stage.

Sampling Pilot•Issues arising from the 2010 survey

-Could not establish users of antenatal and postnatal care.

-Impacted on the survey reports.

-Labour & Birth section was the only benchmarked section.

-Taking steps to try and benchmark all three sections of the report for the 2013 survey.

Sampling Pilot•Development of sampling methods

-Sample pilot aims to identify antenatal and postnatal care users.

-General Medical Practice Code (GMPC) and postcode will be used.

-Electronic records will be used if accurate.

-Could enable all three sections to be benchmarked.

Sampling Pilot•Practicalities of the pilot

-Providing postcode and GMPC.

-Establishes proximity of the respondent to the trust.

- Sample size increase to 300.

Sampling Pilot

•Identifying AN/PN care users and geographies

-Trusts provided with a look up file of postcodes relating to their service areas.

-GMPC and postcode to establish proximity of respondent.

-Women registered or living close to the trust will be identified.

-Identified women are likely to have had all their care at the trust.

- >30 responses will allow all sections to be benchmarked.

- Still looking for participants.

Practicalities of AdministrationApproved Contractors-Patient Perspective-Picker Institute Europe-Quality Health

-Minimally, contractors will: - print questionnaires- enter data from respondents- provide trust reports

-Contractors to be appointed by end March 2013

Please note that conducting the survey ‘in-house’ is not recommended

Practicalities of AdministrationFieldwork period-Begins early May & lasts for up to 18 weeks-Longer fieldwork period higher response rates – especially for ‘hard to reach’ groups-Allow time for three weeks between mailings

Throughout the fieldwork period, the co-ordination centre...-Must be kept updated with any changes to contacts-Will collect monitoring data on a weekly basis-Will support trusts and contractors to resolve queries

Practicalities of AdministrationDBS (Demographic Batch Service) checks-Survey samples must be sent to DBS for checking-Trusts should do this before each mailing-Details of mothers and babies should be on separate rows-Aim is to identify & exclude cases of infant or maternal mortality

Further checks-Trusts should take reasonable steps to satisfy themselves that they have removed, where possible, cases involving:

- Concealed pregnancies- Babies taken into care

Full list of inclusion/exclusion criteria in guidance (March 2013)

Potential Errors: Sampling

-The sample will be all women giving birth in Feb 2013

-Common sampling errors include:• incomplete coverage• including births outside the sampling period • sending out mailings without conducting DBS checks first• missing information• incorrect formatting

Potential Errors: Questionnaire

The published pre-designed questionnaire must be used

Errors can occur if trusts re-format the questionnaire:

• Questions or response options excluded• Incorrect routing instructions• Question text changed• Incorrect numbering

Questionnaires with errors may lead to results being omitted

Potential Errors: Data entry

Numeric data •Multiple response questions•Out-of-range responses

use pre-designed data entry spreadsheet

Free Text Data Entry: submit anonymised free text comments•Remove staff, patient, ward/unit names•Remove offensive language

Provisional Timetable•Key Dates-Advertise survey with posters January to February-Guidance document published mid March-Approach and sign up with an approved contractor if appropriate (By end March)-Trusts draw sample (March – April)-Sample checking will be conducted throughout April. Mailing can only begin once a sample has been approved.-Survey mailing fieldwork period (May to August)-Response data due 3rd September-Free text comments due by 7th October-Reporting (November)

Maternity Information Poster•Maternity Posters-Informs people that personal information may be passed on.

-Trusts need to log people opting out of the survey (if any).

-Posters should be clearly visible and up by January 1st.

-Dissent, people who have previously objected should be left out.

-Timescale, the poster should be up throughout January and February.

-The poster is available on the NHS surveys website.

Picker Institute EuropeBuxton Court3 West WayOxford OX2 0JB

Tel: +44 (0)1865 208100Fax: +44 (0)1865 208101Email: info@pickereurope.ac.ukWebsite: www.pickereurope.org

Registered charity no 1081688Company limited by registered guarantee no 3908160