MCH Group M&E Work Plan
-
Upload
ifelakojaofin -
Category
Documents
-
view
83 -
download
0
Transcript of MCH Group M&E Work Plan
MCH group M&E Work Plan © [Haihuwa Lafiya Foundation and 2011] Page 1 of 27
Haihuwa Lafiya Foundation
[September 19, 2011 – Oct 18, 2012]
MMoonniittoorriinngg && EEvvaalluuaattiioonn
WWoorrkk PPllaann
Version: First
Date of Release: September 29, 2011
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 2 of 27
Table of Contents
1. Introduction .............................................................................................................................................. 4
1.1. Vision and Mission of Haihuwa Lafiya Foundation ............................................................................. 4
1.2. Background / Context Information for Haihuwa Lafiya Foundation .................................................... 4
1.3. [project name] and Funding Mechanism ............................................................................................. 6
1.4. Purpose of the Monitoring & Evaluation Work Plan ............................................................................ 6
1.5. Monitoring & Evaluation Team ............................................................................................................ 7
1.6. Audience Analysis ............................................................................................................................... 7
2. Frameworks / Models [organizational / project level] ............................................................................. 12
2.1. Conceptual Framework ..................................................................................................................... 12
2.2. Logic Model ....................................................................................................................................... 13
2.3. Results Framework ........................................................................................................................... 14
2.4. Results Framework Hypothesis .......................................................... Error! Bookmark not defined.
3. [project x] Implementation Plan ............................................................................................................. 15
4. [project x] Indicator Information Sheets ................................................................................................. 17
5. Evaluation Plan ...................................................................................................................................... 22
6. Data Quality Plan ................................................................................................................................... 23
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 3 of 27
Acronyms
Acronym Explanation
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 4 of 27
1. Introduction
1.1. Vision and Mission of Haihuwa Lafiya Foundation
The vision of Haihuwa Lafiya Foundation is to be the leading organization in the protection and
improvement of the wellbeing of women, infants and children in Zamfara state, with emphasis on the health
status of women of childbearing age.
The Mission of Haihuwa Lafiya Foundation is committed to ensuring the quality of health care for women,
infants, and children, and through working effectively with communities and other development partners.
The underlying values of Maternal & Child Health Services are:
1. Promotion of health facility based delivery.
2. Capacity building for health workforce.
3. Coordination and collaboration with local communities, other state agencies, organizations and
individuals concerned with the health and well-being of women, infants, and children.
1.2. Background / Context Information [for organisation X and project name]
INTRODUCTION
Proper care during pregnancy and delivery is important for the health of both the mother and the baby, and is
an indicator of the status of maternal and child health in the society. In the 2008 NDHS, women who had
given birth in the five years preceding the survey were asked a number of questions about maternal care.
For all live births in the past five years, mothers were asked what type of assistance they received at the time
of delivery. The health care that a mother receives during pregnancy, at the time of delivery, and soon after
delivery is important for the survival and well-being of both the mother and her child. The 2008 NDHS
obtained information on the extent to which women in Nigeria receive care during pregnancy, during delivery,
and in the period after the baby is born. These findings are important to policy- makers and programme
implementers in designing appropriate strategies and interventions to improve maternal and child health care
services. 1
According to the World Health Organisation (WHO), a skilled health worker is “an accredited health
professional—such as a midwife, doctor, or nurse—who has been educated and trained to proficiency in the
skills needed to manage normal (uncomplicated) pregnancies, childbirth and the immediate post-partum
period, and in the identification, management, and referral of complications in women and newborns” (WHO,
2008). WHO further states that traditional birth attendants (TBA), trained or untrained, are excluded from the
category of skilled health workers. In this context, the term TBA refers to traditional, independent (of the
health system), non-formally trained and community-based providers of care during pregnancy, childbirth,
and the postnatal period.
PLACE OF DELIVERY
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 5 of 27
Increasing the percentage of births delivered in health facilities is an important factor in reducing deaths
arising from the complications of pregnancy. The expectation is that if a complication arises during delivery, a
skilled health worker can manage the complication or refer the mother to the next level of care. Table 1
shows the percent distribution of all live births in the five years preceding the survey by place of delivery, and
the percentage of births delivered in a health facility, according to background characteristics. The factors
that have been described as determinants include mother’s age, birth order, residence and zone. Others
include mother’s education, antenatal care visits and wealth quintile.
By age, women 20-34 are most likely to deliver in a health facility (38 percent). Women having their first baby
are more likely than other women to deliver in a health facility; the proportion of births occurring in a facility
decreases sharply as birth order increases. Women in urban areas are more than twice as likely to deliver in
a health facility as their rural counterparts (60 percent compared with 25 percent). The North West has the
lowest proportion (8 percent). Women with higher levels of educational attainment are more likely to deliver
in a health facility than women with less education or no education. For example, women with more than
secondary education (90 percent) are nine times more likely to deliver in a health facility, compared with
women with no education (10 percent). The proportion of births occurring in a health facility increases
steadily with increasing wealth quintile. The majority of women who received no ANC services delivered at
home (96 percent).
ASSISTANCE DURING DELIVERY
In addition to place of birth, assistance during childbirth is an important variable influencing the birth outcome
and the health of the mother and infant. The skills and performance of the person providing assistance
during delivery determine whether complications are managed and hygienic practices are observed. Table 2
shows the percent distribution of live births in the five years preceding the survey by person providing
assistance at delivery and the percentage of births attended by a skilled health worker, according to
background characteristics. According to this table, 39 percent of births in the five years preceding the
survey were assisted by a skilled health worker (doctor, nurse, midwife, or auxiliary nurse/midwife); 9 percent
by a doctor; 25 percent by a nurse or midwife; and 5 percent by auxiliary nurse/midwife. In the absence of a
skilled health worker, a traditional birth attendant was the next most common person assisting a delivery (22
percent). Nineteen percent of births were assisted by a relative or other person, and an equal proportion of
births were attended by no one.
Women under age 20 (25 percent) are least likely to receive assistance from a skilled provider at delivery.
Older women (35-49 years) are most likely to deliver without any assistance (25 percent). The likelihood of a
skilled attendant delivering a birth decreases with increasing birth order, from 49 percent for first-order births
to 25 percent for births of order six or higher. One of the most striking differentials in assistance during
childbirth is by urban-rural residence. About seven in ten births to urban women are attended by a skilled
provider, compared with three in ten births to women in rural areas. Women in urban areas are most likely to
be assisted by a nurse or midwife (40 percent), while women in rural areas are most likely to be assisted by
a traditional birth attendant (25 percent). Thirty-three percent of births in the North West zones are assisted
by a traditional birth attendant. Women in North West are much more likely to deliver without any assistance
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 6 of 27
(44 percent) than are women in other zones (19 percent or lower). A mother’s level of education and wealth
status have a positive association with the likelihood that her delivery will be attended by a skilled provider.
PERCEIVED PROBLEMS IN ACCESSING HEALTH CARE
Many factors can prevent women from getting medical advice or treatment for themselves when they are
sick. Information on such factors is particularly important in understanding and addressing the barriers some
women face in seeking care during pregnancy and at the time of delivery. In the 2008 NDHS, women were
asked whether each of the following factors would be a big problem in seeking medical care: getting
permission to go for treatment, getting money for treatment, distance to health facility, transport cost, not
wanting to go alone, concern there may not be a female provider or any health provider, and concern that
drugs may not be available. Table 3 present information on the extent to which women reported that each of
these factors was a serious problem for them in accessing health care. Three-quarters of women reported
that they have at least one serious problem in accessing health care. The leading barrier to health care for
Nigerian women is getting money for treatment. Fifty-six percent of women said that getting money for
treatment was a serious problem in accessing health care. Problems getting permission to go for treatment
(14 percent) were less likely to be reported as a hindrance to seeking health care..
1.3. Haihuwa Lafiya Foundation and Funding Mechanism
Costs for the M&E plan and its implementation, including data collection, were covered under the overall
budget for project activities. Total funding for the first year, amounted to US$169,805.
1.4. Purpose of the Monitoring & Evaluation Work Plan
Monitoring and evaluation (M&E) is an important part of this important programme. It is very germane to
the success of this important public health programmes on maternal and child programmes. It will be
invaluable at all levels of this programme; from planning, implementation and evaluations.
This monitoring and evaluation plan is a comprehensive document showing all the activities outlined in
an M&E programme included in the parent programme or project.
This plan will assist the monitoring and evaluation of this programme of Increasing Women Delivered
by Skilled Birth Attendants in Zamfara State in North-West Nigeria.
The various reasons for M&E summarized below
Provides the structure to M&E
M&E plans explain its entire purpose and scope to all in an organization
It helps to organize, shows the various system within the M&E and how its various components
could be integrated.
It explains what is to be achieved, the people responsible for it, the purpose of M&E, when it will
be done and how it will be presented in a single document
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 7 of 27
The method of communicating the findings to all stakeholders.
1.5. Monitoring & Evaluation Team
A committed and multi-disciplinary team with experience in Monitoring and evaluation in maternal and child
health programs
1. Akomolafe Toyin a specialist in maternal and child health and will lead the group and provide the
guidance to the group, she is responsible for overseeing trainings, mobilization and awareness of all
stakeholders. She is responsible for the success of the whole process
2. Dr Adesina Olubukola is a specialist in obstetrics and Gynecology will head the training and
community mapping, she will also be charged with the responsibility of sensitizing the health facilities
as well as heading the dissemination team.
3. Dr Akanbiemu Adegoke Francis Community health specialist will oversee the completion of reports,
update and back check whether all the processes were done according to the set guidelines and
procedures
4. Mr Natukwatsa Amon Health and development Economics specialist will head the process of data
collection, data analysis and spearhead the process of report writing, he will be responsible for
software identification to be used in report writing
5. Mbwayo W Anne is a specialist in clinical psychology, training and report writing, she will work with
the person responsible for data analysis and reports and offer technical, she will liaise with the local
governments and state government to make ensure that stakeholders have their input in reports and
discussion.
6. Dr Falola Ezekiel Olajide tests and Measurement, its important to include and identify stakeholders
in the monitoring and evaluation process, he will mobilize all the identified stakeholders foe
discussion, update them, identify their roles and responsibilities, draw various modalities on how
they can fully participate in the process as well as ensuring that they are involved in all stages of
monitoring and evaluation.
1.6. Audience Analysis
The audiences in this programme are the stake holders who were involved right from the beginning of the
programme. The stake holders include:
1. The service providers who are in public, private or in the community and faith based
facilities.
2. Local government as represented by the chair person
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 8 of 27
3. State government as represented by the following commissioners- health, Women
Affairs and Justice.
4. Permanent secretary in the ministry of Health
5. Hospital Management Board
6. MCH Desk officer at the LGA
7. MCH Programme Manager at the state
8. Civil societies/Non governmental Organization
9. Implementing partner Monitoring and Evaluation Officer, and Programme Manager
10. Community members; religious leaders, opinion leaders, district heads, ward heads,
men, women, and children
The service providers
1. They will attend training
2. They will provide the delivery services to the women
3. Keep record
4. They will also be involved in advocacy and IEC distribution
They are likely to ask:
That they do not have enough skills- so what will happen to improve on these
The personnel are not enough, so where will they get the extra personnel
The facilities do not have enough delivery kits, where shall we get them from?
Some of the skilled personnel are deployed for in other duties, what will happen so that
they can manage to do the work?
What mechanism will be used to make the women come o deliver in the health facilities
as many pregnant women deliver at homes?
Local government as represented by the chair person
1. Facilitate whole process of the programme by providing an enabling environment
2. They can also employ staff.
The LGA is likely to ask:
What are our roles?
Are we supposed to provide money in any form?
The state
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 9 of 27
1. Employ staff
2. Will distribute in a rational manner the available staff.
3. Provide money.
Just as the LGA it is likely to ask
What their roles are
Are we supposed to provide money in any form?
Whom will you be reporting to?
We have shortage of personnel, where shall we get enough to send to the facilities?
Will it be possible to pass all the bills that are relevant, can you at least give some outline of
what you expect
Will this guarantee safe delivery of mothers?
Permanent secretary in the ministry of Health
1. Accounting officer for example in fund utelization
2. Will facilitate and spearhead the policy making and implementation
They would want to know:
How that affects the budget and how is it more important than the other areas of health like
Malaria, HIV and TB, so as to be given priority
Where will you get the curriculum that you will be using to upgrade the health workers and is
that not taught in their basic nursing course?
What is new that you will be imparting that the health providers do not have? If they have
this knowledge are you suggesting that the health providers are not doing their work well?
Have you consulted the current training curriculum so that you point out what is missing?
Commissioner of justice
1. Drafting laws dealing with MCH
2. Facilitate passing of MCH laws
Commissioner of women affairs
Advocate for the passing of laws MCH
Hospital Management Board
1. Ensure that amenities e available in the hospitals
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 10 of 27
2. Will ensure that those with delivery skills are doing the work and not being involved in unrelated
duties
Some of the skilled personnel are in the management of our health facilities, are you
suggesting that we make them work in the two areas?
You know that we have shortage of personnel in our health facilities, how will the
programme work and that is why we are not able to provide 24 hour skilled services?
Our facilities do not get enough materials and that is why we ask the mothers to come with
some essential delivery kits like gloves, how will the programme assist the facilities so that
the kits can be available all the time?
Much as we would like to provide skilled services, none of our current personnel has mid
wifely skills, how do you intend to cover this gap and we have been talking to the ministry of
health to send even one and they keep promising?
MCH Programme Manager at the state/ MCH Desk officer at the LGA
Will provide data on what is happening on the ground and also compile the incoming data for the programme
As the people in charge of the MCH how will the programme work in collaboration with us?
Why is the programme not covering the whole state?
What form of reporting will be done to us will you be having new forms or just the ones that
are in use?
There are other NGOs working almost on the same in the area, why don’t you combine, or
how different are you from them?
How will you convince the mothers to come to the clinics and even deliver in the facilities, as
we have tried before and the culture here is that mothers should deliver alone as a sign of
being a woman? In fact some of the reasons why many women do not come to deliver in our
facilities is because of that myth and hence the funding is neglected and money diverted to
other areas for example HIV.
Civil societies/Non governmental Organization
1. They will mobilize the community so that there can be support for the mothers to deliver in the
health facilities
2. They will also push the government to pass laws affecting MCH
They will want to know:
How will the programme deal with stigma associated with delivery in health facilities?
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 11 of 27
How will the community elders be convinced that it is important that women deliver in the
hospitals?
The government has been charging some money and many of the women do not have the
money to deliver in hospitals, let alone buying the kits they are told to carry by the health
facilities. So how will the programme address this issue?
Implementing partner Monitoring and Evaluation Officer, and Programme Manager
What are your suggestions?
If all the issues that you have raised are addressed, can we go ahead and plan for the
programme to start and monitor the progress?
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 12 of 27
2. Frameworks / Models [organizational / project level]
2.1. Conceptual Framework
Conceptual FrameworkReasons why women in Zamfara State deliver at
homeIndividual Characteristics
Community characteristics
Organizational Characteristics
•Poverty •Literacy level
•Age
•Culture of Shame•Religion •Tradition
•Gender disparity
•Poor political commitment
•Lack of skilled personnel
Increased Maternal
morbidity or mortality
Delivery without
SBA
Poor service utilization
Unavailability of quality services
with skilled birth attendants (SBA)
MCH group M&E Work Plan © [Haihuwa Lafiya Foundation and 2011] Page 13 of 27
2.2. Logic Model
Logic Model
Inputs
• Materials
• Money
• Training curriculum
• Personnel
Activities
• Advocacy
• Mobilization & sensitization
• Training of health workers
• Supply kits & equipments purchased
• Develop IEC materials
Outputs
• No of health workers trained
• No of delivery kits provided
• No of IEC materials distributed
• No of sensitization programs organised
• No of advocacy visits conducted
Outcome
- Increased knowledge &
attitude among women
- Increased % of women
delivering by SBA
- Improved community
attitude towards
delivery by SBA
- Improved political will
Impact
Reduction in
maternal morbidity
and mortality
MCH group M&E Work Plan © [Haihuwa Lafiya Foundation and 2011] Page 14 of 27
2.3. Results Framework
Table 2.1:
Result FrameworkGoal: Reducing maternal morbidity and mortality
IR1: Increased demand for services
IR2: Health System strengthening
SO: Doubling the % annually of women delivered by skilled birth attendants in Zamfara over a 5 year period
IR1.1: Increased knowledge among women
IR2.1: Trained personnel
IR1.3: Improved family and community support for
pregnant women
IR1.2: Women empowerment
IR2.2: Rational distribution of personnel
IR2.3: Rational distribution of well equipped facilities
MCH group M&E Work Plan © [Haihuwa Lafiya Foundation and 2011] Page 15 of 27
3. Implementation Plan
[project x] Implementation Plan: name of organisation
Grant Goal– Reducing Maternal Mortality And Morbidity
Project Objective #1 – increased demand for services
Key Activities Target Beneficiaries Time Frame Person / Partner
Responsible
Results Anticipated (Target
input / output)
Budget Comments
Start
date
End date
Conduct
advocacy visits
Women and the
community.
Oct 2011 Oct 2012 Community health worker.
Implementing partner
(representative)
Improved community support for
delivery by skilled birth
attendants.
Distribution of
culturally
acceptable IEC
materials.
Women and the
community.
Oct 2011 Oct 2013 Community health worker. Improved knowledge of women
about benefits of delivery by
skilled birth attendants.
Mobilization and
sensitization by
community health
workers
Women and the
community.
Oct 2011 Oct 2012 Community health worker.
Improved knowledge of women
about benefits of delivery by
skilled birth attendants.
[project x] Implementation Plan: name of organisation
Grant Goal – Reducing Maternal Mortality And Morbidity
Project Objective #2 – health system strengthening
Key Activities Target Time Frame Person / Partner Results Anticipated Budget Comments
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 16 of 27
Beneficiaries Start
date
End
date
Responsible (Target input / output)
Training of
health workers.
Care providers State ministry of health.
Implementing partner.
Increased no of skilled birth
attendants available.
Procurement
and supply of
kits and
equipment.
Facility clients State ministry of health. Delivery kits available for
service provision.
MCH group M&E Work Plan © [Haihuwa Lafiya Foundation and 2011] Page 17 of 27
4. [project x] Indicator Information Sheets
Indicator Protocol Reference Sheet Number: I
Name of Indicator: Number of Government policies enacted by Government on MCH
Result to Which Indicator Responds: Health system strengthened
Level of Indicator: Input
Description
Definition: The number of policies formulated and adopted (passed into law) on MCH in the last two years
Unit of Measure: Numbers
Disaggregated by: State Government
Justification and Management Utility: The formulation and ratification of laws on MCH provide an enabling environment for women to be attended by skilled birth attendants.
Plan for Data Acquisition
Data Collection Method: Inspection of Government’s records
Data Source: Parliament, ministry of health and local government
Frequency and Timing of Data Acquisition: Data collection will biannual
Estimated Cost of Data Acquisition: Cost included in the contract with implementing partners.
Individual Responsible: Commissioner of Justice
Location of Data Storage: Commissioner of Justice and State ministry of health
Data Quality Issues
Known Data Limitations and Significance: Not Applicable
Actions Taken or Planned to Address this Limitation: Not Applicable
Internal Data Quality Assessments: Not Applicable
Plan for Data Analysis, Review & Reporting
Data Analysis: Not Applicable
Presentation of Data: Not Applicable
Review of Data: Not Applicable
Reporting of Data: Not Applicable
Baselines: -
Year Target Actual Cumulative Net Change Notes
2013 1 1 -
2014 2 2 3
Performance Indicator Values
Year Target Actual Notes
This Sheet Last Updated On:
September 2011
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 18 of 27
Indicator Protocol Reference Sheet Number: I
Name of Indicator: IEC Distribution
Result to Which Indicator Responds: Increasing demand for services
Level of Indicator: Input
Description
Definition: Number of IEC materials distributed during the year
Unit of Measure: Numbers
Disaggregated by: LGA and ward facilities
Justification and Management Utility: Providing information is one of the means of favourable behavioural change
Plan for Data Acquisition
Data Collection Method: Community Based worker’s record
Data Source: Communit worker’s record
Frequency and Timing of Data Acquisition: Annually
Estimated Cost of Data Acquisition: Cost included in the contract with implementing partners.
Individual Responsible: State Government (Program Manager/Directro of statistics)
Location of Data Storage: State ministry of health and LGA
Data Quality Issues
Known Data Limitations and Significance: Not Applicable
Actions Taken or Planned to Address this Limitation: Not Applicable
Internal Data Quality Assessments: Not Applicable
Plan for Data Analysis, Review & Reporting
Data Analysis: Not Applicable
Presentation of Data: Not Applicable
Review of Data: Not Applicable
Reporting of Data: Not Applicable
Baselines: - -
Year Target Actual Cumulative Net Change Notes
2012 20% 15% -
2013 40% 60%
Performance Indicator Values
Year Target Actual Notes
This Sheet Last Updated On:
September 2011
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 19 of 27
Indicator Protocol Reference Sheet Number: I
Name of Indicator: Community outreach effort
Result to Which Indicator Responds: Increasing demand for services
Level of Indicator: Input
Description
Definition: Number of persons reached during community mobilization by community health workers in a year
Unit of Measure: Numbers
Disaggregated by: Senatorial district, LGA, ward and community
Justification and Management Utility: Members of the community participated in decision in making and contribute to health seeking practices of pregnant women.
Plan for Data Acquisition
Data Collection Method: Renew of community health workers records
Data Source: Health worker’s record
Frequency and Timing of Data Acquisition: Monthly
Estimated Cost of Data Acquisition: Cost included in the contract with implementing partners.
Individual Responsible: State Government (Program manager/Director of statistics)
Location of Data Storage: SMOH and each LGA
Data Quality Issues
Known Data Limitations and Significance: Not Applicable
Actions Taken or Planned to Address this Limitation: Not Applicable
Internal Data Quality Assessments: Not Applicable
Plan for Data Analysis, Review & Reporting
Data Analysis: Not Applicable
Presentation of Data: Not Applicable
Review of Data: Not Applicable
Reporting of Data: Not Applicable
Baselines: -
Year Target Actual Cumulative Net Change Notes
2013 2012 20% -
2014 2013 30% 50%
Performance Indicator Values
Year Target Actual Notes
This Sheet Last Updated On:
September 2011
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 20 of 27
Indicator Protocol Reference Sheet Number: I
Name of Indicator: Number of personnel trained to provide skilled care
Result to Which Indicator Responds: Health system strengthened
Level of Indicator: Input
Description
Definition: Capacity building: Numbers of personnel trained to provide skilled care during delivery in a quarter
Unit of Measure: Numbers
Disaggregated by: Senatorial Districts, by LGA’s, Ward and Community groups
Justification and Management Utility: Attendants by skilled birth attendants at birth provide better health outcomes for mother and child
Plan for Data Acquisition
Data Collection Method: Review of training records and sessions
Data Source: Attendance lists, curriculum
Frequency and Timing of Data Acquisition: Annual
Estimated Cost of Data Acquisition: Cost included in the contract with implementing partners.
Individual Responsible: State Government
Location of Data Storage: Hard and Soft copies by LGA and Senatorial Districts
Data Quality Issues
Known Data Limitations and Significance: Not Applicable
Actions Taken or Planned to Address this Limitation: Not Applicable
Internal Data Quality Assessments: Not Applicable
Plan for Data Analysis, Review & Reporting
Data Analysis: Not Applicable
Presentation of Data: Not Applicable
Review of Data: Not Applicable
Reporting of Data: Not Applicable
Baselines: -
Year Target Actual Cumulative Net Change Notes
2012 20% 15% -
20143 30% 50%
Performance Indicator Values
Year Target Actual Notes
This Sheet Last Updated On:
September 2011
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 21 of 27
Indicator Protocol Reference Sheet Number: I
Name of Indicator: Percentage of Health facilities providing 24 hours basic obstetric care
Result to Which Indicator Responds: Strengthening health system
Level of Indicator: Input
Description
Definition: Proportion of health centres providing 24 hours basic obstetrics care services by skilled birth attendants
Unit of Measure: Proportion
Disaggregated by: Political wards, LGA, Senatorial district
Justification and Management Utility: Skilled attendants at delivery contribute to better health outcome to the mother and child
Plan for Data Acquisition
Data Collection Method: Records and surveys from health facilities, HMB and SMOH
Data Source: Health facilities, HMB and SMOH
Frequency and Timing of Data Acquisition: Annually
Estimated Cost of Data Acquisition: Cost included in the contract with implementing partners.
Individual Responsible: Program Manager
Location of Data Storage: LGA and SMOH
Data Quality Issues
Known Data Limitations and Significance: Not Applicable
Actions Taken or Planned to Address this Limitation: Not Applicable
Internal Data Quality Assessments: Not Applicable
Plan for Data Analysis, Review & Reporting
Data Analysis: Not Applicable
Presentation of Data: Not Applicable
Review of Data: Not Applicable
Reporting of Data: Not Applicable
Baselines: -
Year Target Actual Cumulative Net Change Notes
2013 10% 15% -
2014 20% 30%
Performance Indicator Values
Year Target Actual Notes
This Sheet Last Updated On:
September 2011
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 22 of 27
5. Evaluation Plan
6.
Evaluation study designObjective Indicator Source of
informationCollection method
Target group
1. To determine the proportion of pregnant women delivered by skilled birth attendants in Zamfara by 2016
% of women delivered by skilled birth attendants
Communitysurvey,Facility survey
survey, questionnaire,focus group discussion,And facility records
Relevant officials of SMOH and LGA
1. Normative evaluation2. Evaluation study design- pre and post intervention
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 23 of 27
Data Quality Plan
As part of the construction of the indictor information sheets you will have noted some data
quality issues. You need to construct a data quality plan, which clearly identifies for the
project as a whole how you intend to manage your data quality risks.
1. Why do I need a Data Quality Plan?
It is essential that any data that is being collected and reported be of the best possible
quality. This is due to decisions, related to the effectiveness and efficiency of any project,
being based on the data collected during monitoring and evaluation. In order to ensure
data quality and to avoid unnecessary and costly data repairs a Data Quality Plan (DQP) is
constructed in support of the Monitoring and Evaluation Plan (MEP) and in line with the
Indicator Information Sheets (IIS). The DQP forms the basis for ensuring that the five
critical elements of data quality, namely: validity, reliability, timeliness, precision and
integrity, are given due regard during the planning for monitoring and evaluation and
activity rollout. The DQP is an essential record of how the project managed its data
quality issues and as such is an excellent source of information for the Auditor during a
Data Quality Audit (DQA).
2. What is the significance of the ‘Items’ in column A?
The items listed in column A are broadly related to the Indictor Information Sheets but
contextualised to address specific data quality issues that must be considered at
operational level when planning the monitoring and evaluation activities.
3. What ‘Explanations’ are required in column B?
This is where the implementing partner explains how the requirements for data quality are
realised operationally. For example: data quality, in terms of validity, is always dependent
on the partner having a specific definition for the indicator they are reporting on.
Although the indicator has a definition in the IIS it is important for the partner to explain
the definition in terms of their program and hence what data is included or excluded
during data collection in order for them to prove validity.
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 24 of 27
4. What is meant by ‘Source / Records’ in column C?
All implementing partners must be able to prove, during a DQA, that they have a data
quality management system, which enables them to report data that is accurate, valid and
reliable. In order to save the implementing partner and the auditor time it is always a
good idea to list the ready sources of evidence / records which would demonstrate the
information given in the DQP. This could be a list of document types, or record numbers,
or references to academic works, or even a reference to a filing location etc.
5. How and why do I do a ‘Risk Type’ analysis as required in column D?
All data has an associated quality risk and sometimes the cost of managing the risk
outweighs the additional benefit to be gained from improving the data quality. The use of
a risk matrix enables the implementing partner to establish those elements within the data
management system, which pose the greatest data quality risk so that the appropriate
controls can be put in place to minimise the impact of a risk being realised in practice.
Use the matrix given below to establish the data risk. Identify the probable frequency
with which an error in the data could arise and assign the appropriate value. Identify how
serious the error would be in terms of the overall effect on the quality of the data and
assign an appropriate value. Multiply the two values together to get the risk score.
Review the score against the risk analysis table below and take the appropriate actions.
Risk Matrix
Overall Effect on
Data Quality
Probability of Error Occurring
(4) - Constantly (3) - Frequently (2) - Occasionally (1) - Unlikely
(4) - Catastrophic 16 12 8 4
(3) – Critical 12 9 6 3
(2) - Marginal 8 6 4 2
(1) - Negligible 4 3 2 1
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 25 of 27
Risk Analysis Table
Risk Score Risk Type Remedial Action
9 – 16 High Risk Establish contingency plan to reduce risk, verify and validate prior to each reporting episode, maintain strict audit trail.
4 – 8 Medium Risk Establish contingency plan to reduce risk, verify and validate prior to annual return,
maintain strict audit trail.
1 – 3 Low Risk No immediate action required; risk could be managed through normal internal audit processes.
6. Where can I get more information to help me understand Data Quality?
ADS Chapter 203 – Assessing and Learning [http://www.usaid.gov/pubs/ads/200/]
TIPS 12: Guidelines for Indicator and Data Quality [http://www.dec.org/usaid eval/#004]
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 26 of 27
Data Quality Plan Table XX of XX
A. ITEM B. EXPLANATION C. SOURCE /
RECORDS
D. RISK
TYPE
1. Desired Outcome
Indicator:
2. Measure of Validity
Unit of measure:
Operational
definition:
Definitional
inclusions:
Definitional
exclusions:
Definitional bias:
Desegregations:
Operational
justification:
Source of data:
3. Measure of Reliability
Collection
methodology:
Collection
instrumentation:
Sampling
frameworks:
Collection personnel:
Collection bias:
Analysis
methodology:
Arithmetic
manipulations:
4. Measure of Timeliness
Frequency of
collection:
Reporting frequency:
Collection: Collation:
Reporting time lags:
MCH group M&E Work Plan © Haihuwa Lafiya Foundation, 2011 Page 27 of 27
A. ITEM B. EXPLANATION C. SOURCE /
RECORDS
D. RISK
TYPE
5. Measure of Precision
Source error:
Instrument error:
Sampling error:
Transcription errors:
Manipulation errors:
Total margin of
error:
6. Measure of Integrity
Cost of collection:
Source integrity:
Collector integrity:
Anti-tampering
controls:
Data cleaning:
Hard copy storage:
Electronic storage:
Internal audit:
External audit: