Methods for conducting an on-site visitor questionnaire survey
Conducting the Survey
description
Transcript of Conducting the Survey
![Page 1: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/1.jpg)
Conducting the Survey
1Module 2, Unit 5, Session 6
![Page 2: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/2.jpg)
SESSION OBJECTIVES
• Practice determining sample sizes for all of your target audiences
• Roughly identify where the interviews will take place
• Identify standard practices for training enumerators to implement the survey
• Minimize bias and error during survey implementation
Module 2, Unit 5, Session 6 2
By the end of this session, campaign managers should be able to:
![Page 3: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/3.jpg)
3
![Page 4: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/4.jpg)
Qualitative Research in 4 Steps
1. Conceptualization • Problem you want to solve and scope of research
2. Research Design• Survey Design (completed) | Survey Settings (location)• Survey Sampling | Sample Size
3. Data Collection • Conducting the survey
4. Data Analysis and Reporting• Analyzing results and measure effectiveness of survey
4
![Page 5: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/5.jpg)
1. Conceptualizing your survey
5
![Page 6: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/6.jpg)
Conceptualizing your survey
Conceptualizing includes defining:
• The problem you want to solve
• The scope of your research project
6
Scope:
The scope in survey research is determined by the target population, or the group of people that you want to study with the survey.
![Page 7: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/7.jpg)
7
Considerations When Determining Scope
Who do I survey, what to consider?
• Geography (location and proximity to MPA)• Age range• Gender• Employment• Gender• Socio-economic status
![Page 8: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/8.jpg)
2. Research Design
8
Survey Design (completed) | Survey Settings (location)Survey Sampling | Sample Size
![Page 9: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/9.jpg)
Designing your Survey
• Setting: where do I survey?
• Survey Sampling: who/what group should I survey?
• Sample Size: how many do I survey?
9
![Page 10: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/10.jpg)
Survey Setting: where do I survey? Four Types of Setting: (Millard Brown Market Research, Ltd.)
1. Door-to-Door: best way to guarantee random and representative sample. Restriction: more time and resource required. (consensus data)
2. Other Defined Place: Conduct surveys in multiple places. Most useful in finding larger number of respondents. (business, parks, shopping centers, street corner, markets, other public places)
3. Pre-determined Location: Conduct in very specific locations to target a defined audience and excludes all other. (arriving tourists at airport, fishermen at docks)
4. Central Location Tests: specific location to conduct survey (at the end of workshop or presentation)
10
![Page 11: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/11.jpg)
Module 2, Unit 4, Sub-Unit 1.1 11
Survey Sampling: Who/what group should I survey in population?
![Page 12: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/12.jpg)
12
Designing your Survey: Sampling
![Page 13: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/13.jpg)
Module 2, Unit 4, Sub-Unit 1.1 13
Designing your Survey: Sampling
![Page 14: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/14.jpg)
Designing for your Survey: SamplingMost important and difficult part of survey
• Impossible to interview everyone in your area (at most sites)
•You want to select a “representative” sample
•The best way is though a random sampling procedure
•No magic number to tell you how many people you need to interview
14
![Page 15: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/15.jpg)
Designing your Survey: Randomize Sampling
15
![Page 16: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/16.jpg)
Designing your Survey: Randomize Sampling
16
*Random Sampling: every person in your target population has an equal chance of being selected to be in the sample:
Ways to randomize your sample:(Target Population must first be defined)
1. Simple Random Sample: choosing samples from a single pool of the population (picking from a hat)
2.Stratified Sampling: You would divide this large pool of subjects into several groups (strata) and then randomly select subjects from within each group. The number of subjects selected from each group is fixed by design.
![Page 17: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/17.jpg)
17
Population
Brgy A Purok A1
Purok A2
Brgy BPurok B1
Purok B2
Brgy C Purok C1
Purok C2
Brgy D Purok D1
Purok D2Stratified Sampling: Understanding Strata
Strata (level 1)Strata (level 2)
![Page 18: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/18.jpg)
Selecting your Sample Size• No magic number to get “valid” or “statistical significant” result. • Three Things to Take when Choosing Sample Size:
– Population Size– Confidence Level: tells you how sure you can be you that your
sample is generally representative of the population . – Confidence Interval: reflects your probability of having a sampling
error in your survey.
• General Trends for CL, CI and Sample Size: a) The larger your sample size, the smaller your confidence interval (less likely to make sampling error). b) Confidence level: The larger your sample size, the more sure you can be that their answers truly reflect the population (higher confidence level). c) Standard CL is: 95% or 99% | Standard CI is: 2.5% or 5%
18
![Page 19: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/19.jpg)
19
Target Population Size Confidence Interval
95% Confidence
Level99% Confidence
Level50,000 5 percentage points n = 381 n = 657
3 percentage points n = 1,045 n = 1,7832 percentage points n = 2,291 n = 3,8411 percentage point n = 8,057 n = 12,486
100,000 5 percentage points n = 383 n = 6613 percentage points n = 1,056 n = 1,8152 percentage points n = 2,345 n = 3,9941 percentage point n = 8,763 n = 14,267
250,000 5 percentage points n = 384 n = 6643 percentage points n = 1,063 n = 1,8352 percentage points n = 2,378 n = 4,0921 percentage point n = 9,249 n = 15,062
1,000,000 5 percentage points n = 384 n = 6653 percentage points n = 1,066 n = 1,8462 percentage points n = 2,395 n = 4,1431 percentage point n = 9,513 n = 16,369
![Page 20: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/20.jpg)
EXAMPLE:
20
5
15
25
45
35
0Pre-campaign Post-campaign
K l
evel
%How to know if statistically different?
X X
![Page 21: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/21.jpg)
How do we calculate for sample size?
http://www.surveysystem.com/sscalc.htm
21
![Page 22: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/22.jpg)
• Municipality of Bebeh = population (N) of 2500• Composed of 4 barangays• Sample size (n) = 333
22
Stratified Sampling: Example
Barangays Population size
Percent of Target Area Population
(%)Ideal sample
size
Arman 400 16 53
Bebeh 800 32 107Cathy 1100 44 147Dagsoy 200 8 27
Total 2500 100 334
![Page 23: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/23.jpg)
Quick exercise
• Municipality of Jongoland = population (N) of 700• Composed of 3 barangays• Sample size (n) = 248
23
Barangays Population size
Percent of Target Area Population
(%)Ideal sample size
Arman 150 21.4 (22) 54.6 (55)
Labs 380 54.2 (54) 133.9 (134)Ruby 170 24.3 (24) 59.52 (60)
Total 700 99.9 (100) 248 (actual 249)
![Page 24: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/24.jpg)
Let’s go back to scope: Questions to consider
• Do you want equal representation between men and women?– Implication: know what time/s of day to survey
• What survey setting should I use? (door-to-door, any other defined place, etc.)– Implication: where to specifically find subgroups
of target audience (i.e: fishermen)
24
![Page 25: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/25.jpg)
Experimental Design – using a comparison group
25Module 2, Unit 4, Session 8
Treatment/Intervention/Pride Campaign
![Page 26: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/26.jpg)
Experimental Design
Choosing a Control Group: 1. Similar Demographic and Scope: Must be close enough
to experimental group so that culture, environment, language, and other factors are very similar.
2. Unexposed to Campaign Activity: Far away enough so that people in the control group are unlikely to be exposed to any of the campaign (intervention) activities.
*note for those who read pre-reader: comparison group = control group
26
![Page 27: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/27.jpg)
3. Data CollectionActually conducting the survey
27
![Page 28: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/28.jpg)
Preparing for your Survey: Enumerators• Teachers• University students• Dept. of Statistics personnel• High school students• Lead Agency personnel• NGO volunteers
• Hopefully for free: minimum to keep enumerators engaged (lunch, transportation, small celebration). Money spent on this is money not spent on campaign material and activities only (core funds).
28
![Page 29: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/29.jpg)
Preparing your enumerators• Ideally, 5-6 enumerators• Level off
– Clarify and standardize group understanding of questions and procedure of administering survey (i.e: asking questions, randomizing, time, etc.)
• Pre-test the survey questionnaire to iron out any bugs
• Prepare schedule (date, times, jurisdictions, survey settings)
• Refer to reader for other tips29
![Page 30: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/30.jpg)
Conducting your Survey
• Pleasant personality
• A professional manner
• A good listener
• A trusted person
• Language proficient
• Well presented
• Be mindful of time
• Taking “no” as an answer? – ideal response rate is 80%
• Refer to reader for other tips 30
![Page 31: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/31.jpg)
The Mini-Campaign in Practice and Roadblocks
31
![Page 32: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/32.jpg)
TIME TO BE KAPALMUKS!
BAGA’G NAWONG!
32
![Page 33: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/33.jpg)
• In groups of 4, design one question (single answer).
• Try to randomly interview at least 2 people.
• Compare notes.
33
![Page 34: Conducting the Survey](https://reader036.fdocuments.net/reader036/viewer/2022062520/56815b28550346895dc8e983/html5/thumbnails/34.jpg)
Training and Rules for Interviewers• Be courteous.• Maintain confidentiality of the interview at all times. • Introduce the survey by saying who is running it, its general intentions,
and how the respondent was chosen (usually at random).• Be professional, have all your materials ready and keep to the purpose of
your visit.• Be familiar with the questionnaire so if there are filters and skip patterns,
you know where they lead. • Read each question exactly the same to each respondent.• Speak slowly and clearly so you can be understood.• Don’t mark an answer until the respondent states it.• If a response is incomplete, use a neutral probe, to get the respondent to
fully answer the question.• Before leaving, make sure the questionnaire is completed.• Thank the respondent and leave.
34