TIPS FOR SURVEY DATA ANALYSIS
description
Transcript of TIPS FOR SURVEY DATA ANALYSIS
![Page 1: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/1.jpg)
TIPS FOR SURVEY DATA ANALYSIS
Presented By:Dr. Michael Kaylen
University of Missouri
![Page 2: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/2.jpg)
INTRODUCTION
• SURVEY DATA ANALYSIS INVOLVES TRANSFORMING SURVEY DATA INTO INFORMATION.
DATA INFORMATION
![Page 3: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/3.jpg)
DATA
![Page 4: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/4.jpg)
INFORMATIONNUMBER OF TRAVELERS IN MO
BY STATE OF ORIGIN AND MONTH.
MONTH_1 MONTH_2 MONTH_3 TOTAL
MO 1,411,300 1,408,444 663,828 3,483,571IL 498,092 369,995 95,497 963,584KS 261,961 331,999 104,022 697,982AR 148,049 85,801 80,671 314,521CA 181,330 42,411 75,195 298,936OK 162,171 75,132 42,820 280,123TX 60,200 107,057 74,255 241,511OTHER 726,492 739,200 500,286 1,965,978TOTAL 3,449,595 3,160,039 1,636,573 8,246,206
![Page 5: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/5.jpg)
INTRODUCTION• DATA INFORMATION• TIPS FOCUS ON
EXCEL PIVOT TABLESWEIGHTED DATA
• APPLICATION TO HOUSEHOLD PANEL DATA
![Page 6: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/6.jpg)
• MONTHLY SURVEYS OF HOUSEHOLDS
• 3 LEVELS OF DATAHOUSEHOLD (DEMOGRAPHICS)TRIP (# TRAVELING, STATES VISITED, ETC.)
STATE (# NIGHTS BY LODGING TYPE, EXPENDITURES, ETC.)
• SIMULATED DATA
HOUSEHOLD PANEL DATA
![Page 7: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/7.jpg)
HOUSEHOLD PANEL DATA• HOUSEHOLD LEVEL DATA (HOUSE! - 54,824 OBSERVATIONS) HOUSEHOLD ID MONTH # TRIPS ORIGIN STATE HOUSEHOLD INCOME RANGE TWO WEIGHTS
![Page 8: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/8.jpg)
HOUSEHOLD PANEL DATA• HOUSEHOLD LEVEL DATA• TRIP LEVEL DATA (TRIP! - 21,144
OBSERVATIONS) HOUSEHOLD LEVEL DATA # HOUSEHOLD MEMBERS ON TRIP PRIMARY TRIP PURPOSE PRIMARY TRANSPORTATION MODE (0/1) CODE FOR EACH STATE THREE WEIGHTS
![Page 9: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/9.jpg)
HOUSEHOLD PANEL DATA• HOUSEHOLD LEVEL DATA• TRIP LEVEL DATA• STATE LEVEL DATA (STATE! - 23,225
OBSERVATIONS) HOUSEHOLD AND TRIP LEVEL DATA DETAILED STATE # NIGHTS BY LODGING TYPE EXPENDITURES BY CATEGORY (0/1) CODE FOR ACTIVITIES THREE WEIGHTS
![Page 10: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/10.jpg)
EXCEL PIVOT TABLESANALYZE DATA USING 3 OPERATIONS:1.GROUP DATA INTO CATEGORIES• EX. - CREATE A PIVOTTABLE
![Page 11: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/11.jpg)
PUT CURSOR ANYWHERE IN DATA TABLE, WORKSHEET HOUSE.
CLICK ON INSERT TAB
![Page 12: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/12.jpg)
CLICK ON PIVOT TABLE ICON
![Page 13: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/13.jpg)
CLICK OK
![Page 14: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/14.jpg)
To Group: Drag Fields toRow/Column Labels
![Page 15: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/15.jpg)
![Page 16: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/16.jpg)
Cross-tab using both Rowand Column Labels
![Page 17: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/17.jpg)
![Page 18: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/18.jpg)
EXCEL PIVOT TABLESANALYZE DATA USING 3 OPERATIONS:1. GROUP DATA INTO CATEGORIES2. SUMMARIZE DATA USINGCALCULATIONS• COUNT, SUM, AVERAGE, MAXIMUM, MINIMUM, STANDARD DEVIATION
• EX.- LOOK AT NUMBER OF HOUSEHOLDS IN SAMPLE, BY STATE OF ORIGIN AND MONTH.
![Page 19: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/19.jpg)
![Page 20: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/20.jpg)
Change the type of calculation by clicking on the drop-down menu
![Page 21: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/21.jpg)
CLICK ON “VALUE FIELD SETTINGS”
![Page 22: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/22.jpg)
Click on Count, then OK
![Page 23: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/23.jpg)
![Page 24: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/24.jpg)
EXCEL PIVOT TABLESANALYZE DATA USING 3 OPERATIONS:1. GROUP DATA INTO CATEGORIES
2. SUMMARIZE DATA USINGCALCULATIONS
3. FILTER RESULTSCAN BE USED TO VIEW A
SUBSET OF RESULTS
![Page 25: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/25.jpg)
WEIGHTED DATA•WEIGHTS ARE USED TO PROJECT SAMPLE DATA TO A POPULATION
EX. – A HOUSEHOLD WEIGHT OF 10,000 MEANS THAT PARTICULAR HOUSEHOLD “REPRESENTS” 10,000 HOUSEHOLDS IN THE POPULATION
![Page 26: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/26.jpg)
WEIGHTED DATA•THE DESIGN WEIGHT OF A SAMPLE ELEMENT IS THE INVERSE OF ITS INCLUSION PROBABILITY
EX. – IF 20,000 HOUSEHOLDS ARE CHOSEN FROM A SIMPLE RANDOM SAMPLING DESIGN FROM 100,000,000 HOUSEHOLDS, THE DESIGN WEIGHT IS 100,000,000/20,000 = 5,000
![Page 27: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/27.jpg)
WEIGHTED DATA•CALIBRATION WEIGHTS - COMPUTED USING DATA ON AUXILIARY VARIABLES (E.G., DEMOGRAPHICS)
•“BALANCE” SAMPLE DATA.
EX. – IF STUDYING TRAVEL TO MO AND SAMPLE UNDER-REPRESENTS NEIGHBORING STATES.
![Page 28: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/28.jpg)
WEIGHTED DATACALCULATIONS WITH WEIGHTS
n
iiiXwX
1
Ex. – To estimate the total number of household trips, create a new variable:
WT_HH * HH_Trips
• To estimate population totals:
![Page 29: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/29.jpg)
![Page 30: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/30.jpg)
PivotTable: Estimated Number of Household Trips, by Month
![Page 31: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/31.jpg)
WEIGHTED DATACALCULATIONS WITH WEIGHTS
n
iiiXwX
1
• To estimate population averages:
• To estimate population totals:
n
ii
n
iii
w
XwX
1
1
![Page 32: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/32.jpg)
PivotTable: Including Sum of Household Weights, by Month
![Page 33: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/33.jpg)
Calculation of Avg. Number of Trips per Household
![Page 34: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/34.jpg)
POTPOURRI
• Monitor sum of weights over all observations, by strata.- Weight totals should reflect population numbers.
• Monitor number of observations, by strata (e.g., month, state).- Sample size is critical to accuracy.
![Page 35: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/35.jpg)
POTPOURRI
Ex. 1 – Sampled Households, but interested in Household Trips (e.g., What percent of all household trips included travel in MO?).
• Be careful projecting to other than the sample design population.
![Page 36: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/36.jpg)
POTPOURRI
- TRIP! contains detailed data on trips, each row (observation) corresponding to one trip.
- Already used data in HOUSE! to estimate 138,511,079 household trips taken during 3 months.
- Problem: household weights over all trips in TRIP! sum to only 124,116,209
![Page 37: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/37.jpg)
POTPOURRI
Sampled households could only provide details for up to 3 trips, regardless of the number of trips actually taken.
Why the discrepancy?
Solution: create a new weight
3,3*_
3,_
TripsifTripsHHWTTripsifHHWT
WT_HHTrip =
![Page 38: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/38.jpg)
Calculation of WT_HHTrip
![Page 39: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/39.jpg)
PivotTable showing Sum of WT_HHTrip, grouped by TR_VisitMO
About 2.9% of all HH trips included MO.
![Page 40: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/40.jpg)
POTPOURRI
Ex. 1 – Sampled Households, but interested in Household Trips.
• Be careful projecting to other than the sample design population.
Ex. 2 – Sampled Households, but interested in Travelers (e.g., What percent of all travelers visited MO?).
![Page 41: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/41.jpg)
POTPOURRI- The original data set contains two numbers of potential interest for each detailed trip: the number of people in the travel party and the number of household members in the travel party.- Problem: which numbers to use?
![Page 42: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/42.jpg)
POTPOURRISolution: Since the sampling design was based on households, not travel parties, use the number of household members in the travel party.
WT_PersTrip = WT_HHTrip * TR_HHMemTot
![Page 43: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/43.jpg)
PivotTable showing Sum of WT_PersTrip, grouped by TR_VisitMO
About 2.9% of all travelers visited MO.
![Page 44: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/44.jpg)
Thank You!
Questions, Comments?
![Page 45: TIPS FOR SURVEY DATA ANALYSIS](https://reader035.fdocuments.net/reader035/viewer/2022062315/568161b9550346895dd18bac/html5/thumbnails/45.jpg)