3/11/15%

1%

Audits'Based'on'Enumerator'Behavior'to'Collect'Survey'Metadata'

March&5,&2015&Christopher&Robert&Dobility,&Inc.&(SurveyCTO)&

•  Want%to%steadily%lower%the%cost%of%collec6ng%high8quality%data%(as%opposed%to%garbage)%–  Random%audio%audits%–  Speed%limits%

•  Quietly%track%viola6ons%•  Trigger%audio%audits%on%x%

viola6ons%

–  Automated%quality%checks%

Collecting&quality&data&

3/11/15%

2%

•  Want%to%steadily%lower%the%cost%of%collec6ng%high8quality%data%(as%opposed%to%garbage)%–  Random%audio%audits%–  Speed%limits%

•  Quietly%track%viola6ons%•  Trigger%audio%audits%on%x%

viola6ons%

–  Automated%quality%checks%

Collecting&quality&data&

•  Want%to%steadily%lower%the%cost%of%collec6ng%high8quality%data%(as%opposed%to%garbage)%–  Random%audio%audits%–  Speed%limits%

•  Quietly%track%viola6ons%•  Trigger%audio%audits%on%x%

viola6ons%

–  Automated%quality%checks%

Collecting&quality&data&

3/11/15%

3%

•  Want%to%steadily%lower%the%cost%of%collec6ng%high8quality%data%(as%opposed%to%garbage)%–  Random%audio%audits%–  Speed%limits%

•  Quietly%track%viola6ons%•  Trigger%audio%audits%on%x%

viola6ons%

–  Automated%quality%checks%

Collecting&quality&data&

•  Want%to%steadily%lower%the%cost%of%collec6ng%high8quality%data%(as%opposed%to%garbage)%–  Random%audio%audits%–  Speed%limits%

•  Quietly%track%viola6ons%•  Trigger%audio%audits%on%x%

viola6ons%

–  Automated%quality%checks%

Collecting&quality&data&

3/11/15%

4%

•  Want%to%steadily%lower%the%cost%of%collec6ng%high8quality%data%(as%opposed%to%garbage)%–  Random%audio%audits%–  Speed%limits%

•  Quietly%track%viola6ons%•  Trigger%audio%audits%on%x%

viola6ons%

–  Automated%quality%checks%

Collecting&quality&data&

•  Entry%constraints,%field%and%group%relevance%

•  Barcode8scanning,%double8entry,%etc.%

•  Audi6ng%6me%spent%on%ques6ons%

•  Random%and%non8random%audio%audits%

•  Photo%audits%

•  High8frequency%checks%%

•  SurveyCTO:%supports%(and%encourages!)%all%of%these%%

QualityEcontrol&options&

3/11/15%

5%

Online&workflow&

Offline&workflow&

3/11/15%

6%

Turnkey&Services&

How&SurveyCTO&Works&

3/11/15%

7%

•  Host%your%own%server%in%the%cloud%

•  Use%a%cloud8hos6ng%service%

•  Host%your%own%server%in8house%

•  Avoid%a%server%altogether%

•  SurveyCTO:%primarily%a%cloud%service,%but%self8hosted%and%fully8offline%op6ons%available%%

Server&options&

•  Online%WYSIWYG%

•  Offline%WYSIWYG%

•  Offline%XML%

•  Offline%spreadsheet%

•  SurveyCTO:%primarily%offline%spreadsheet,%but%supports%XML,%has%builders,%templates,%samples%%

SurveyEdesign&options&

3/11/15%

8%

•  Survey%design%in%Excel%or%Google%spreadsheets%

Survey&design&paradigm&

The&tricky&bits&

3/11/15%

9%

•  Our%solu6on:%online%and%offline%tools%to%systema6cally%make%common%tasks%easier%

A&hybrid&solution&

•  Our%solu6on:%online%and%offline%tools%to%systema6cally%make%common%tasks%easier%

A&hybrid&solution&

3/11/15%

10%

Just&paste&it&in…&

•  Our%solu6on:%online%and%offline%tools%to%systema6cally%make%common%tasks%easier%

A&hybrid&solution&

3/11/15%

11%

•  Our%solu6on:%online%and%offline%tools%to%systema6cally%make%common%tasks%easier%

A&hybrid&solution&

•  Just%sta6c%details%like%loca6ons,%enumerator%names%and%ID’s,%etc.%

•  Addi6onal%details%about%targeted%households,%perhaps%from%a%prior%baseline%or%lis6ng%survey%

•  Informa6on%about%“cases,”%team%or%individual%assignments%

•  SurveyCTO:%supports%sta6c%pre8loading,%plus%pre8loading%of%any%.csv%data%as%survey%field%defaults,%plus%case%management%%

DataEpreEloading&options&

3/11/15%

12%

•  Our%solu6on:%online%and%offline%tools%to%systema6cally%make%common%tasks%easier%

A&hybrid&solution&

•  Our%solu6on:%online%and%offline%tools%to%systema6cally%make%common%tasks%easier%

A&hybrid&solution&

3/11/15%

13%

•  Our%solu6on:%online%and%offline%tools%to%systema6cally%make%common%tasks%easier%

A&hybrid&solution&

•  Are%great…%–  avoid%reinven6on%of%wheel%–  flexibility%and%interoperability%–  seemingly%can’t%beat%the%cost%(nominally%free)%

•  Are%not%so%great…%–  lack%of%adequate%support%–  oien%designed%by%techies%for%techies%–  oien%require%server%admins,%programmers,%other%technical%

consultants%•  can%turn%out%to%be%extremely%costly%in%prac2ce!%

•  Our%solu6on:%Open%Data%Kit%(ODK)%–%plus%hos6ng,%plus%%hundreds%of%improvements,%plus%help%and%support%

Open&source&technologies&

3/11/15%

14%

•  Ethical%and/or%IRB%requirement:%don’t%have%sensi6ve%respondent%data%vulnerable%on%public%servers%–  Don’t%even%want%a%wide%circle%of%

“authorized”%users%to%have%access%to%data%

•  Our%solu6on:%make%ODK’s%support%for%public/private%key%pairs%easy%to%use,%build%workflow%and%design%product%around%it%

Example:&data&security&