Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE...

22
Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY THE INFORMATION ECONOMY Unctad Manual Chapter 7

Transcript of Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE...

Page 1: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B-3Designing and ICT Business Survey

TRAINING COURSE ON THE TRAINING COURSE ON THE PRODUCTION OF STATISTICS PRODUCTION OF STATISTICS

ON THE INFORMATION ON THE INFORMATION ECONOMYECONOMY

Unctad ManualChapter 7

Page 2: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

2

After completing this module you will be able to: • Design a survey on ICT use in business (sample design)• Build a questionnaire using internationally agreed

indicators• Decide on interviewing method• Define outcome indicators

ObjectiveObjectivess

Contents of this moduleContents of this module

• B3.1. Survey design• Coverage, target population, statistical units• Use of statistical frames• Stratification criteria• Sample size and sample selection methods

• B3.2. Model questions and questionnaires• Questions for a module on ICT • Questionnaires for stand-alone surveys

Page 3: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

3

Coverage, target population and statistical Coverage, target population and statistical unitsunits

• As with other business surveys, the scope and target population of the ICT use surveys are defined in terms of:1. Industry (economic activity)2. Business size 3. Geographical location (sometimes)

B3.1. Survey design

Remember: • The target population is the group of statistical units

that are of interest• The scope is the conceptual definition of the target

population, the set of attributes that seize the target population

Page 69Page 69

Page 4: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

4

Industry scopeIndustry scope

The Partnership recommends:• The core industries:

The OECD core industries (ISIC Rev 3.1 D, F, G, H, I, K)

• The non core industries: ISIC rev 3.1 section J and division 92.

• In developing economies:• The scope of ICT business surveys may deviate from

the OECD recommendation to better suit country requirements.

• Partnership also encourages a broader scope, beyond OECD core and non-core industries.

B3.1. Survey design

Page 70Page 70

Page 5: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

5

Business sizeBusiness size

• A common scope criterion is business size based on number of employees.

• Partnership recommends a minimum size scope of 10 or more employees for international comparability.

• Some developing economies may decide to include microenterprises (<10 employees) if they represent a large share of the in-scope population.

B3.1. Survey design

Page 71Page 71

Page 6: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

6

Geographical locationGeographical location

• The geographic scope of the business sector (and its parts) should in principle include the entire territory of the country.

• Include both urban and rural areas. • It is necessary to establish a definition or

urban/rural at country level. No international harmonized definition exist yet.

B3.1. Survey design Page 77Page 77

Page 7: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

7

Statistical unitsStatistical units

• The Partnership recommends the “enterprise” as the statistical unit.

• It is the most common.

• The SNA93 concept of enterprise:• “An institutional unit in its capacity as a producer

of goods and services” • With autonomy in decision-making • One or more legal units involved in one or more

activities at one or more locations• A corporation or an unincorporated enterprise.

B3.1. Survey designPage 75Page 75

Page 8: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

8

Use of population statistical framesUse of population statistical frames

• Business registers should be improved through the coordination with other sources

• General administrative registers: taxes, registrations, licenses, social security, etc.

• Specific registers: licenses for operating telecommunications businesses

• Statistical databases: updated from economic censuses.

B3.1. Survey design

Page 9: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

9

If no business register is availableIf no business register is available

• Population frames can be obtained from other sources• Lists of live units in economic censuses

• External directorieso Commercial telephone listingso Industry association lists

• The frame should be checked in terms of coverageo Comparison with external sourceso Adjusting of the estimates (reweighting)

• If the population frame lacks information on industry or sizeo The survey should include questions to classify the

respondent unit

B3.1. Survey design

Page 10: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

10

Sample DesignSample Design

• Sample selection should be made using probabilistic techniques

• This guarantees that the sample is truly representative of the population

• Only probabilistic (random) sampling allows calculation of estimates of the sampling error

• The design of a random sample should consider:

• The structure of the population of businesses (its stratification),

• The cost of collecting data and,

• The maximum acceptable statistical error associated with estimates.

B3.1. Survey design

Page 11: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

11

Stratification criteriaStratification criteria

• Optimal stratification for ICT use business surveys• Basic stratification variables

o Industry ando Size of business

• Additional stratification variableo Geographical location of the business

B3.1. Survey design

Page Page 7777

Page 12: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

12

Sample sizeSample size

Methods for deriving the sample size and design:

• Bottom-up procedure

• Use of estimates of sampling error and auxiliary information

• Setting the required precision (CV); no international recommendations

• Eurostat recommendations (page 78, number 208)• Adjusting of total sample size

• Top-down Procedure

• Calculation of the overall sample size• Available budget and collection unit cost • Allocation of the sample by strata

B3.1. Survey design

Page 13: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

13

Sample Selection MethodsSample Selection Methods

• Simple random samplingSimple random sampling • Random draw of n numbers between 1 and N

• Generation of random numbers• Statistical software• Random numbers tables

B3.1. Survey design

Page 14: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

14

Sample Selection MethodsSample Selection Methods

• Systematic samplingSystematic sampling

• Procedure• Arrangement of units from 1 to N• Obtain:

• - Interval K=N/n• - Starting point t (random number between 1

and K)• Selection of units t+i*k (i=0,1,...,n)

• Advantage: it may improve representativeness of the sample

• Disadvantage: it produces biased estimates (unless the weighting factor is adjusted)

B3.1. Survey design

Page 15: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

15

Topics covered by Sub-module B3.2Topics covered by Sub-module B3.2

• Building a questionnaire using internationally agreed indicators

• Selecting topics to be included in the questionnaire

• Preparing topic-related questions

• Choosing appropriate wording

• Preparing answer patterns

• Deciding on interviewing method

• Defining outcome indicators

B3.2. Model questions and questionnaires

Page 16: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

16

Structure of a ModuleStructure of a Module

B3.2. Model questions and questionnaires

Section A: General information about use of ICT by the enterprise

Use of computers by the enterprise and the persons employed

Use of Local Area Network (LAN)

Use of intranet and extranet

Section B: How the enterprise uses the Internet in its operations

Use of the Internet by the enterprise and its employees

Mode of Internet access

Web presence

Activities carried out over the internet (e-commerce, information, e-banking, e-government, etc.)

Section C: Other business information

Page 59Page 59

Page 17: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

17

Suggested model questionsSuggested model questions

B3.2. Model questions and questionnaires

Code

Indicator Model question and response items

B1 Proportion of businesses using computers

Did your business use computer(s) during <reference period>a?Yes/ No

B2 Proportion of persons employed using computers

What percentage of persons employed in your business routinely used a computer at work during <reference period>?Percentage values (no decimals) from 0% to 100%

B3 Proportion of businesses using the Internet

Did your business use the Internet during <reference period>?Yes/ No

B4 Proportion of persons employed using the Internet

What percentage of persons employed in your business routinely used the Internet at work during <reference period>?Percentage values (no decimals) from 0% to 100%

B5 Proportion of businesses with a web presence

Did your business have a web presence as at <reference date>?Yes/ No

B6 Proportion of businesses with an intranet

Did your business have an intranet as at <reference date>?Yes/ No

Page 18: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

18

Suggested model questions (cont.)Suggested model questions (cont.)

B3.2. Model questions and questionnaires

Code

Indicator Model question and response items

B7 Proportion of businesses receiving orders over the Internet

Did your business receive ordersc for goods or services (that is, make sales) via the Internet during <reference period>?Yes/ No

B8 Proportion of businesses placing orders over the Internet

Did your business place ordersc for goods or services (that is, make purchases) via the Internet during <reference period>?Yes/ No

B9 Proportion of businesses using the Internet by type of access (narrowband, fixed broadband and mobile broadband)

How did your business connect to the Internet during <reference period>? The list of response categories should allow the grouping into narrowband and broadband, and for the latter, into fixed and mobile. Yes/no or tick box for each response category

B10 Proportion of businesses with a local area network (LAN)

Did your business have a local area network (LAN) as at <reference date>?Yes/ No

B11 Proportion of businesses with an extranet

Did your business have an extranet as at <reference date>?Yes/ No

Page 19: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

19

Suggested model questions (cont.)Suggested model questions (cont.)

B3.2. Model questions and questionnaires

Code

IndicatorModel question and response items

B12 Proportion of businesses using the Internet by type of activity

For which of the following activities did your business use the Internet during <reference period>?

Response categories:• Sending or receiving e-mail• Telephoning over the Internet/VoIP or using video conferencing• Use of instant messaging, bulletin boards • Getting information about goods or services• Getting information from general government organizations• Internet banking• Accessing other financial services• Interacting with general government organizations• Providing customer services• Delivering products online• Internal or external recruitment• Staff training Yes/no or tick box for each response category

Page 20: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

20

Structure of a QuestionnaireStructure of a Questionnaire

Section A: General information about ICT use in business

Use of computers by the business and its employees

Use of mobile phones

Use of Local Area Network (LAN)

Use of Intranet and Extranet

IT Security

Section B: How the Business uses internet in its operations

Use of internet by business and its employees

Mode of internet access

Web use

Systems integration (for e-commerce)

Activities carried out over the internet

Barriers to using the internet

Section C: Other information about the business

Main activity

Number of employed persons

Value of turnover and fixed assets

B3.2. Model questions and questionnaires

Page 21: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

21

Model questionnairesModel questionnaires

• The OECD model questionnaire• Suitable for a broad range of industries• Modules can be adapted to any specific sector

• Eurostat model questionnaires• Cover more topics than the OECD model• Rotate topics between years

• UNCTAD model questionnaire• Covers core indicators• Has 3 modules

• A – General Information• B – How the business uses the Internet in its

operations• C – Other information about the business

B3.2. Model questions and questionnairesAnnexes 2 to 4Annexes 2 to 4Pages 125-153Pages 125-153

Page 22: Module B-3 Designing and ICT Business Survey TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Unctad Manual Chapter 7.

Module B3: Designing an ICT business survey

UNCTAD

22

B1.3. Concepts and definitions of ICT indicators

• Coverage, target population, statistical units

• Use of statistical frames• Stratification criteria• Sample size• Sample selection methods• Questions for a module on ICT • Questionnaires for stand-alone surveys

ReviewReviewModule 3 essentialsModule 3 essentials