© Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International...

19
© Beta Systems Software AG 2008 1 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok

Transcript of © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International...

Page 1: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 1

Process Stagesof Census Surveys

Richard J. Lang, International Manager September 2008, Bangkok

Page 2: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 2

Agenda

Scanning

Recognition

Verifying Processes

The solution

Data capture

Census Process internal

Census data flow

Quality assurance

Page 3: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 3

Scanning

Page 4: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 4

Scanning

Simultaneous creation of up to six images

Optical lens > 10 mm, sharpness-depth-area 3 mm

Optical und ultrasonic double feed control

Energy saving / live cycle extending Mode

Consistent jam handling:

no document is lost or double captured due to physical jams

cleanness check program: detects white - and black dirt spots

Page 5: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 5

Scanning Pockets 2 – 12 why:

if the document is scanned skewed or de-skewed

if the very important questions are filled / are readable

(if OMR, OCR, Barcode)

if there are fingerprints on the questionnaire or not

if the Barcode/OCR/OMR numbers (not ICR) numbers

are in the given range

if there are double entries – we check the unique number

if there are (colour) copies used

if there are mismatches in quantity:

Batch header shows 50 and only 40 are scanned

Transport stop can be programmed to clarify the issue

Page 6: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 6

Scanning

Customer: I have a printer and print since long my own questionnaire

…I learnt from the internet that it is just a matter of software …

Before printing we should be consulted

to give best advices, we will test and optimize.

Single side printing or higher scaled paper is necessary

(shine through factor = opacity)

Paper should be white without any spots inside

Discuss different methods before making big investments

Page 7: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 7

Scanning

Batch

EA

EA

Doc

Doc

Sheet

Image

Page

Image Grey

Image B/W

Sheet

Side 1

Side 2

Side

Page

Image color

Page 8: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 8

Analyze the structure of documents for identification

The Path to Recognition

Page 9: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 9

The Path to Recognition

Perform proper clean-up and image

pre-processing

Analyze individual page layout

Dynamically locate fields of interest

Character recognition

(numeric handwriting, voted)

Compile results

Page 10: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 10

Page 11: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 11

Recognition – Image Pre-processing

18

Skeweddocument ...

…after alignment

Page 12: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 12

Recognition: Noise and box removal

Page 13: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 13

Verifying Processes

Unique Number – double Scan check

Double feed check

Check if Copy

Trace of all editing work

Logical checks

Completeness checks

Reports

Page 14: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 14

The Solution: SC80HC + FC Census

Formx

Formx

Batch Header

Batch Header

WorkData

Storage

VSAT

FC Census recognition

Preparation:cut & jogg

PaperArchive

PaperArchive

Data + Images

Editing

ArchiveData

Storage

TAPE

ExportCSPro

Local reports

Page 15: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 15

Data capture

Data Processing Centres in different locations

Peak period 3 shifts, average 1-2 shifts

Local operators trained by our supervisors

Supervisors local

Central support from Lab

Training & documentation realised in advance

Help to design the documents

Page 16: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 16

Census Process internal

Command Command ProcessingProcessing

Form Type Form Type AnalysisAnalysis

Structure Structure AnalysisAnalysis

ICR Result ICR Result AnalysisAnalysis

ICR votingICR voting

ICR 1ICR 1 ICR 2ICR 2

LogicalLogicalResult Result

AnalysisAnalysis

Output Output AssemblyAssembly

EditingEditing

Page 17: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 17

Census data flow

ProcessStation 1

Server

logical Network.

Process flow controlled via process queues.

„outside world“

ProcessStation 2

ProcessStation 3

ProcessStation “n”

Page 18: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 18

Quality assurance

Form design with scanning quality check

Before delivery of paper scanning quality check

Confirm the quantity of forms

Make use of Trial Census experience

Establish checks for essential criteria only

Make day to day checks during the running Census

As soon as possible check the results and verify

Back up / Reporting

National / International Supervisors

Page 19: © Beta Systems Software AG 20081 Process Stages of Census Surveys Richard J. Lang, International Manager September 2008, Bangkok.

© Beta Systems Software AG 2008 19

Thank you!

We are prepared for your Census