UNSD Census Workshop Day 2 - Session 9 Data Capture: Process Stages

UNSD Census WorkshopDay 2 - Session 9

Data Capture: Process Stages

Andy Tye – International Manager

DRS are Worldwide specialists in data capture from paper

Data Capture

Pre-Census Planning – Pre-Pilot Timeline (Census July 2010)

Data Capture

Pre-Census Planning – Post-Pilot Timeline (Census July 2010)

Data Capture

Pre-Census Planning – Forms Design - Sudan

Data Capture

Pre-Census Planning – Enumerator Training Ethiopia

Data Capture

Enumeration during the Census

Data Capture

Census Processing Stages

• Forms Receiving• Scanning Process• Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality

Data Capture

Census Processing Stages

• Forms Receiving• Scanning Process• Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality

Data Capture – Process Stages

Forms Receiving

• Batch processing• EA Control forms• Opening• Sifting• Cutting• Prepare to scan

Data Capture – Process Stages

Forms Receiving

• Batch processing• EA Control forms (Sudan Example)• Opening• Sifting• Cutting• Prepare to scan

Data Capture – Process Stages

EA Control forms - Sudan

• 2 Parts– Supervisor– Enumerator

• Unique Barcode

EA Control forms - Sudan

Data Capture – Process Stages

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process• Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process• Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality

Data Capture – Process Stages

Scanning Process

• Speed

– Form condition– Scanner condition– Size & Type of image– Real-time validation rules– Sorting– Doubles separation & detection– Operator training– Paper Crashes– Environment

Data Capture – Process Stages

Scanning Process

• Skew

– Form condition– Scanner condition– Operator training– Cut of Form

Data Capture – Process Stages

Scanning Process

• Double Sheets

– Sifting– Scanner separator condition– Operator training

– Detection via scanners sensors• Ultra Sonic• Capacitive

Data Capture – Process Stages

Scanning Process

• Other

– Duty Cycle– Servicing and Cleaning– Batch Control– Audit/Tracking Process– Physical space

Data Capture – Process Stages

Scanning Process - Ethiopia

Data Capture – Process Stages

Scanning Process

Show Scanner Video

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality

Data Capture – Process Stages

Recognition Process – For Hand Written Characters

• Feature recognition– Length– Nodes– Angles

Data Capture – Process Stages

Recognition Process – For Hand Written Characters

• Feature recognition– Length– Nodes– Angles

• Neural Networks– Resize– Converted to Pixels– Template set comparatives

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process• Quality Process• Logistic issues• Time V Quality

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process• Quality Process• Logistic issues• Time V Quality

Data Capture – Process Stages

Verification Process

Data Capture – Process Stages

Verification Process

Data Capture – Process Stages

Verification Process – Sudan & Malawi

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Managment Process• Logistic issues• Time V Quality

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process• Logistic issues• Time V Quality

Data Capture – Process Stages

Quality Process

• Starts Pre-Census• Audit Trail• Unique Barcodes• System Reports• Defined Roles

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues• Time V Quality

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues• Time V Quality

Data Capture – Process Stages

Logistic Issues

• Distribution (EA Packs and Forms)– Space– Man power– Security– Loading and moving equipment

• Receiving & Processing– Space

• Storage• Processing

– Security– Fire and emergency procedures

Data Capture – Process Stages

Logistic Issues - Tanzania

Data Capture – Process Stages

Logistic Issues – 0.5 Million Forms

Data Capture – Process Stages

Logistic Issues – 0.5 Million Forms

Data Capture – Process Stages

Logistic Issues – Lifting equipment

Data Capture – Process Stages

Logistic Issues – 10 Million Forms (6,000 Sqft)

Data Capture – Process Stages

Logistic Issues – Forms Storage in Sudan

Data Capture – Process Stages

Logistic Issues – Fire Risk

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues • Time V Quality

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues • Time V Quality

Data Capture – Process Stages

Time V Quality

‘From experience DRS has identified that the largest issue for Time and Quality is how well the Census forms are filled out by the Enumerators’

Data Capture

Census Processing Stages

• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues • Time V Quality

Data Capture – Process Stages

Summary

• Significant Pre-census Preparation (2 Years)• Forms design – Critical path• Staffing• Data Capture systems

– used in a variety of business sectors• Verification of Data – Business rules• Security and Backup plans

Worldwide specialists in data capture from paper