UNSD Census Workshop Day 2 - Session 9 Data Capture: Process Stages Andy Tye – International Manager DRS are Worldwide specialists in data capture from paper
Jan 06, 2016
UNSD Census WorkshopDay 2 - Session 9
Data Capture: Process Stages
Andy Tye – International Manager
DRS are Worldwide specialists in data capture from paper
Data Capture
Pre-Census Planning – Pre-Pilot Timeline (Census July 2010)
Data Capture
Pre-Census Planning – Post-Pilot Timeline (Census July 2010)
Data Capture
Pre-Census Planning – Forms Design - Sudan
Data Capture
Pre-Census Planning – Enumerator Training Ethiopia
Data Capture
Enumeration during the Census
Data Capture
Census Processing Stages
• Forms Receiving• Scanning Process• Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality
Data Capture
Census Processing Stages
• Forms Receiving• Scanning Process• Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality
Data Capture – Process Stages
Forms Receiving
• Batch processing• EA Control forms• Opening• Sifting• Cutting• Prepare to scan
Data Capture – Process Stages
Forms Receiving
• Batch processing• EA Control forms (Sudan Example)• Opening• Sifting• Cutting• Prepare to scan
Data Capture – Process Stages
EA Control forms - Sudan
• 2 Parts– Supervisor– Enumerator
• Unique Barcode
EA Control forms - Sudan
Data Capture – Process Stages
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process• Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process• Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality
Data Capture – Process Stages
Scanning Process
• Speed
– Form condition– Scanner condition– Size & Type of image– Real-time validation rules– Sorting– Doubles separation & detection– Operator training– Paper Crashes– Environment
Data Capture – Process Stages
Scanning Process
• Skew
– Form condition– Scanner condition– Operator training– Cut of Form
Data Capture – Process Stages
Scanning Process
• Double Sheets
– Sifting– Scanner separator condition– Operator training
– Detection via scanners sensors• Ultra Sonic• Capacitive
Data Capture – Process Stages
Scanning Process
• Other
– Duty Cycle– Servicing and Cleaning– Batch Control– Audit/Tracking Process– Physical space
Data Capture – Process Stages
Scanning Process - Ethiopia
Data Capture – Process Stages
Scanning Process
Show Scanner Video
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process• Verification Process• Quality Process• Logistic issues• Time V Quality
Data Capture – Process Stages
Recognition Process – For Hand Written Characters
• Feature recognition– Length– Nodes– Angles
Data Capture – Process Stages
Recognition Process – For Hand Written Characters
• Feature recognition– Length– Nodes– Angles
• Neural Networks– Resize– Converted to Pixels– Template set comparatives
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process• Quality Process• Logistic issues• Time V Quality
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process• Quality Process• Logistic issues• Time V Quality
Data Capture – Process Stages
Verification Process
Data Capture – Process Stages
Verification Process
Data Capture – Process Stages
Verification Process – Sudan & Malawi
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Managment Process• Logistic issues• Time V Quality
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process• Logistic issues• Time V Quality
Data Capture – Process Stages
Quality Process
• Starts Pre-Census• Audit Trail• Unique Barcodes• System Reports• Defined Roles
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues• Time V Quality
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues• Time V Quality
Data Capture – Process Stages
Logistic Issues
• Distribution (EA Packs and Forms)– Space– Man power– Security– Loading and moving equipment
• Receiving & Processing– Space
• Storage• Processing
– Security– Fire and emergency procedures
Data Capture – Process Stages
Logistic Issues - Tanzania
Data Capture – Process Stages
Logistic Issues – 0.5 Million Forms
Data Capture – Process Stages
Logistic Issues – 0.5 Million Forms
Data Capture – Process Stages
Logistic Issues – Lifting equipment
Data Capture – Process Stages
Logistic Issues – 10 Million Forms (6,000 Sqft)
Data Capture – Process Stages
Logistic Issues – Forms Storage in Sudan
Data Capture – Process Stages
Logistic Issues – Fire Risk
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues • Time V Quality
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues • Time V Quality
Data Capture – Process Stages
Time V Quality
‘From experience DRS has identified that the largest issue for Time and Quality is how well the Census forms are filled out by the Enumerators’
Data Capture
Census Processing Stages
• Forms Receiving • Scanning Process • Recognition Process • Verification Process • Quality/Management Process • Logistic issues • Time V Quality
Data Capture – Process Stages
Summary
• Significant Pre-census Preparation (2 Years)• Forms design – Critical path• Staffing• Data Capture systems
– used in a variety of business sectors• Verification of Data – Business rules• Security and Backup plans
Worldwide specialists in data capture from paper