Using SMS-Gateways for Monitoring Progress and Quality of Data Collection: Lessons Learned from the 2010 Population Census of Indonesia Thoman Pardosi.

Using SMS-Gateways for Monitoring Progress and Quality

of Data Collection: Lessons Learned from the 2010

Population Census of IndonesiaThoman Pardosi – Statistics

Indonesia

Presentation Outline• Background: - The 2010 Indonesia’s Census: Milestones of the Census

and the Census Field Organization • Monitoring progress of the census listing

– Listing activity as a crucial part of a census– Using SMS-gateway to monitor the progress of the census

listing• Monitoring quality of the Census Data

– Individual long form – Monitoring activity :

• Standard procedure in data collection• Reliability of the results

Milestones of the Census

• Mapping Census Enumeration Areas (EA) or cluster: 2008 – 2009

• Recruitment and training filed workers: Jan-April 2010

• Data collection: May 2010 (Extended to June to ensure the census coverage)– Household (HH) listing and counting HH members by

sex: Using EA maps and listing instrument (L1). – Enumeration and 100% interview of HH member:

Using a questionnaire with 40 questions (C1).

Additional Information about Indonesia

• 33 provinces• 497 districts• 6 747 sub districts• 78 198 vilages• 237 641 326 population (2010 census)• 61 157 592 households (2010 census)• 16 000 islands• 2.000.000 km2• 126 peopels / km2

Field Organization of the Census

122.200 Teams

360.000 enumerators

Working in 721.000 clusters

497 districs

6 747 sub districts

Sending the census data for monitoring

• Summary of the census results were sent by field coordinator via SMS-gateway system to the census call center established at BPS headquarter in Jakarta.

• The contents of the summary results:– EA identity, – number of male, and – number of female

Processes of data dissemination • The census call center was designed mainly to

receive the census results sent by field coordinators via SMS-gateway system and to tabulate them automatically.

• The SMS-based tabulation was disaggregated by EA, village, sub district, district, province, and total at national level.

• Using a website, the census officers at every management level (from district to national level) were entitled to access the table using their own user name and password.

Utilization and drawback of the SMS-based results

• The summary of the census results sent via SMS-Gateway were utilized mainly to monitor the progress of data collection and to serve as an early warning system for mitigation possible problems in the census coverage.

• The census results provided by SMS-gateway system were also utilized for comparison with the results provided by other systems (which were also developed during the census).

• Nonetheless, due to possible typing errors (in writing SMS), the results of SMS-gateway system were used only for internal BPS, not for public.

Quality Monitoring

• Quality assurance focused on listing, procedures, and characteristic of individual.

• The listing quality monitoring is to improve the coverage.

• The procedure monitoring is to minimize non sampling error and also improve the coverage.

• The monitoring of individual characteristic is to improve the validity of individual and housing data.

Organization Q.M.

• For data quality monitoring we recruited 1676 person : 136 person as coordinators and 1540 person as enumerators.

• About 1.200 person of enumerators were the student of Statistical Colleagues. They were trained by 50 trainers. Their 2 days training program covering: all fields operation and how to use field instruments.

Data Collection

Copy Data

• Then they copied the answer from original questionnaires, so both of them can be compared, and then it is sent to a gateway system.

• They do not need to judge the result which is wrong or right, but just send it.

• The system will immediately create tables of differences and disseminate tables and graphics. Red color in graphics indicates high differences.

Access to Website

• Website can be accessed by supervisor or management who are already registered. (http://kualitassp2010.bps.go.id).

• This internet monitoring is designed to help management in all levels to see the rechecked result as soon as possible.

• It is important for the management level to instruct the team to correct the same errors in all clusters.

Data Content fo Monitoring

KOTAK PESAN SMS

m 1 <spasi>

provKab/kota Kec

Desa/Kelurahan

Nomor Blok Sensus

<spasi>

1

<spasi>

2

<spasi>

4a

<spasi> <spasi>

3 4b

<spasi>

5

<spasi>

6

<spasi> <spasi>

7 8

<spasi>

9a

<spasi>

10a 10b

<spasi>

11

#

Data Format in SMS

The Question on Coverage and Procedure

• Border of cluster’s map is clear or not?• Is listing start from east or west side?• Is listing process done part by part of sub

cluster (if any)?• How many census building that is no

sticker and how many all census building in the cluster?

The Question …

• Is the number of stickers match with forms (questionnaire): all, or majority (>= 75%), or not majority (<75%)?

• Is the crosscheck done?• Is interview with long form done after finishing

listing?• Are you trained? If yes, for how long?• When do you scan the cluster?• Before you do listing, did your team take meeting

first?

The objectives

• To maximize coverage of buildings and households, by checking the samples.

• To make sure that listing applied based on the rule.

• To correct content error of some characteristic on individuals and housing information.

• Give speed information by SMS-Gateway to the officers in the district level about error indications and ask them to do checking in all clusters.

KAMSAHAMNIDA 감사합니다Thank You