Third Party Validation - RSPN

Pakistan’s Citizens’ Damage Compensation

Programme

Third Party Validation

Revised Inception Report

June 01, 2011

Prepared by:

Assessment & Strengthening Program - RSPN

House 70, Street 25, F-10/1, Islamabad

Tele: 92-51-2114312-4

i

Contents

ABBREVIATIONS ..................................................................................................................................... iii

BACKGROUND ......................................................................................................................................... 4

PROJECT OVERVIEW ................................................................................................................................ 8

OBJECTIVES ......................................................................................................................................... 8

ASP-RSPN STRATEGY FOR THE SPOT CHECKS ......................................................................................... 8

METHODOLOGY .................................................................................................................................... 11

SAMPLE DESIGN ................................................................................................................................ 11

QUESTIONNAIRE DESIGN .................................................................................................................. 15

TRAINING .......................................................................................................................................... 15

ENUMERATION ................................................................................................................................. 16

DATABASE DEVELOPMENT AND DATA ENTRY .................................................................................. 18

REPORTING PLAN .............................................................................................................................. 18

MONITORING AND EVALUATION .......................................................................................................... 20

Data Collection M&E ......................................................................................................................... 20

Data Processing M&E ........................................................................................................................ 21

MANAGEMENT PLAN ............................................................................................................................ 22

TEAM MEMBERS ............................................................................................................................... 22

PROPOSED MANAGEMENT PLAN ..................................................................................................... 23

ASP- RSPN Team:............................................................................................................................... 24

LOGISTICS PLAN .................................................................................................................................... 25

Detailed Staff Plan ............................................................................................................................ 26

IDS Head Office Management and other Staff ................................................................................. 27

Hiring and Training of Field Staff ...................................................................................................... 27

ASSUMPTIONS AND APPROVALS .......................................................................................................... 28

WORK PLAN .......................................................................................................................................... 29

WORK PLAN WITH TIME FRAME ....................................................................................................... 31

ii

ANNEX I - QUESTIONNAIRE ................................................................................................................... 38

ANNEX II - DEFINITIONS ........................................................................................................................ 42

ANNEX III - METHODOLOGY FOR ANALYSIS .......................................................................................... 43

ANNEX IV – ASP-RSPN CPO & PPO ORGANOGRAM .............................................................................. 45

iii

ABBREVIATIONS

ASP Assessment and Strengthening Programme

AJK Azad Jammu and Kashmir

CNIC Computerised National Identity Card

CPO Central Program Office

CDCP Citizen Damage Compensation Programme

DCO District Coordination Officer

GB Gilgit-Baltistan

HoF Head of Family

HoH Head of Household

IDS Innovative Development Strategies

KPK Khyber Pakhtunkhwa

KPO Key Punch Operator

MIS Management Information System(s)

NDMA National Disaster Management Authority

NADRA National Database and Registration Authority

PDMAs Provincial Disaster Management Authorities

PaRRSA Provincial Reconstruction & Rehabilitation Settlement Authority

PKR Pakistani Rupees

PPOs Provincial Program Offices

RSPs Rural Support Programmes

RSPN Rural Support Programmes Network

ToT Training of Trainers

UC Union Council

USD US Dollar

USAID United States Agency for International Development

4

BACKGROUND

The recent flood in Pakistan propagated disastrous effects, destroying infrastructure, road

links and houses – affecting over 14 million families and individuals who are in dire need of

support and shelter, as estimated by National Disaster Management Authority (NDMA). It

was further estimated that over 78 districts witnessed devastating results due to the unforseen

catastrophe implicating grave estate, infrastructure and life loss.

The Government of Pakistan consequently initiated the Watan Card Program to aid recovery

from the calamity in all four provinces (Khyber Pakhtunkhwa, Sindh, Punjab,and

Balochistan) and Gilgit-Baltistan and Azad Jammu and Kashmir (AJK). The Council of

Common Interest (CCI)—a constitutional body headed by the Prime Minister with the Chief

Minister of all provinces as well as its member, made an immediate decision to initate a one-

off payment of PKR. 20,000 (approx. USD 233) to the affected families under the Watan

Card Program. The Program was financed jointly by the federal and provincial governments.

The targeting of beneficiaries was carried out by geographic location, i.e. flooded areas, as

well as the identification of affected families by provincial and district teams. Potential

applicants were invited to registration centers at which information was verified. At the

centers, the National Database and Registration Authority (NADRA) would verify their

Computerized National Identity Card (CNIC). In addition, all applicants registered their bio-

metrics (thumbprints and photographs). This information was used to crosscheck with

NADRA‘s central database to secure identity and reject duplications. Those applicants who

presented their CNIC and whose address was confirmed, were declared enrolled subject to

final verification with the NADRA database. Enrolled families received a debit card (Watan

Card) activated within 48 hours after NADRA completed identity checks of these

beneficiaries. This card enabled beneficiaries to receive an unconditional cash grant of

PKR.20,000 that could be withdrawn exclusively by the beneficiary from the designated

payment centres where ATM/POS (Point of Sale) machines were installed.

More than 1.43 million of an estimated 1.64 million families across Pakistan have been given

cash assistance under this first phase of the Watan Card Program.

The Government of Pakistan now plans to extend the program through a second phase named

Citizen Damage Compensation Programme (CDCP), during which further installments of

PKRs 40,000 would be made to flood victims. The second phase will use housing damage as

a proxy indicator for determination of households‘ being affected by the floods. The second

phase of the CDCP is to be financed by the Federal Government and the development

partners (donors).

There are several distinct elements that are different in the two phases of the program:

5

1. Phase I targeted families, Phase II targets households.

2. Phase I selected families based on geographic location (except for KPK) while Phase

II selection criteria are geographic area plus housing damage.

3. Phase I initial list of potential beneficiaries was established by NADRA through its

national database, while Phase II initial list of potential beneficiaries will be

established by the provincial governments, specifically by each Provincial Disaster

Management Authority (PDMA).

4. Phase I grievances for targeting were mostly handled by NADRA, while Phase II

grievances for targeting will mostly be managed by the respective provinces.

Given these differences, the GoP agreed to carry out Third-Party Validation on the initial list

of potential beneficiaries for Phase II to ensure that only those households are included whose

houses were actually damaged. The development partners will support the GoP in conducting

this exercise.

The identification of the households under Phase II is being carried out under the following

two steps:

A. Survey of the Beneficiary Households

The survey to identify the households with damaged houses has been carried out by the

respective provincial governments as per the damage criteria developed by each provincial

government.

The potential beneficiaries of the program will be the ones whose house has been declared

damaged by the respective provincial authorities in the flood affected areas. The provincial

governments conducted door-to-door surveys of damaged houses under their specific criteria.

The lists of beneficiaries were developed based on the survey results. This list will be handed

over to NADRA. NADRA will check for any duplications in the data before handing over for

third party validation.

B. Verification through Spot Checks.

In order to ensure that the houses damage compensation is delivered to eligible and entitled

beneficiaries, a Third-Party Validation named ‗Spot Checks‘ shall be carried out. This will

mean obtaining a representative1 sample of the verified applicants in the affected areas. The

results will be compared with the house damaged assessment performed by each provincial

government. For this purpose, a good understanding of the house damage assessment

definition used in each province is critical. NADRA will provide a detailed list of beneficiary

1 Any size of the population that gives statistically acceptable results at the intended level is called a

representative sample

6

households and damage criteria before the execution of the spot checks. The process to be

followed for each district during the Spot Checks shall be as follows:

a) A district level representative sample will be picked up for validation [Round-1]

in order to categorize the results under the following three categories

1. Results from the district are accepted, if discrepancies2

are ≤ 10%.

2. Results from the districts are rejected, if discrepancies > 30%; therefore

district/provincial government must repeat the identification process of

that specific district.

3. Results from the district are revalidated, if discrepancies are > 10%...and

..≤ 30%. Revalidation process will be carried out as described below

under point b).

b) An additional sample of the flood affected district population will be required

for revalidation [Round 2].

c) Districts with more than 1963 and less than 1,850 potential beneficiaries: a

Round 2 survey will be conducted using a new sample of 50 houses (or less if

there are less than 50 houses not previously sampled).

Districts with more than 1,850 potential beneficiaries: a Round 2 survey will be

conducted using a new sample of 100 houses.. The results will thus be

computed based on an aggregate sample, i.e. first sample/Round-1 plus

revalidation sample/Round-2. There will be two possible outcomes:

1. If discrepancies ≤ 15%, results are accepted.

2. If discrepancies > 15%, district/provincial government must repeat the

identification process of that specific district (house assessment is

redone).

Based on the results of the district reports, disbursement will be made at the ‗District‘

level.This means that validation will be done district by district and the disbursement will not

be held back for a validated district because another district has yet to be validated.

Triangulation by NADRA

The results and the data from the third party validation survey, as required by NADRA, will

be handed over to NADRA by ASP-RSPN. The results and the data provided by ASP-RSPN

will be based on the finalized questionnaire. NADRA will match CNIC numbers with the

data provided by ASP-RSPN and analyse the data to identify percentage discrepancies. In

2 Instances where the potential household beneficiaries identified under CDCP Phase II survey were not verified

to be the legitimate under the spot checks survey. 3 In districts with less than 196 houses no Round 2 spot check is possible (as Round 1 will already have checked

every proposed beneficiary.) Therefore, if data discrepancies ≤ 15%, results are accepted

7

addition the complete list of beneficiaries will also be triangulated by NADRA as per the

procedure mentioned below.

1. Head of household CNIC is unique in NADRA Database.

2. Head of household CNIC is valid in NADRA Database.

3. Head of the household CNIC is clear in NADRA Database, i.e., is not

marked suspicious, alien or fraud.

4. One or two addresses of the head of household indicated in the CNIC

coincide with the affected areas.

8

PROJECT OVERVIEW

The purpose of the third-party validation/Spot Checks is to evaluate the accuracy and validity

of information about the beneficiary households given to NADRA. This mechanism is

intended to compare the beneficiaries list prepared by the province (validated by NADRA)

with the field verification to be done by the USAID funded ASP-RSPN. The ASP-RSPN has

been requested by USAID to conduct the spot check/third party validation for the Citizen

Damage Compensation Program. The Cooperative Agreement signed between USAID and

RSPN envisages an assessment and capacity building Program for the Government of

Pakistan and civil society organization. One of the Program‘s components relates to

assessment of these organizations. The third-party validation/Spot Checks for the CDCP falls

under the assessment component.

OBJECTIVES

The specific objectives of this third-party validation/spot checks are

1. To design the Spot Checks survey activity and produce inception report4 for the

execution of survey.

2. To collect data from the flood affected areas based on district level sample.

3. To report results per district and draft consolidated reports at the district and national

level after completion of district level report.

ASP-RSPN STRATEGY FOR THE SPOT CHECKS

In line with the terms of reference for the spot checks/third party validation, the Assessment

and Strengthening Program (ASP) will ensure to reach out to selected beneficiaries through

door-to-door Spot Checks to verify the beneficiary. The main pillars of the RSPN strategy for

conducting the spot checks are as follows:

Pillar I: The Central Program Office (CPO) of ASP-RSPN will design, manage, supervise

and monitor the whole operation for all flood affected districts. CPO will be the hub of all

administrative and operational activities of Third-Party Validation ―Spot Checks Survey‖.

Monitoring, Evaluation and Research section of CPO will be responsible for overall

completion of the assignment. More specifically, ASP-RSPN will develop detailed guidelines

for the implementation of the survey.

Pillar II: The Provincial Program Offices (PPOs) of ASP-RSPN will supervise and monitor

the survey operation at the provincial level. The PPOs, while working directly under the

4Sampling design, data collection methodology, data analysis, Logistic plan, and monitoring mechanism

9

supervision and guidance of the CPO, will ensure that the devised processes and

methodologies are followed. At the Provincial level, the PPOs have already developed a

liaison with Provincial Disaster Management Authorities (PDMAs) and other stakeholders in

the provincial government for gathering of critical information essential for planning the

third-party validation survey.

Pillar III: The ASP-RSPN has engaged the services of a professional firm ―Innovative

Development Strategies (IDS)‖ to assist ASP-RSPN in the design, data collection and data

entry for the assignment.

Pillar IV: Coordination: ASP-RSPN will coordinate all activities as strategized below:

Level I: The CPO of ASP-RSPN will coordinate and conduct liaison with the USAID,

World Bank, NADRA, the Cabinet Division and other stakeholders at the federal level. The

CPO Management will also have initial strategic dialogue with the key stakeholders

(PDMAs, Chief Secretaries etc.) & Provincial Governments. The CPO will also establish

effective coordination with the IDS for timely execution of the project and getting timely

reports.

Level II: The PPO has already established networking with the key stakeholders of the

CDCP & the provincial governments. The management and the staff of the PPOs will

establish formal communication channels and mechanisms in order to keep on board the

provincial governments and also to get their support for conducting the survey.

Level III: Since all the activities will be conducted at the district level, therefore it is

imperative to have effective and continuous liaison and coordination with the district

administration. The PPO management & staff will hold periodic coordination meetings with

the relevant offices in the district administration. The PPO will also have very close and

continuous coordination and liaison with enumeration teams & districts to supervise and

facilitate their activities.

The ASP-RSPN CPO will provide a list of the focal persons to donors and Government of

Pakistan, with all their contact coordinates. The focal persons will be from the CPO engaged

in coordination and monitoring of the survey enumeration. The list of the focal persons for all

the coordination and monitoring activities from the PPOs will be provided to all the

stakeholders.

In the CPO, the Third-Party Validation team will be led by Mr. Shahzad Arif, Director of

Monitoring, Evaluation and Research. In the PPOs the teams will be led by the respective

Provincial Directors of ASP-RSPN. Names of these officers have been given in the

Management Plan (―Proposed Team‖) on page 21 of this report.

Pillar V: Monitoring and Quality control:

The CPO and PPOs of ASP-RSPN will be rigorously involved in monitoring of all the

activities of the third-party validation and spot check. The monitoring and quality control will

involve the following:

10

1. Trainings: In order to ensure that the quality of training imparted to the personnel of

the third party validation is up to the mark, the CPO and PPO will monitor the entire

training program as follows:

a. The training of trainers (TOT) will be monitored and supervised by the CPO

of ASP-RSPN.

b. The PPOs having capacity building staff will monitor the trainings of the

provincial and district staff for conducting the survey. PPOs will monitor the

schedule, environment and content of the enumerators‘ trainings. A quality

check on the questionnaire will be made during the training phase to make

sure that it is clear and understandable to everyone.

2. Enumeration: the PPO will closely monitor the enumeration activities at the district

level and will also visit the identified areas to carry out surprise checks of the ―Spot

Check‖. The CPO will prepare a template and protocol for conducting these spot

checks, preparing the monitoring reports as well as giving feedback to the

enumeration teams and their supervisors. PPOs will randomly check 5% of the

information collected through questionnaires. However, in cases where sample size is

smaller than 300 households, 10% of the cases will be randomly checked. The

monitoring process will be based on two principles:

a. Proactive

b. Reactive

Proactive monitoring would involve continuous supervision and assessment of the

training program, testing of the questionnaire, certification of enumerators‘

qualification/experience and evaluation of the field staff etc. Monitoring instruments

will be developed to ensure the compliance with standard protocols. Moreover, under

the reactive monitoring principle, if the field monitoring staff identifies either

variation in the actual data or evidence of diversion from the standard protocols by a

specific field staff member, data will be recollected for that staff member.

3. Data entry: The ASP-RSPN CPO will also randomly check at least 5% of data

punched during the data entry operation in order to ensure that all the quality

standards are met.

The ASP-RSPN strategy has also factored in use of the Rural Support Programme (RSP)‘s

outreach staff as members of the RSPN in order to facilitate and support the enumeration

teams in their activities in the flood affected areas. The presence of the RSPs in the flood

affected districts will provide useful support to the enumeration teams. The support will also

be available in the shape of social capital, community organizations, facilitation in logistics

and ensuring quality control. The RSP staff will also help the PPO monitoring teams in

ensuring the quality through their visits. These visits will be carried out as per the daily

location plans. To give an understanding of the ASP-RSPN institutional infrastructure the

ASP-RSPN CPO and PPOs organogram is at Annex II.

11

METHODOLOGY

SAMPLE DESIGN

Given the primary objective of validation of the house damage assessment as completed by

the provincial authorities at the district level and then using these results to guide further

actions, the sample has been designed with a focus to be representative at the district level.

Universe: The universe under study in the present exercise comprises the flood affected

households identified under Phase II spread over the four provinces,5 Gilgit-Baltistan and

AJK. Military restricted areas, if any, will be out of the scope of the survey.

Province-wise Watan Card Processed:

The figures in the above table represent potentially eligible families for phase I of the CDCP.

Phase II of the CDCP will provide benefits on the basis of households, not families. The

number of beneficiary households in phase II may be less than the number of beneficiary

families in phase I because households often contain multiple families.

Once ASP-RSPN receives from NADRA the proposed lists of beneficiary households for

phase II, it will adjust the sample size for each district (shown in Table 2: The Proposed

Sample) in accordance with the sampling strategy explained below and will communicate the

adjusted sample size to all concerned parties.

Sampling Strategy: As detailed in Table 2, the total sample size will be 15,062 for all

districts. A sample size of 196 per district (except for the districts with fewer than 196

households, where the sample would be 100% of the proposed benficiaries) will be enough to

yield a 90% confidence level (attached as annexure). ASP-RSPN‘s analysis confirmed that

this sample size was more than sufficient to yield robust results even considering the likely 2

percent non-response rate. All flood-affected districts will be covered except where affected

population is less than 25 households. Districts with potential beneficiaries less than 25 are

excluded for reasons of cost: it is not worthwhile to undertake the costs entailed for

populations that small.

5 This includes four provinces (Punjab, Sindh, Balochistan and Khyber Pakhtunkhwa).

6 Data on Household head has not been received from NADRA to give total number of affected Households

Province Districts Head of Family (Beneficiaries)6

AJK 10 11,157

Baluchistan 13 120,521

GB 7 3,424

KPK 24 213,099

Punjab 12 729,107

Sindh 17 602,321

Total 83 1,679,629

12

- Selection of Districts: All flood-affected districts with a population of potential

beneficiaries (of the CDCP) greater than 25 will be covered. This results in 797

districts (detailed later) to be covered.

- District Sample Size: The total number of households to be sampled in each District

is shown in Table 2.

- Selection of Union Councils (UC)s): Within each district, all flood-affected UCs will

form the sampling frame for selection. UCs to be enumerated will be selected

randomly. The number of UCs per district will depend upon the size of sample to be

enumerated in each district considering that for reasons of logistical efficiency in the

field work at least 25 households randomly selected from each site will be

enumerated. In the selection of UCs consideration will be given to urban/rural

thick/remote stratification as far as possible. Given the parameter of 25 households

per site, the number of sites in the district will be calculated to yield the total sample

required for that district. Given the 15,062 national sample size, this implies that

approximately 615 sites will need to be selected. 100% of the total proposed

beneficiary households will be enumerated in districts where the number of

households on the list of potential beneficiaries is less than196.

- For all cases where the number of households to be enumerated in a district is less

than 35 only one UC (site) will be enumerated (subject to above mentioned

exclusion).

In case the number of households to be enumerated falls between 35 and 50

the number of UCs (sites) from which households will be enumerated will be

2 (provided there are more than 2 UCs available).

- Selection of Households: As stated earlier, 25 households within each UC will be

selected. Households will be selected randomly from the list of all proposed

beneficiary households in the selected UC.

Details are as follows:

Table 1: Sampling Strategy Summary

Stage Detail Sampling Frame

1: Districts

Flood- affected districts with potential beneficiaries

greater than 25 will be covered. All flood-affected UCs

within these districts will be considered

798 districts

categorized as flood-

affected (with more

than 25 HHs affected)

2: A sample of flood-affected UCs will be selected

randomly from flood-affected districts.

List of flood-affected

households by UCs in

each district to be

7 Though the total number of affected districts is 83, four districts have 25 or less affected households; hence the

coverage will be only in 79 districts. 8 Though the total number of affected districts is 83, four districts have 25 or less affected households; hence the

coverage will be only in 79 districts.

13

provided by NADRA

to yield a total of 615

randomly selected

sites based on

sampling techniques.

Each district would

have 196 households

surveyed, except

those where total

proposed beneficiaries

are less than 196. In

such districts all

identified households

will be covered.

Districts with less than

25 affected households

will not be surveyed.

3:

Houses

25 households will be selected randomly within each of

the selected UCs.

A total of 15,062

households based on

approx.25 households per

selected site

Estimator Precision: ASP-RSPN will report each District sample's discrepancy rate,

indicating in particular whether the rate is less than or equal to 10%, in which case the

District's data will be considered to be valid. The District sample size is sufficient to ensure

that, if the District actually had 15% discrepancies (the limit ultimately permitted for

acceptance), the likelihood of 10% or lower sample discrepancy rate would also be 10% or

less. Thus, there is 90% or higher confidence in any finding of a sample discrepancy rate that

is equal to or under 10%. ASP-RSPN will also report the standard error of each District's

discrepancy rate estimator. Table 2: The Proposed Sample

No. District Province No. of District

s

HOF Beneficiary

Sample size required for 80% power

assuming alpha = 0.1, a 1 tailed test and

comparison statistics of 0.1 and 0.15

the lessor of 196 and the actual number of

HoF beneficiaries (excluding district with

less than 25 HoH

No. of approx.

sites based on

25 HoH/site

1 Bagh AJK 1 2,497 196 196 8

2 Bhimber AJK 1 211 196 196 8

3 Hattian Bala AJK 1 40 196 40 2

4 Haveli (Kahuta) AJK 1 243 196 196 8

5 Kotli AJK 1 395 196 196 8

6 Mirpur AJK 1 206 196 196 8

7 Muzaffarabad AJK 1 4,589 196 196 8

8 Neelum AJK 1 1,114 196 196 8

9 Poonch AJK 1 657 196 196 8

10 Sudhnoti AJK 1 1,205 196 196 8

TOTAL AJK 10 11,157 1,960 1,804 74

11 Barkhan Balochistan 1 1,351 196 196 8

12 Harnai Balochistan 1 76 196 76 3

13 Jaffarabad Balochistan 1 90,541 196 196 8

14 Jhal Magsi Balochistan 1 1,755 196 196 8

14


s

HOF Beneficiary






less than 25 HoH

No. of approx.

sites based on

25 HoH/site

15 Kacchi* Balochistan 1 16 196 - -

16 Killa Saifullah Balochistan 1 257 196 196 8

17 Kohlu Balochistan 1 389 196 196 8

18 Loralai Balochistan 1 653 196 196 8

19 Musakhel Balochistan 1 460 196 196 8

20 Nasirabad Balochistan 1 17,007 196 196 8

21 Sherani Balochistan 1 50 196 50 2

22 Sibbi Balochistan 1 5,994 196 196 8

23 Zhob Balochistan 1 1,972 196 196 8

TOTAL Balochistan 13 120,521 2,548 2,086 85

24 Astore* GB 1 7 196 - -

25 Baltistan GB 1 483 196 196 8

26 Diamir GB 1 1,068 196 196 8

27 Ganche GB 1 205 196 196 8

28 Ghizer GB 1 827 196 196 8

29 Gilgit GB 1 450 196 196 8

30 Hunza Nagar GB 1 384 196 196 8

TOTAL GB 7 3,424 1,372 1,176 48

31 Abottabad KPK 1 1,751 196 196 8

32 Bannu KPK 1 6,639 196 196 8

33 Batagram KPK 1 332 196 196 8

34 Buner KPK 1 990 196 196 8

35 Charsadda KPK 1 20,572 196 196 8

36 Chitral KPK 1 594 196 196 8

37 D.I. Khan KPK 1 61,483 196 196 8

38 Hangu KPK 1 1,629 196 196 8

39 Haripur KPK 1 3,993 196 196 8

40 Karak KPK 1 6,131 196 196 8

41 Kohat KPK 1 2,435 196 196 8

42 Kohistan KPK 1 15,208 196 196 8

43 Lakki Marwat KPK 1 4,597 196 196 8

44 Lower Dir KPK 1 452 196 196 8

45 Malakand P Area KPK 1 442 196 196 8

46 Mansehra KPK 1 2,684 196 196 8

47 Mardan KPK 1 6,015 196 196 8

48 Nowshera KPK 1 32,847 196 196 8

49 Peshawar KPK 1 26,301 196 196 8

50 Shangla KPK 1 5,077 196 196 8

51 Swabi KPK 1 1,007 196 196 8

52 Swat KPK 1 3,888 196 196 8

53 Tank KPK 1 7,187 196 196 8

54 Upper Dir KPK 1 845 196 196 8

TOTAL KPK 24 213,099 4,704 4,704 192

55 Bhakkar Punjab 1 11,805 196 196 8

56 Dera Ghazi Khan Punjab 1 31,414 196 196 8

57 Jhang Punjab 1 14,573 196 196 8

58 Khushab Punjab 1 3,856 196 196 8

59 Leiah Punjab 1 50,425 196 196 8

60 Mianwali Punjab 1 74,931 196 196 8

61 Multan Punjab 1 22,816 196 196 8

62 Muzaffargarh Punjab 1 294,448 196 196 8

63 Narowal* Punjab 1 1 196 - -

64 Rahim Yar Khan Punjab 1 66,813 196 196 8

65 Rajanpur Punjab 1 145,431 196 196 8

66 Sargodha Punjab 1 12,594 196 196 8

TOTAL Punjab 12 729,107 2,352 2,156 88

67 Badin* Sindh 1 15 196 - -

68 Dadu Sindh 1 125,571 196 196 8

69 Ghotki Sindh 1 15,404 196 196 8

70 Hyderabad Sindh 1 1,587 196 196 8

71 Jacobabad Sindh 1 127,157 196 196 8

72 Jamshoro Sindh 1 35,622 196 196 8

15


s

HOF Beneficiary






less than 25 HoH

No. of approx.

sites based on

25 HoH/site

73 Kamabar Shahdad Sindh 1 37,056 196 196 8

74 Kashmore Sindh 1 28,924 196 196 8

75 Khairpur Sindh 1 19,442 196 196 8

76 Larkana Sindh 1 16,637 196 196 8

77 Matiari Sindh 1 2,384 196 196 8

78 Naushero Feroze Sindh 1 16,894 196 196 8

79 Sh. Benazirabad Sindh 1 5,390 196 196 8

80 Shikarpur Sindh 1 76,777 196 196 8

81 Sukkur Sindh 1 12,502 196 196 8

82 Tando M. Khan Sindh 1 631 196 196 8

83 Thatta Sindh 1 80,328 196 196 8

TOTAL Sindh 17 602,321 3,332 3,136 128

TOTAL Pakistan 83 1,679,629 16,268 15,062 615

Notes: (a) Final sample will be based on actual NADRA data of applicants.

(b) Sample size will be 196 houses, except those where the total number of identified affectees are less

than 196 such cases, all identified households would be surveyed.

(c) Number of sites may increase or decrease in those districts where 100% of the affectees households

will be surveyed.

(d) * Districts have a sample size of zero as these have populations of potential beneficiaries less than

25

Sampling for repeat districts

The sample detailed above, and the results derived from it will be used to do a comparative

analysis against results of the provincial authorities‘ damage assessment survey. Based on

this comparative analysis, USAID, under the recommendation from NADRA, may request a

repeat survey of a specific district. In such cases, another set of households will be identified

as per the agreed sample size from the household population.

QUESTIONNAIRE DESIGN

The final questionnaire is attached as Annex I. Each questionnaire will have a unique printed

questionnaire identification code (questionnaire ID) and will also have an enumerator ID.

The enumerator has to observe and verify the damage, as well as collect photographic

evidence. This photographic evidence will be stored in the Management Information System.

Additionally, the enumerator has to verify the damage claim from a village notable (member

of RSPs, Community Organization, headmaster, head imam or a person of similar stature).

TRAINING

While using nationwide network, IDS will hire enumerators from every region. The

enumerators will be selected through a process of quality based selection which includes a

screening and testing process. These enumerators will receive training for the particular

assignment as follows:

16

Training of Trainers workshop will be held at the IDS head office Islamabad for the

Provincial Coordinators and district supervisors. They will in turn impart training to

supervisors and enumerators in their respective provinces and areas (Punjab, Khyber

Pakhtunkhwa, Sindh, Balochistan, Gilgit/Baltistan and AJK).

District Enumerators and field supervisors will receive training on time management,

effective communication skills and field ethics to facilitate effective and smooth data

collection.

Training workshops typically are three days long consisting of classroom training, field

training and a comprehensive review of the field day work to ensure not only further

familiarity with the survey instruments but also to iron out logistic considerations. At the end

of the workshop there will be a comprehensive test conducted to ascertain their level of

performance. In case of a delay of more than 4 weeks in deployment for any reason, one-day

refresher training will be conducted for the field staff.

(Progress: ToT for the provincial coordinators and district supervisors of KPK, GB and AJK

has been completed.)

ENUMERATION

Provincial Coordinators: IDS will appoint experienced individuals with a proven track

record in managing/monitoring large surveys as provincial coordinators. IDS is responsible

for hiring and assigning Provincial Coordinators to specific districts. The Provincial

Coordinators will coordinate the survey in each province9, Gilgit-Baltistan and AJK. The

Coordinator will be in constant contact with the Survey Manager and responsible for ensuring

quality in data collection from the selected districts. They will also conduct and coordinate

the trainings of enumerators and supervisors and oversee the planning, management and

quality control of data collection in their respective provinces.

Field Supervisors: Field supervisors will be responsible for the identification and oversight

of data collection teams as well as for overall planning, management and operations in their

respective districts. The supervisors will also be responsible for making logistic arrangements

in an effective manner.

Enumerators: The spectrum of activities conducted during enumeration is as under

1. District supervisors will allocate areas to enumeration teams. Each team will comprise

one field supervisor, two enumerators and one quality control officer.

2. Field supervisors will conduct a two-day reconnaissance activity prior to beginning of

actual enumeration activities to build rapport with locals and to familiarize themselves

with the areas.

3. Field supervisors will lead enumerators to the site of enumeration each day.

4. Each enumerator will have a list of respondents (with their addresses) for interviews.

9 This includes four provinces (Punjab, Sindh, Baluchistan and Khyber Pakhtunkhwa)

17

a. In case the respondent is not found, another member of his/her household, who

is at least 18 years of age and has a CNIC, will be interviewed.

b. In case no eligible respondent could be found after two revisits, the house will

be taken in the category of ―no response‖, however, the evidence of damage

through photograph and community involvement will be collected.

5. Day‘s activities will begin at 8.00 am every morning and continue till dusk. However,

repeat visits when required will be conducted in the evening to ensure presence of

household head.

6. Each enumerator will fill 10-12 forms a day.

7. Enumerators will carry a GPS device and collect GPS coordinates of houses visited.

8. Enumerators will carry digital cameras to collect photographic evidence of house

damages. Pictures will be stored in cameras with a unique identification code given on

questionnaire.

9. When required, the data collected will be verified from notables of the area (revenue

official, school headmaster, maulvi (cleric), community elders) who will attest the

information provided by the respondent.

10. Chalk/marker markings (name of field supervisor, name of enumerator, date, and

status) will be used to avoid overlap and to facilitate any re-visits.

11. Any questionnaires flagged by Quality Control Teams will be re-visited by the

concerned enumerator the next day in the evening to ensure household head is

present.

12. Enumeration activities will be subjected to robust monitoring specially in the initial

days to help enumerators build good practices at the on-set.

Quality Control Officers - Field: Quality Control Officers will be deployed in districts to

monitor field work and ensure quality of the survey. They will oversee the process of

documenting the number and completeness of questionnaires as they are transmitted from the

field on a given format. They will conduct random spot checks during the conduct of the

survey and note any digressions from the enumeration strategy as well as inform the

Provincial Coordinators on the quality of data collection. Specific details of quality control

activities are as follows:

1. Questionnaires will be checked in the evening of the same day:

a. Field supervisors will check random batches of questionnaires: 20-30 percent

of questionnaires will be reviewed by field supervisors

b. Quality control officers will check each and every questionnaire for omissions

and faults

2. Questionnaires that are found to be incomplete or faulty will be flagged and returned

to the field supervisor to be corrected in the field next evening.

3. Questionnaires that pass the quality checks will be couriered (via TCS) each day

18

a. For Gilgit-Baltistan, where transit time for couriered questionnaires may be

longer, means of electronic transmission may be used (fax or e-mail of

scanned copies)

b. Hard copies will be dispatched nonetheless.

DATABASE DEVELOPMENT AND DATA ENTRY

Database - For previous surveys, data entry programs at IDS have been developed using

SQL. These programs have basic inbuilt checks to ensure that any errors that remain in the

completed questionnaires are flagged.

KPOs - For data entry, KPOs will be hired from IDS‘s existing roster as far as possible, and

KPOs will be given one-day training wherein they receive an overview of the questionnaires

and the database. Practical exercises with dummy questionnaires are conducted, and results

reviewed and discussed.

Data Entry – Data entry will take place at the IDS head office Islamabad10

to ensure close

supervision to ensure quality. As required IDS will aim to complete data entry for a district

two days after data collection is completed in that district. An appropriate number of KPOs

will be hired to achieve this. The IDS will ensure double entry for all questionnaires in order

to ensure that errors are avoided during the data entry process.

Analysis – Details of methods of analysis are contained in Annex III.

REPORTING PLAN

IDS will proceed with data collection after data has been received from NADRA. Therefore

ASP-RSPN plans on starting data collection within ten days of data receiving from NADRA.

(This includes time to draw district samples, train enumerators, and to conduct

reconnaissance of the area). For all those districts for which data has been made available,

ASP-RSPN will run the data collection process simultaneously for all locations. Since the

identification of the eligible household beneficiaries is not complete in all provinces, it is

anticipated that data collection activity may not commence at one time in all the provinces.

ASP-RSPN has the capacity to manage the data collection activity in a phased manner

considering the baseline information (CDCP Phase II survey results) is made available at

different times. ASP-RSPN, with the assistance from IDS, will be completing the assignment

for all those locations for which data is provided by NADRA.

During the implementation phase, IDS will share bi-weekly progress reports and the district

level results reports with ASP-RSPN as soon as the results for the districts are compiled. The

provincial and consolidated reports will be required at a later stage. Progress on the

assignment will be reported to donors through Bi-weekly reports.

10

Given the quality of KPOs available at provincial level and other problems like prolonged power outages,

data security, the best way out is centralized data entry at Islamabad under the direct supervision of Manager

MIS and Survey specialist.

19

IDS shall submit the following deliverables:

1. Finalization of the Inception report having included the Work Plan and draft

questionnaire and submitted as part of the proposal.

2. An initial draft of the questionnaires before testing in the field

3. A memo describing the results of testing the questionnaire and recommendations.

4. Second draft of questionnaires after incorporating feedback from ASP-RSPN and

learning from field testing. Final questionnaire both in Urdu/ local versions and back

translated English version.

5. A data security plan to ensure the confidentiality of information.

6. Draft and final tool for the quantitative assessment through discussions with different

groups of stakeholders and interviews with beneficiaries.

7. An approved training kit along with the electronic and paper copy of different training

manuals used for imparting the training to the enumerators.

8. Basic cross-tabulations.

9. Three copies of the raw and final data sets and analytical reports in SPSS format on

CD-ROM and paper documentation.

10. Bi-Weekly Management Progress Reports in a mutually agreed reporting format

having the UC level details for each target district.

11. Districts‘ Completion Reports for all districts in a mutually agreed reporting format.

12. Submission of the Final Reports (one consolidated, 4 provincial, 1 for AJK, 1 for

Gilgit-Baltistan and 7911

district), including:

a. Executive summary

b. Methodology: description of sampling and methodology used, assessment of

methodology and its limitation, data collection instruments, and data

processing (analysis methodology, and quality assurance)

c. Findings

d. Conclusions

e. Recommendations

f. Lessons learned

g. Four-page briefing note

13. A copy of the electronic database developed to record and analyse information

collected through questionnaires by the enumerators.

14. Upon completion of the assignment, IDS will deliver to the ASP-RSPN all original

materials (completed questionnaires or survey instruments, computer files, etc.) used

during the implementation of the survey and will destroy all copies, in order to protect the

anonymity and confidentiality of the information.

11

Though the total number of affected districts is 83, four districts have 25 or less affected households; hence the

coverage will be only in 79 districts.

20

15. Special report(s) upon Client‘s request; important documents/information as requested

by ASP-RSPN.

All the reports should be provided in both hard copy and electronic version in English in the

format requested.

MONITORING AND EVALUATION

The M&E function of this assignment will be undertaken by the qualified teams both at ASP-

RSPN and IDS. ASP-RSPN would conduct external monitoring of the entire assignment

through CPO and PPOs. Under an overall quality control framework, ASP-RSPN will

directly do the surprise visits to the enumeration sites to ensure the quality and pace of data

collection. The external M&E framework has been explained in detail under the role of ASP-

RSPN in the beginning of the inception report.

At the level of IDS, the M&E team shall be led by a senior IDS person who has extensive

experience of monitoring and evaluation of similar projects undertaken by Pakistan Poverty

Alleviation Fund (PPAF). All aspects of the spot checks, from training of enumeration teams

to report writing shall be monitored by M&E teams reporting directly to the Team Leader.

This shall involve team visits to the field offices at various intervals to monitor field work

and to resolve or draw the manager‘s attention to any issues/problems identified.

Enumeration teams may be joined at times in the field to inspect the listing and enumerating

activities. Data entry shall also be monitored at intervals, where the M&E team shall

randomly select a small sample of entries/questionnaires to check accuracy. All report writing

shall be carefully supervised and shall be proof read by the M&E team to make sure that

these and all presentations are accurate and meet high writing and publishing standards.

Data Collection M&E

Three-Tier Management and Quality Control: For field work, IDS shall implement a three

tier management and quality control mechanism to ensure that the survey data collected is

authentic.

Tier 1- Supervision in the field: Field offices shall be established at the district level to ensure

efficient management and control. Field supervisors are responsible for monitoring of

enumeration teams in the field. They ensure that day-to-day targets are met.

Quality Control Officers review each and every questionnaire filled, marking errors and

omissions. Questionnaires with faults are returned to field supervisors via district supervisor

for correction in the field.

Tier 2 – Supervision at District Level: The District Supervisor, a permanent IDS staff

member, ensures enumeration targets are met, and keeps an overall check on the field activity

at the district level. The District Supervisors maintains the questionnaire log-book to ensure

that all questionnaires are accounted for, and randomly inspects filled-out questionnaires, and

receives error reports from the Quality Control Officers. Questionnaires with faults are

21

returned for enumeration through him. They ensure that survey guidelines and techniques are

being followed. Moreover, a centralized M&E team comprised of 3 officers from IDS,

including the Survey Manager, will carry out random spot visits to the field during the

survey. They will monitor the overall practices and performance of field staff and evaluate

performance in each district. Such checks would also be conducted by the unannounced visits

by the Survey Manager and Survey Specialist.

Tier 3 – Supervision at the Head Office Level: Questionnaires received at the head office are

put through a second layer of monitoring before being passed on for data processing. An

additional team of Editors will review questionnaires again. The Management Information

System (MIS) Manager will be directly part of and oversee all supervision at the head office.

Data Processing M&E

The MIS manager will supervise the overall data entry activity for the Spot Checks and keep

a check on the performance of the keypunch operators (KPOs) based on the feedback

received from the data editors to ensure that the data entry sample size/target is being

achieved in each phase.

Double Entry12

: Each questionnaire (of all instruments used in the Spot Checks Evaluation)

is entered twice, to ensure that human errors are minimized.

Built-in Checks: There are standard built-in features in the software designed for the spot

check. These include: skip-and-fill design, pre-defined data range for entry for different

questions e.g. CNIC number cannot be more than 13 digits. ―Forced entry‖ features ensure

necessary fields cannot be left blank.

Data Editors: The MIS team at the IDS head office will include data editors. Once certain

batched of data entry load is completed, an error report is generated by the software

highlighting all kinds of discrepancies, if any. The data editors will be responsible for

checking these discrepancies against the original questionnaires and make the relevant

corrections in the entered data.

Data Analysts: Data analysts, responsible for final work in close coordination with the MIS

department during the data analysis and report writing at the required intervals; will provide

an additional layer of review when/if analytically unexpected or exceptional results are

found.

12

Given the quality of KPOs available at provincial level and other problems like prolonged power outages, data

security, the best way out is centralized data entry at Islamabad under the direct supervision of Manager MIS

and Survey specialist.

22

MANAGEMENT PLAN

TEAM MEMBERS

A team of ASP-RSPN will supervise the assignment as mentioned below

Proposed Team

Position in Team Name

Team Leader Mr. Shahzad Arif

M&E Specialist Mr. Naveed Anjum Buzdar

M&E Officer Mr. Sardar Karim

Coordinator Punjab Mr. Iqbal Ahmad Raja

Coordinator KPK & GB Mr. Sharif Khan

Coordinator Sindh Mr. Ghulam Sarwar khero

Coordinator Balochistan Mr. Sheryar Taj

Quality Control Manager Punjab Ms. Ayesha Nawaz

Quality Control Manager KPK Mr. Shehbaz Faiq Khatak

Quality Control Manager Sindh Mr. Shahid Panwar

Quality Control Manager Balochistan Mr. Kamran Khan

*ASP- RSPN CPO Islamabad will coordinate AJK Spot Checks activities.

A core team comprising IDS permanent staff members will be assigned to the project. Field

supervisors, enumerators, and KPOs will be hired from our existing roster of field personnel.

The members of the core IDS team, and the management structure under which the team will

perform is as follows:

Proposed Team

Position in Team Name

Team Leader Dr. Sohail J. Malik

Survey Specialist Dr. Hina Nazli

Survey Manager Lt. Col. (R.) Imran Malik

MIS Manager Arshad Khurshid

Data Analysis and Report Writing Wajiha Saeed

Research Associate Shehryar Rashid

Research Associate Sara Rafi

A tentative detail management plan is given in the following page.

Team Leader

Survey Manager

Provinical Coordinators (6)

District Supervisor &

Quality Control Officers (Field)

Field Supervisors

Enumerators

Training Team

MIS Manager

Quality Control Officers (MIS)

Data Entry Team

Data Analysis Team

Survey Specialist

PROPOSED MANAGEMENT PLAN

24

Team Leader

Coordinator KPK, GB, AJK

Quality Control Manager

Coordinator Punjab


Coordinator Sindh


Coordinator Baluchistan


M & E Specialist

M & E Officer

ASP- RSPN Team:

25

LOGISTICS PLAN

The logistics plan for the project has been prepared according to the sample design mentioned

above. Sample design includes information on the number of districts to be covered and the

number of households per district. Field staff will be hired according the sample design and

survey requirements. The distribution of teams/groups will depend on number of sampled

households to be surveyed. The following table presents information on field work such as

number of supervisors, enumerators, district offices, and GPS‘s to be utilized. The tentative

work plan and scheduling for the project is presented in a later section. The resource plan

indicated below will be executed based on the level of services required at a particular time.

These resources will not remain fully deployed during the entire duration of the program.

Field Work

Provincial Coordinators 613

District Supervisors 7914

Field Supervisors 79 supervisors

Enumerators 158 enumerators

Quality Control Officers (Editors ) 79 editors

Key Punch Operators (KPO) 25 officers

Transport for supervisors and enumerators field

work 79 vehicles

District office 7915

offices

GPS 158 GPS

Camera 158 camera

13

Four provinces, GB and AJK 14

Though the total number of affected districts is 83, four districts have 25 or less affected households; hence

the coverage will be only in 79 districts. 15

Though the total number of affected districts is 83, four districts have 25 or less affected households; hence

the coverage will be only in 79 districts.

Detailed Staff Plan

Province No. of

Districts Adjusted HH Sample based on

minimum 25 per site Field days

Questionnaires/day Number of District

Supervisors No of

Enumerators Number of Field

Supervisors Number of

Editors Total number of teams in

each province

AJK 10 1,804 10 12 10 20 10 10 10

Balochistan 12 2,086 10 12 12 24 12 12 12

GB 6 1,176 10 12 6 12 6 6 6

KPK 24 4,704 10 12 24 48 24 24 24

Punjab 11 2,156 10 12 11 22 11 11 11

Sindh 16 3,136 10 12 16 32 16 16 16

Pakistan 79 15,062

79 158 79 79 79

27

IDS Head Office Management and other Staff

The team leader for this project will be Dr. Sohail Malik, Chairman of Innovative

Development Strategies. He will be responsible for the overall affairs of all departments at

the head office and in the field for the full duration of the project. Managers for all

departments would report to him on the progress of work and presenting the outputs.

A Survey Specialist shall work directly under the team leader and will be responsible for

assisting in survey design and implementation. Additionally the survey specialist will oversee

progress in field work, data entry, and data analysis. The survey team will be led by a Survey

Manager who will be responsible for organizing all training exercises and coordinating with

field staff.

The MIS department is headed by the MIS Manager supported by a deputy officer. He is

responsible for all affairs related to data entry, cleaning, processing, issues regarding data

entry software and affairs of other staff in this department. Additionally he is responsible for

hiring key punch officers and editors for the data entry process.

The Survey Manager is an experienced member of IDS staff who has knowledge on M&E

techniques from previous major projects. He is responsible for monitoring and evaluation of

all field and survey activities.

IDS‘s team of data analysts are responsible for analyzing data received from the field using

relevant statistical and econometric techniques. Additionally the data analysts will assist in

preparation of reports for submission.

Hiring and Training of Field Staff

Staff will preferably be hired from within the districts with the help of Field Supervisors for

each of these districts. Field staff includes enumerators and quality control officers. Criteria

for hiring of field staff will give preference to locals of the area (speak local language), and

education level of at least a bachelor‘s degree. Field Supervisors for each district are IDS

employees who would be sent into the field. IDS is a professional private limited company

that operates at the highest ethical levels. The Field Supervisors are qualified professionals

who have supervised six major surveys in the last two years. The three tiered management

control plan shall ensure that field work is being conducted appropriately and efficiently. The

role of the Quality Control Officer and field visits from the Survey Specialist shall minimize

the risk of collusion or bias from local field workers.

As mentioned above, training for field staff shall be done through a three-day training course.

The first two days shall involve technical training on instruments, time management,

effective communication skills and field ethics. The last day involves field work to ensure

further familiarity with the survey instrument and iron out logistics.

Initially a training workshop will be conducted at the IDS head office in Islamabad for

Provincial and AJK Coordinators and district supervisors. These coordinators will in turn

impart training on supervisors and enumerators in their respective districts.

28

The cascade training will be imparted by IDS, using the training manual it has prepared and

that ASP-RSPN has thoroughly reviewed. The manual has been finalized. ASP-RSPN will be

monitoring the whole process of imparting the cascade training. This monitoring will be

conducted by the ASP-RSPN CPO in Islamabad and by PPOs in districts.

Establishment of District Field Offices

The IDS Supervisors in the field are responsible for establishment of field offices in the

respective districts assigned to them. While the training takes place in the respective district,

arrangements will be made for establishing district field offices. RSPN through its RSPs will

provide facilities to the firm where its offices are located to facilitate quick logistical

arrangements. However where this arrangement may not be possible, the premises for the

office will be rented locally. The furnishing and other necessary office equipment would also

be purchased locally. All field activities in each district will be coordinated from the district

field offices directly under the IDS Supervisor. Quality Control officers would also be work

from these offices. The district office equipment consists of the following:

Stationery, Forms and GPS

The stationery has been locally procured and issued by the IDS head office in Islamabad.

Progress Report Forms shall be provided by IDS which will be used for monitoring and

evaluation purposes. GPS equipment – per each enumerator/ field supervisor hired has been

purchased by the head office. The IDS supervisors will carry all this material for their district

when they leave for the field.

Transport

Transport for the field staff will be arranged locally at the district level. IDS Supervisor at the

district level will be responsible for all arrangement related to transportation of field staff. It

is estimated that there will be a requirement to rent one vehicle per district.

Data Entry Stations at IDS

25 data entry stations have been established at the IDS head office in Islamabad10. Each of

these is equipped with a laptop/work station, a comfortable seating arrangement and space for

placing forms to be entered. All laptops/work stations have the software developed for data

entry installed. The editors and KPOs will work alongside. MIS Manager and Deputy

Manager will supervise all data entry and cleaning process and assess the performance of

each individual on the team. IDS will minimize the lag between data collection and entry by

using the fastest courier service and utilizing all 25 data entry stations simultaneously. This

system has been followed successfully in previous major surveys. However data entry will be

completed within a week after the completion of the survey for each district.

ASSUMPTIONS AND APPROVALS

The timelines for the assignment are based the following assumptions

29

1) Security situation of the target districts remains conducive

2) GPS device may not be used in sensitive operational areas

3) Timely approvals of the documents requested by USAID and other stakeholders

4) The timelines of the assignment would significantly depend on the provision of the

data by NADRA

USAID in consultation with the relevant stakeholder will approve the following documents.

1) Inception report/design report

2) Questionnaire

3) Sampling Plan

4) Training kits/ packages

5) Final report

WORK PLAN

This assignment is expected to be completed for each province within 40 days after the data

are received from NADRA. Therefore a specific work plan has been developed with the

following general timeline:

1) During the first week (23-29 March) of the project the inception report will be

submitted which shall include information on the process, approach and methodology.

Additionally the inception report shall include the proposed sample and first draft of

the questionnaire. Arrangements will be made to field test and finalize the

questionnaire at the earliest

2) Progress: During the first week (23-29 March) of the project the inception report was

prepared and The inception report included the proposed sample and questionnaire.

The questionnaire has been finalized after field testing and in-house review. The

finalized questionnaire is attached as ANNEX 1.

3) Throughout the initial phase there will be training workshops to train enumerators,

supervisors and key punch operators for the survey, data entry, and data analysis

process. The first training session will take place at IDS head office in Islamabad after

three days of data sharing by NADRA for Provincial Coordinators.

4) Upon receipt of data from NADRA, ASP-RSPN would assess the data for any

shortfall, issues and missing information. The timelines for resolution of such issues is

not indicated in the work plan.

5) IDS will start field work 10 days after cleaned data is received. Field work will take

place simultaneously in all districts where data has been received from. However, IDS

may withhold field work till the completion of the appropriate training exercises take

place.

30

6) It is estimated that the data entry process will start after 2 days of data collection. Data

entry will take place at IDS‘s head office in Islamabad10.

7) Data analysis shall start right after the data entry process begins.

8) Report writing, which includes the Final Report and District Completion Reports,

shall continue during the entire duration of the assignment.

9) Once the data from a province is received, the activities will be started simultaneously

in all the districts of that province.

Province wise detailed work plan is attached.

WORK PLAN WITH TIME FRAME

Design Phase

Sr. # Activity March April

21 22 23 24 25 26 27 28 29 30 31 1 2

1 Inception Report

2 Questionnaire Development and Finalization

3 Field Testing

4 Printing of Questionnaires

5 Selection of District and Field Supervisors

6 Training of District Supervisors

7 Logistics arrangement

AJK – Total Sample = 1,804

Work Plan for Field Work

Sr. # Activity Days

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

1 Receipt of cleaned data by ASP-RSPN

1 Deployment of Districts Supervisors

2 Office setup in each district

3 Training of Field supervisors and enumerators

4 Reconnaissance

5 Field work

Work Plan for Data Entry, Analysis and Report Writing

Sr. # Activity Days

13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

1 Data checking

2 Data entry

3 Data cleaning

4 Data analysis

5 Report Writing

Balochistan16– Total Sample = 2,086


Sr. # Activity Days

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20





4 Reconnaissance

5 Field work


Sr. # Activity Days

13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

1 Data checking

2 Data entry

3 Data cleaning

4 Data analysis

5 Report Writing

16

Except for data collection process, all other activities take the same time irrespective of the sample size.

Gilgit-Baltistan– Total Sample = 1,176


Sr. # Activity Days

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20





4 Reconnaissance

5 Field work


Sr. # Activity Days

13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

1 Data checking

2 Data entry

3 Data cleaning

4 Data analysis

5 Report Writing

Khyber Pakhtunkhwa– Total Sample = 4,704


Sr. # Activity

Days

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20


1 Deployment of District Supervisors



4 Reconnaissance

5 Field work


Sr. # Activity Days

13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

1 Data cleaned by ASP-RSPN

2 Data entry

3 Data cleaning

4 Data analysis

5 Report Writing

Punjab– Total Sample = 2,156


Sr. # Activity Days

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20





4 Reconnaissance

5 Field work


Sr. # Activity Days

13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

1 Data checking

2 Data entry

3 Data cleaning

4 Data analysis

5 Report Writing

Sindh– Total Sample = 3,136


Sr. # Activity Days

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20





4 Reconnaissance

5 Field work


Sr. # Activity Days

13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

1 Data checking

2 Data entry

3 Data cleaning

4 Data analysis

5 Report Writing

38

ANNEX I - QUESTIONNAIRE

39

40

41

42

ANNEX II - DEFINITIONS

1. Ownership Status:

a. Owner: owns the property as per land revenue records

b. Tenant: May be either of two types as follows

i. Urban tenant: does not own the property and is paying rent; is not

responsible for repair and maintenance of the structure

ii. Rural tenant: is not the owner of the land, but may be the owner of

the structure by virtue of family residing on the land historically.

c. Relative of Owner: is related to the owner of the property and residing in the

structure rent-free. (If a relative is paying rent, he will be considered a

tenant.)

2. Type of house:

a. Pucca: walls and roof made of the following materials.

i. Walls: Burnt bricks, stones (packed with lime or cement), cement

concrete, timber, etc.

ii. Roof: Tiles, iron sheets, cement sheets, brick concrete, cement

concrete, timber etc.

b. Kutcha: Walls and/or roof made of materials other than those above e.g. un-

burnt bricks, bamboos, mud, grass, reeds, thatch, loosely packed stones

c. Mixed: Walls made of pucca materials but roof made of material other than pucca

3. Household:

“The general criterion to be used in identifying the members of a multi-person household

relates to whether they live and eat together and have no usual place of residence

elsewhere”. (Source: Federal Bureau of Statistics of Pakistan)

4. Definition of Damage(if there does not exist any provincial definition):

Cracks, load-bearing structure affected; dangerous to live in; structure washed away

entirely, walls and floor damaged but safe to live in (structure intact).

43

ANNEX III - METHODOLOGY FOR ANALYSIS

Household Indicator (HH): at the household level, the difference between provincial

damage assessment (𝑫𝑨𝒊𝟏) and ASP/IDS damage assessment (𝑫𝑨𝒊𝟐 ) :

𝑯𝑯 = 𝑫𝑨𝒊𝟏 − 𝑫𝑨𝒊𝟐

𝐻𝐻 = 0, implies no discrepancy

𝐻𝐻 = 1, implies discrepancy (deemed damaged when not damaged)

District Indicator 1 (D1): at the district level, percentage of households that have discrepant

damage assessment

𝑫𝟏 =𝒏𝒅𝑵𝒅

∗ 𝟏𝟎𝟎

Where 𝑛𝑑 =number of discrepant houses in district, i.e. houses for which 𝐻𝐻 = 1,

𝑁𝑑 =total number of houses (surveyed) in district

If D > 30, district must be re-assessed by provincial authorities

If 10 < D ≤ 30, further sample will be taken

If D ≤ 10, district stands validated

44

Further analysis at district level: are katcha houses more likely to have an incorrect damage

assessment?

- Katcha Indicator (K): At the district level, percentage of katcha households

with discrepant damage assessment

𝑲 =𝒏𝒌𝑵𝒌

∗ 𝟏𝟎𝟎

Where 𝑛𝑘 =number of katcha houses in district for which𝐻𝐻 ≠ 0,

𝑁𝑘 =total number of katcha houses (surveyed) in district

- Pacca Indicator (P): At the district level, percentage of pacca households

with discrepant scores

𝑷 =𝒏𝒑

𝑵𝒑∗ 𝟏𝟎𝟎

Where 𝑛𝑝 =number of pacca houses in district for which 𝐻𝐻 ≠ 0,

𝑁𝑝 =total number of pacca houses (surveyed) in district

Province/Region Indicator (R): at the province level, percentage of households that have

discrepant damage assessment

𝑹 =𝒏𝒓𝑵𝒓

∗ 𝟏𝟎𝟎

Where 𝑛𝑟 =number of houses in province/region for which 𝐻𝐻 ≠ 0,

𝑁𝑟 =total number of houses (surveyed) in province/region

Inferences about Population:

1. Inferences about the population can be drawn using sample weights/raising factors where

sample weights at district and province level are given by:

𝑊𝑑 = 𝑁

𝑁𝑑

Where 𝑁 = total number of beneficiaries in the district

𝑁𝑑 =sample size for the district

2. Mean, tests of significance and margins of error will be reported for ASP/IDS damage

assessment (𝑫𝑨𝟐).

45

ANNEX IV – ASP-RSPN CPO & PPO ORGANOGRAM

Central Program Office Islamabad

ASP- RSPN PPO Organogram

Chief of Party

Executive Assistant

Deputy Chief of Party

Director Admin & Contacts

Manager Contracts &

Admin

Administration Officer

HR Assistant

Director Capacity Building

Manager Capacity Building

Program Officer -Capacity Building

Director Finance & Compliance

Manager Finance

Finance Officer -Finance & Accounts

Finance Assistant - Cashier

Manager Compliance

Compliance Officer

Director MER

Manager IT, Database & MER

Monitoring & Evaluation

Officer

Provincial Director

Manager Assessment, Validation &

Capacity Building

Program Officer Assessment, Validation &

Capacity Building

Senior Program Officer Finance &

AdminManager MER

Program Officer MER

Third Party Validation - RSPN

Documents