TERMS OF REFERENCE 1 Assignment Title: Hiring Services of a Survey Firm to Conduct One Round of School & Household Surveys for Impact Evaluation of Phase II of the Supplemental Stipends Pilot Program in Punjab Duration: April 1, 2015 – June 30, 2015 ______________________________________________________________________ _______________ 1. INTRODUCTION Under the Second Punjab Education Sector Reform Program (PESRP II), supported by international Development Partners (DPs), the Government of Punjab (GOP) is seeking an experienced survey research firm in Pakistan to conduct household and school surveys for a rigorous impact evaluation of Phase II of the Supplemental Stipends Pilot in Punjab (SSPP-II). The impact evaluation of SSPP-II was launched in April 2014 and employs a prospective experimental design, where selected middle and secondary government schools serving girls in tehsils with low school participation rates in existing stipend districts were randomly assigned to two treatment groups corresponding to different supplemental benefit levels, and one control group. 1 Updated on June 11, 2014 to reflect revised deliverable dates and work timeline. Updated on June 25, 2014 to reflect revised deliverable dates and scope of work. Updated on December 30, 2014 to reflect modifications for the second survey round. - 1 -
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
TERMS OF REFERENCE 1
Assignment Title:
Hiring Services of a Survey Firm to Conduct One Round of School & Household Surveys
forImpact Evaluation of Phase II of the Supplemental Stipends Pilot Program
in Punjab
Duration: April 1, 2015 – June 30, 2015_____________________________________________________________________________________
1. INTRODUCTION
Under the Second Punjab Education Sector Reform Program (PESRP II), supported by international Development Partners (DPs), the Government of Punjab (GOP) is seeking an experienced survey research firm in Pakistan to conduct household and school surveys for a rigorous impact evaluation of Phase II of the Supplemental Stipends Pilot in Punjab (SSPP-II). The impact evaluation of SSPP-II was launched in April 2014 and employs a prospective experimental design, where selected middle and secondary government schools serving girls in tehsils with low school participation rates in existing stipend districts were randomly assigned to two treatment groups corresponding to different supplemental benefit levels, and one control group.
The survey research firm is required to conduct extensive school and household sample surveys in identified communities served by SSPP-II. The firm is expected to undertake all activities related to survey data collection, entry, processing and quality-control.
1 Updated on June 11, 2014 to reflect revised deliverable dates and work timeline. Updated on June 25, 2014 to reflect revised deliverable dates and scope of work. Updated on December 30, 2014 to reflect modifications for the second survey round.
- 1 -
1. BACKGROUND
Beginning in 2003, the Government of Punjab has been implementing a multifaceted sector reform program – the Punjab Education Sector Reform Program (PESRP) which focuses on improving service delivery performance to realize meaningful and continuing gains in educational outcomes. Since 2004, the distribution of stipends to female students has been a key activity of PESRP as a means to incentivize girls’ enrollment and retention in middle and secondary levels of education. This program is targeted to girls enrolled in grades 6-10 in government schools in 16 low literacy districts of Punjab. Under the original program, Rs. 600 is provided on a quarterly basis to girls who maintained an attendance rate of at least 80%. In 2013-14, on average, 410,000 beneficiaries received stipends in each quarter. Going forward, the Government of Punjab seeks to modify the design of the benefit structure to strengthen the incentive effect of the program, and sharpen the focus on gains in transition and retention outcomes of disadvantaged girls.
Phase II of the Supplemental Stipends Pilot Program (SSPP-II) is a three-year pilot launched in April 2014 in low participation tehsils of 6 districts.2 In these tehsils, girls in grades 6-10 in select rural government schools are offered a supplemental benefit amount, over and above the Rs. 2,400 per year that they received before.
2 These are the following 18 tehsils from six districts with below average school participation rates of girls ages 11-15 in rural areas: DG Khan, KotChuta and Taunsa in DG Khan; Chaubara, KarorLalisan and Layyah in Layyah; DunyaPur, KarorPacca and Lodhran in Lodhran; Alipur, Jatoi and Muzaffargarh in Muzaffargarh; Khanpur, Rahimyar Khan and Sadiqabad in Rahimyar Khan; and Jampur, Rajanpur and Rojhan in Rajanpur. The region of KotChuta in DG Khan will be treated as a tehsil for the purpose of this impact evaluation.
- 2 -
SSPP-II also tests at least one additional new design feature, i.e. an additional stipend on progression to grades 9 and 10.3 4
SSPP-II is being rigorously evaluated to determine the causal effects of the program on key outcomes such as school participation and progression, as well as spillover effects on intra-household behavior. The impact evaluation of SSPP-II employs a prospective experimental design, whereby 659 rural middle and secondary government schools for girls from the 6 districts are either part of one of the two treatment groups (corresponding to different supplemental benefit levels) or no treatment (i.e. control group).5
The original design note for the impact evaluation is included as Appendix A.
2. SCOPE OF WORK
The survey will cover 659 SSPP-II treatment and control schools in the 6 districts for which valid GPS coordinates were collected and that could be assigned to treatment and control groups as well as a sample of households in 431 settlements in 372 selected mouzas. The list of schools, mouzas and settlements are included as Appendix B and Appendix C. Their GPS coordinates and additional information
3 Specifically, the following financial incentive packages (or “treatments”) are being piloted:
Treatment I:(i) Girls in grades 6-8 receive Rs. 900 per quarter based on 80% attendance.(ii) Girls in grades 9-10 receive Rs. 1200 per quarter based on 80% attendance.
Treatment II:(i) Girls in grades 6-8 receive Rs. 900 per quarter based on 80% attendance.(ii) Girls in grade 9-10 receive Rs. 2400 upon progression to this grade in the first quarter of the
school year + Rs. 1200 per quarter based on 80% attendance.
Control:Girls in grades 6-10 receive Rs. 600 per quarter based on 80% attendance. This is the same benefit structure as in the original stipends program.4 Half of the control group clusters could potentially be offered a different treatment later.5 To clarify, randomization was done at the “school cluster” level, which means that whole clusters were assigned to either treatment or control (i.e. if a cluster is assigned to treatment, all schools in that cluster are being treated). In this context, a “school cluster” is defined as a girls’ secondary school and all feeder schools for girls offering grades 6-8 and which are designated “rural” in the an-nual school census.
- 3 -
will be provided to the survey firm by the Program Monitoring and Implementation Unit (PMIU) and the World Bank (WB).
In a sample of mouzas served by the 659 schools, the firm will administer one round of follow-up household survey in around 3,830 ‘eligible’ households identified in the baseline survey. An ‘eligible’ household is defined as a household
- 4 -
that had at least one female child aged 10 to 16 at the time of the baseline survey.6,
7 The household surveys will comprise of interviews with parents and children (sample), as well as cognitive and/or learning assessments of children at home (sample). In addition, the firm will be required to record locational data (GPS) on domiciles visited. The time period for the baseline household survey was June-August 2015. The time period for the first follow-up household survey is April-June 2015.
The survey research firm will also conduct school based follow-up surveys in 659 SSPP-II treatment and control schools in the 6 districts. School surveys will comprise of school observations, head-teacher, teacher and student interviews (sample)8, recording of location (school GPS), and extraction/capture of information from registers and records at school. The time period for the baseline school survey was May-June 2014. The time period for the first follow-up school survey is April-May 2015.
The survey firm is expected to undertake all activities related to survey and test piloting, field mobilization, and data collection, entry, and processing. The firm must also have procedures and strictly follow them to identify and track households over the survey rounds. Data quality is the top priority, and the PMIU and the World Bank will provide direct, close supervision to this end.
6 Given the large number of mouzas, it was not feasible to do household surveys in all affected mouzas. For this reason, a multi-stage stratified random sample design was adopted. In the first stage, a sample of PSUs (mouzas) was selected from each “school cluster” (treatment or control). Inside these mouzas, a sample of SSUs (settlements) was randomly selected with a fixed schedule. Finally, inside settlements the baseline survey was administered in only a sample of ‘eligible’ households (3rd stage – selection of TSUs). These households were selected with the help of the random-walk algorithm described in Appendix D. In each sampled household, the mother or household head will be interviewed as well as a sample of school-aged children (in the follow-up survey one child will selected within the age range of 6 to 10, and one selected within the age range of 18 to 25; all children aged 11 to 17 will be interviewed; if there are 3 or fewer children in the household between the ages of 6 to 25, all children will be interviewed).7 The households interviewed in the first follow-up round will be the same households that were interviewed in the baseline round - i.e. the household surveys are envisaged as panel household surveys. It is imperative that an overwhelming proportion of households interviewed in the baseline survey will be re-interviewed in the follow-up survey. Appendix E sets out a procedure meant to assure this will indeed be the case; the list of panel households will be provided to the survey firm by the PMIU and the World Bank.8 If the school offers only up to grade 8, then only one classroom will be sampled, from grades 6-8. If the school offers up to grade 10, then two classes will be sampled – one from grades 6-8 and one from grades 9-10. In each sampled classroom, up to 10 students and 2 teachers who teach that classroom will be selected for the interview. Head-teachers will also be interviewed.
- 5 -
Based on a performance review after completing the first follow-up household and school surveys, the contract with the firm may be extended / modified to include additional rounds of follow-up surveys.
3. KEY TASKS AND RESPONSIBILITIES
The key tasks and responsibilities of the firm are described in Table 1.
Table 1
Deliverable Date (Revised)9
A. Field mobilization
9 Deliverable dates are indicative and subject to revision.
- 6 -
C1. Provide feedback, as requested, on all survey instruments and tests, particularly with respect to question appropriateness, question framing, response options, and content gaps.
C2. Carefully and properly format all questionnaires, tests, and answer sheets to ensure that they are user- and reader-friendly.
C3. Translate into Urdu and relevant regional languages all survey and test instruments, and administration documents and make them available with adequate time to PMIU/WB for possible reverse translation.
C4. Mobilize teams of sufficient numbers, proficiency, fluency in relevant local languages, and professional integrity to handle the scope of work, including appropriate field-level managers, surveyors, project managers, quality-control monitors, and data entry operators.
C5. Collect in standardized form and submit information on each field survey staff member (coordinators, managers, surveyors, etc.) to WB/PMIU.
C6. Assign unique and permanent identification numbers to all field survey personnel.
C7. Organize and administer all required trainings of field survey personnel.
C8. Make available all field survey personnel for possible additional trainings offered by the WB/PMIU.
C9. Draft and translate all field survey manuals.
C10.Make these field survey manuals available to firm survey staff at trainings and test knowledge of fieldwork procedures and acceptable behaviors. Submit test results to the WB/PMIU team.
C11.Ensure that field survey personnel only comprise of individuals who pass the post-training survey knowledge test that may be conducted by the WB/PMIU team.
C12.Manage all fieldwork logistics and make fieldwork planning available to the WB/PMIU team for review and pre-approval.
C13.Develop field survey quality control protocols and procedures and submit to the WB/PMIU team for pre-approval. Mobilize an independent quality control unit to do
Complete follow-up field mobilization (school) by: April 10, 2015.
Complete follow-up field mobilization (household) by: April 24, 2015.
- 7 -
random checks of at least 5% of each field survey personnel’s interviews and investigate any quality control issues that arise.
B. Data CollectionD1. Pilot questionnaires and test instruments in a sub-sample of
schools and households as requested by the WB/PMIU team. Note that the list of schools, mouzas and settlements are included as Appendix B and Appendix C and that the list of panel households will be provided to the survey firm by the PMIU and the World Bank.
D2. Follow all directives and instructions from the WB/PMIU team with regards to methodology, sampling, storage and data management of survey and test instruments.
D3. Field each survey and test instrument in the manner in which it is intended.
D4. Collect GPS data from all households visited during baseline and follow-up survey rounds, following the data collection protocols outlined by the WB/PMIU team.
D5. Collect GPS data from all schools visited during baseline and follow-up survey rounds, following the data collection protocols outlined by the WB/PMIU team.
D6. Maintain a field visit log of each household visited during the baseline and follow-up rounds, answering all questions therein. Also, maintain a field visit log of each school visited, answering all questions therein.
D7. Ensure 100% assignment of unique and permanent identification information for enumeration areas, households and individuals therein, schools, teachers, and students.
D8. Ensure the development and effective application well-defined, reliable procedures to track households and individuals therein, schools, sample teachers, and sample students over survey rounds.
D9. Ensure quality control measures for data collection at the household level are applied in the baseline and follow-up rounds. Also, ensure quality control measures for data collection are applied at all schools in baseline and follow-up rounds.
D10.Complete all information requested in daily and weekly field reports by the WB/PMIU team.
Complete follow-up survey (school) fieldwork by: May 29, 2015.
Complete follow-up survey (household) fieldwork by: June 26, 2015.
- 8 -
D11.Securely and safely maintain all paper questionnaires, tests, and other reporting forms from each household and school and make available to the WB/PMIU team upon request.
D12.Be respectful at all times to respondents (parents, children, other members of the household, school administrators, teachers, students, etc.).
D13.Fully abide with the principles, regulations, and policies which apply to research involving human subjects. In addition, fully abide with all safeguards for research of vulnerable groups such as children and economically- and educationally-disadvantaged persons.
D14.Put in place appropriate protections so that the risks of invasion of privacy and breach of confidentiality are minimized. Follow all standard requirements for obtaining and documenting informed consent from each prospective subject (parent, child, other household member). In particular, make special provisions for soliciting the assent of children (taking account of the age, and maturity and comprehension levels of the child) and the permission of parents or guardians before initiating any data collection. Ensure that steps are taken to ensure that the data collection exercises are undertaken in a culturally-sensitive fashion.
D15.Notify the WB/PMIU team, as soon as safety permits, of any security threat encountered during the course of field work, including, but not limited to, direct threats to the survey team, generalized threats during the course of field work, and spontaneous occurrences of insecurity during fieldwork or travel.
C. Data entry & quality controlE1. The firm will develop a data entry program for data entry.
This program will follow all inputs from the WB/PMIU team, including, but not limited to, oral and written guidelines, data entry codebooks, and other advice. The data entry program will be shared and tested with the WB/PMIU team prior to use.
E2. Internally check the integrity and accuracy of data before transmitting to the WB/PMIU team.
E3. Provide preliminary data within 1 day of beginning data entry (this will serve as a preliminary check of proper data entry).
Complete follow-up data entry and quality control (school) by: June 19, 2015.
Complete follow-up data
- 9 -
E4. Prepare data entry quality control protocols and procedures and submit the WB/PMIU team for pre-approval. Mobilize a quality control unit.
E5. Provide all logs and outputs of quality control checks done on data prior to transmitting to the WB/PMIU team.
E6. Enter all data simultaneously using two different data entry units (double entry), with each unit under independent supervision.
E7. If requested, reenter 10% of all survey questionnaires and tests as identified by the WB/PMIU team and test answers using a different team of data entry operators under the oversight of and following the instructions of the WB/PMIU team.
E8. Correct any data entry errors as requested by the WB/PMIU team.
E9. Maintain a data entry log as specified to record progress and issues with data entry.
E10.Scan all paper questionnaires, tests and other forms and submit to the WB/PMIU team in an external hard drive.
entry and quality control (school) by: July 17, 2015.
D. GeneralF1. Maintain regular communication with WB/PMIU team via
audioconference, videoconference, and email regarding all aspects of the survey preparation, data collection, and data entry process.
F2. Seek pre-approval from the WB/PMIU team on all key decisions likely to impact the scope and quality of the survey work.
F3. Provide timely feedback on all detailed assignments and instructions provided by the WB/PMIU team via phone or email.
F4. Provide the WB/PMIU team with copies of its logistical planning and fielding documents as it relates to data collection and data entry activities for review and prior approval.
F5. Notify the WB/PMIU of any changes in personnel assigned to this project, including field surveyors, along with clear justifications.
- 10 -
F6. To the extent possible, seek guidance from the WB/PMIU team before troubleshooting any sensitive/complex problems that arise during survey data collection and entry.
F7. Strictly comply with all general independence, confidentiality, and professional integrity codes. Seek advice from the WB/PMIU team when uncertain about requirements and expectations in this regard.
F8. Permit the WB/PMIU team or designated entities or individuals to monitor and inspect selected components or all of the process. Monitoring may take the form of unannounced visits to firm offices, training events, or while undertaking survey rounds.
F9. If Computer Assisted Personal Interviewing (CAPI) with handheld devices (e.g., tablet computers) and electronic questionnaires are to be used, the firm will develop and test the necessary software. All equipment used as part of the survey (e.g., GPS handhelds, smartphones, tablets, digital cameras) is to be provided by the firm in the appropriate quantities and in full working order.
5. OUTPUTS
Required outputs include but are not limited to the following. The WB/PMIU team also reserves the right to request revisions and resubmissions as needed.
1) All survey instruments, assessments, forms, and manuals prepared or revised by the firm.
2) Reports and logs from survey and test field-testing activities.
3) Logistics plans and timetables.
4) Quality control plans for survey and test data collection and data entry.
5) All logs, journals, and reports from fieldwork.
- 11 -
6) Field survey administration report.
7) Survey and test data in electronic format in agreed templates and statistical format.
8) All multimedia information in electronic formats, with clear organization.
9) Scanned survey questionnaires and tests.
10) Data entry and processing report.
6. WORK TIMELINE
The timeline is summarized in Table 2. Note that this timeline may be subject to change.
Table 2
Action Item Revised Dates
Fielding and completion of follow-up household survey April – June 2015
Fielding and completion of follow-up school survey April – May 2015
7. Evaluation Criteria
For this purpose, PMIU intends to hire the services of a firm which has proven relevant background and experience working with the government. Evaluation criteria for evaluating the Expression of Interest (EOI) would be as follows:
a. Firm experience (attach certificate of incorporation), including qualified key staff (25 marks).
Definition of “Qualified Key Staff”: A key staff is considered qualified if he/she sat-isfies all of the following specifications:
(i) holds at least a Masters’ degree; MA-5 scores, MPhil-6 scores, PhD-7 scores
- 12 -
(ii) has at least 2 previous experiences in survey administration work where the survey questionnaire were administered to at least 1,200 individuals (irrespective of organizational unit); 10 scores
(iii) in these prior survey experiences, he/she had similar roles and function as his/her role and function for the assignment under this REI: 8 scores
In the same vein, a key staff is considered unqualified if he/she does not meet any one of the aforementioned specifications. This definition of qualified key staff applies to all parts of this REI.
b. Up to three Qualifying Survey Experiences (25 marks for each qualified ex - perience)
Definition of “Qualified Survey Experience”: A survey experience is considered qualified if it satisfies all of the following specifications:
(i) it is relevant to this REI in terms of scope and tasks and responsibili-ties; 10 scores
(ii) it was administered wholly or partly in Punjab; 5 scores (iii) it is a survey experience for which the firm took full responsibil-
ity of all stages of survey administration, including pre-testing, field mobilization, data collection, data entry and processing; 5 scores
(iv) the survey questionnaire was administered to at least 1,200 in-dividuals (irrespective of organizational unit) – i.e. at least 1,200 indi-viduals were interviewed for the survey; 5 scores
In the same vein, a survey experience is considered unqualified if it does not meet any one of the aforementioned specifications. This definition of qualified survey experience applies to all parts of the TOR.
8. Selection Method
8.1. The attention of interested consulting firms is drawn to paragraph 1.9 of the World Bank’s Guidelines: Selection and Employment of Consultants under IBRD Loans and IDA Credits & Grants by World Bank Borrowers [January 2011] (“Consultant Guidelines”), setting forth the World Bank’s policy on conflict of interest.
8.2. A consulting firm will be selected in accordance with the Selection Based on Consultants Qualification (CQS) method set out in the World Bank’s Guidelines: Selection and Employment of Consultants (under IBRD Loans & IDA Credits and Grants) by World Bank Borrowers (2011). 8.3. A consulting firm may associate with other firms in the form of a joint venture or a sub consultancy to enhance their capability for carrying out the assignment fully, efficiently, and with quality.
The applicant firm will be required to provide the following information during ne-gotiations:
1. A brief description of a proposed survey implementation strategy.
2. A capacity statement for hiring and training sufficient numbers of personnel to complete all tasks.
3. Resumes for key technical personnel expected to be involved in the project.
- 14 -
APPENDIX A: DESIGN NOTE
I. Intervention
The distribution of stipends to female students is a key activity of the Punjab Edu-cation Sector Reform Program (PESRP) and the Second Punjab Education Sector Reform Program (PESRP II) to improve gender parity in access to education. The stipends program is targeted to girls enrolled in grades 6-10 in government schools in 16 districts with literacy rates below 40%, as per the 1998 Population Census data. In 2011-12, approximately 380,000 girls received stipends quarterly for a total cost of Rs. 1 billion. However, since its inception in 2004, the stipend amount had not been increased despite rising inflation.
Considering the above, under PESRP II, the provincial government agreed to in-crease the benefit amount to strengthen the program’s incentive effect obtained through the level of the benefit. To maximize the incentive effect, the increase in benefits was to be targeted to areas with low female school participation rates, a substantial rural population, and a relatively high share of poor students.
In order to (i) increase school transitions of girls from primary schools to middle schools and from middle schools to secondary schools, and (ii) increase retention in grades 6-10, Phase II of the Supplemental Stipends Pilot in Punjab (SSPP-II) will phase in supplemental benefits tied to attendance and/or progression in selected school in 18 tehsils in 6 districts, namely DG Khan, KotChuta and Taunsa in DG Khan; Chaubara, KarorLalisan and Layyah in Layyah; DunyaPur, KarorPacca and Lodhran in Lodhran; Alipur, Jatoi and Muzaffargarh in Muzaffargarh; Khanpur, Rahimyar Khan and Sadiqabad in Rahimyar Khan; and Jampur, Rajanpur and Ro-jhan in Rajanpur.10 KotAdu in Muzaffargarh and Liaqatpur in Rahimyar Khan will not be included. Under SSPP-II, 702 rural government schools in around 3600 mauzas will be categorized into three groups (“Treatment I”, “Treatment II” and “Control”). The following benefit structure will be offered to beneficiary girls in grades 6-10 in each of these groups:
Treatment I:
10 The region of KotChuta in DG Khan will be treated as a tehsil for the purpose of this design note.
- 15 -
(i) Girls in grades 6-8 will receive Rs. 900 per quarter based on 80% at-tendance.
(ii) Girls in grades 9-10 will receive Rs. 1200 per quarter based on 80% attendance.
Treatment II:
(i) Girls in grades 6-8 will receive Rs. 900 per quarter based on 80% at-tendance.
(ii) Girls in grade 9-10 receive Rs. 2400 upon progression to this grade based on 80% attendance in the first quarter of the school year + Rs. 1200 per quarter based on 80% attendance.
Control:
Girls in grades 6-10will receive Rs. 600 per quarter based on 80% atten-dance. This is the same benefit structure as in the original stipends program.
This benefit structure of Treatment I is motivated by the fact that the median pri-vate cost of schooling per girl child in middle grades is between Rs. 2600-Rs. 3800. Furthermore, a similar stipends program in Sindh has set benefit levels in low par-ticipation Talukas at Rs. 3600 per year. Based on this, a benefit amount of Rs. 3600 per year for girls in grades 6-8 is considered appropriate. Since the private cost of schooling is almost double for secondary grades than it is for middle grades, girls enrolled in grades in pilot 9-10 will be offered a higher quarterly benefit amount. Treatment II introduces additional incentive payments on grade progression be-cause transition rates decline sharply for girls completing grade8. Given these con-siderations, girls progressing to grade 9 will be eligible to receive an additional benefit payment in lump sum, subject to 80 % attendance in the first quarter of the school year. Girls progressing to grade 9 will be eligible to receive a lump sum pay-ment, too, to evaluate its effects at a less problematic transition.
Phase II of the Supplemental Stipends Pilot follows Phase I in which the same fi-nancial incentive package as Treatment I is being piloted in 68 government schools for girls in Kasur and Bhakkar Districts. The pilot districts of Phase II will also be at the center of a rigorous impact evaluation of SSPP. This impact evaluation will
- 16 -
analyze SSPP’s effect on girls’ school transition, retention, attendance and pro-gression rates. The implementation will largely follow the procedures established for implementing Phase I. The first disbursements will be made against attendance in Q2 of 2014 (i.e. the period from April to June of that year). SSPP-II will run for at least three years.
II. Evaluation Design
The pilot districts of Phase II will be at the center of a rigorous impact evaluation of SSPP. This impact evaluation will rely on an experimental setup and thus allow the identification of causal effects and cost-effectiveness of SSPP-II with respect to participation, progression and other key outcome variables.
The design of the impact evaluation builds on the selection of districts/tehsils de-scribed below and comprises of the following major steps: (i) selection and forma-tion of randomization units, (ii) blocking/stratifying of school clusters, (iii) random-ized assignment of school clusters, and (iv) randomized encouragement design for within-cluster variation. In more detail:
(i) Selection and formation of randomization units. Randomization will be at the “school cluster” level, where a “school cluster” will be defined as a girls’ secondary school and all feeder schools for girls offering grades 6-8 as well as their catchment mauzas. Whole clusters will be randomly assigned to ei-ther Treatment I or Treatment II or Control (i.e. if a cluster is assigned to a treatment, all schools in that cluster will receive this same treatment). School clusters will be formed according to manually collected data on the catchment areas of secondary schools as well as GPS data on schools and mauzas in the pilot districts of Phase II.
(ii) Blocking/stratifying of school clusters. Once school clusters are formed and validated, they will be stratified based on key metric(s) that determine out-come of interest and are important to understand from a policy and research viewpoint.
(iii) Randomized assignment of school clusters. 25 % of school clusters will be randomly assigned to Treatment 1, 25 % to Treatment 2 and the re-
- 17 -
maining 50% to Control. Half of the control group clusters could potentially be offered a different treatment in the next year or later if agreed. Random-ized assignment will either be performed with simple randomization or a more advanced procedure like matched quadruple randomization.
(iv) Randomized encouragement design for within-cluster variation: To in-troduce within-“school cluster” variation, a randomized encouragement de-sign is recommended. E.g., in every “school cluster” that is part of Treat-ment I, all mauzas will receive a standard “poster/banner” treatment but a certain portion of randomly selected mauzas will also receive a “community camp” that allows for face-to-face interaction and direct information sharing with parents. Since an awareness campaign is already envisaged, some vari-ation in the design of this campaign, its targeting and its content is a feasi-ble way to introduce within-“school-cluster” variation while staying within budget.
III. Targeted Schools
District and tehsil selection for Phase II of SSPP was based on the following crite-ria: prior existence of stipend program, rurality, low school participation, minimum overlap with branchless banking pilot and separation from Phase-I districts. Based on these criteria, Phase II of SSPP will extend the supplemental stipends program toall 18 tehsils in 6 districts, namely Rajanpur, Muzaffargarh, DG Khan, Rahimyar Khan, Lodhran and Layyah.
Functional Middle, High and Higher Secondary Schools for Girls in Rural locations of Rajanpur, Muzaffargarh, DG Khan, Rahimyar Khan, Lodhran and Layyahare eli-gible for the SSPP-II. Eligibility here means that they are eligible to be considered for randomization to either Treatment I or Treatment II or Control. The exact eligi-bility criteria for schools in the 6 districtsareas follows:
(i) Only schools designated as girls’ “middle”, “high” and “higher secondary” in the 2013-14 Annual School Census (ASC) are eligible for participation. This is irrespective of current enrollment.
- 18 -
(ii) Only girls’ middle, high and higher secondary that are designated as “rural” in the ASC are eligible for participation.
(iii) Only schools whose status in the ASC is “functional” are eligible. The only exceptions to this case is if a school is expected to become functional in the near future.
(iv) Schools designated as girls’ middle, high and higher secondary and lo-cation denoted as rural in ASC, but having non-zero male enrollment in grades 6-8, are still eligible.
(v) Schools designated as boys’ middle, high and higher secondary and location denoted as rural in ASC, but having non-zero female enrollment in grades 6-8, are not eligible. This exclusion is made for reasons of administrative ease.
A list of the 659 participating schools selected according to these five criteria can be found in Annex B.
APPENDIX B: LIST OF SCHOOLS District Tehsil School EMIS
CodeD. G. Khan DG KHAN GGHS CHOTI ZAREEN 32110007
- 19 -
D. G. Khan DG KHAN GGHS Sarwar Ali 32110046D. G. Khan DG KHAN GGHS SHADAN LUND 32110047D. G. Khan DG KHAN GGHS PAIGHA 32110056D. G. Khan DG KHAN GGHS YAROO KHOSA 32110057D. G. Khan DG KHAN GGHS PIR AADIL 32110058D. G. Khan DG KHAN GGHS SHAH SADAR DIN 32110059D. G. Khan DG KHAN GGHS SAKHI SARWAR 32110109D. G. Khan DG KHAN GGES QAZI WALA 32110110D. G. Khan DG KHAN GGES Makore Wala 32110114D. G. Khan DG KHAN GGHS Samina 32110115D. G. Khan DG KHAN GGES BASTI KHAKHI GHARBI 32110116D. G. Khan DG KHAN GGES Chanar Wala 32110117D. G. Khan DG KHAN GGHS Ali Wala 32110119D. G. Khan DG KHAN GGHS AHMADANI 32110120D. G. Khan DG KHAN GGHS GHOUS ABAD 32110121D. G. Khan DG KHAN GGES Basti Malana 32110123D. G. Khan DG KHAN GGHS KALA 32110124D. G. Khan DG KHAN GGES CHABRI BALA 32110127D. G. Khan DG KHAN GGES CHURATA NO. 3 32110128D. G. Khan DG KHAN GGES BASTI CLAIRY 32110129D. G. Khan DG KHAN GGES BASTI SHEIKHANI 32110131D. G. Khan DG KHAN GGES Bahadur Garh 32110132D. G. Khan DG KHAN GGES TIBBI ESRAN 32110133D. G. Khan DG KHAN GGES KOT DAUD MUZA MIRHATA 32110134D. G. Khan DG KHAN GGES MAMOORI 32110546D. G. Khan DG KHAN GGES QAIM WALA 32110548D. G. Khan DG KHAN GGES BASTI KHOSA 32110552D. G. Khan DG KHAN GGES KAPER SHAH 32110573D. G. Khan DG KHAN GGES JATOI WALA 32110614D. G. Khan DG KHAN GGES SAKHI SARWAR (B) 32110623D. G. Khan DG KHAN GGES Gago Sharif 32110626D. G. Khan DG KHAN GGES CHAK RAIMAN 32110638D. G. Khan DG KHAN GGES GHUMAN 32110649D. G. Khan DG KHAN GGES GUJAR WALA NO. 1 32110752D. G. Khan DG KHAN GGES CHAH MASOO KHAN 32110756D. G. Khan DG KHAN GGES MUHAMMAD KHAN HOTANI 32110809D. G. Khan DG KHAN GGES BASTI HOOT 32110822D. G. Khan DG KHAN GGES DAHOO 32110829D. G. Khan DG KHAN GGES JAHAN KHAN 32110844D. G. Khan DG KHAN GGHS KORA BHOUNCHRY 32111217D. G. Khan DG KHAN GGES Chan Masoori Wala 32111258D. G. Khan DG KHAN GGES KHALIL ABAD 32111271D. G. Khan DG KHAN GGES GADAI WALA NO. 2 32111295D. G. Khan DG KHAN GGES DADAY WALA 32111301D. G. Khan DG KHAN GGES RANJHAY WALI 32111359D. G. Khan DG KHAN GGES Bodla Farm 32111360D. G. Khan DG KHAN GGES BASTI ALYANI 32111362D. G. Khan DG KHAN GGHS KOT MUBARAK 32111427D. G. Khan KOT CHUTTA GGHSS Kot Chutta 32110008D. G. Khan KOT CHUTTA GGHS JHOKE UTTRA 32110048D. G. Khan KOT CHUTTA GGHSS MANA AHMADANI 32110049D. G. Khan KOT CHUTTA GGES NO. 3 CHOTI ZAREEN 32110111D. G. Khan KOT CHUTTA GGES NAWAN SHEHR 32110113D. G. Khan KOT CHUTTA GGES HAJI KAMAND 32110125D. G. Khan KOT CHUTTA GGES Bashir Tal Pur 32110558D. G. Khan KOT CHUTTA GGES GORISTANI WALA 32110579D. G. Khan KOT CHUTTA GGES BASTI BIRMANI 32111216D. G. Khan KOT CHUTTA GGHS NOTAK MAHMEED 32111403D. G. Khan TAUNSA GGHS KOT QAISRANI 32120030D. G. Khan TAUNSA GGHS TIBBI QAISRANI 32120031D. G. Khan TAUNSA GGHS LITRA 32120032D. G. Khan TAUNSA GGHS SOKAR 32120033
- 20 -
D. G. Khan TAUNSA GGHS BASTI BUZDAR 32120035D. G. Khan TAUNSA GGHS DAUNA 32120036D. G. Khan TAUNSA GGHS MAKWAL KALAN 32120037D. G. Khan TAUNSA GGHS HAIRO EAST 32120038D. G. Khan TAUNSA GGHS Mithy Wali 32120039D. G. Khan TAUNSA GGHS MANGROTHA EAST 32120040D. G. Khan TAUNSA GGHS KOT MOHEE 32120041D. G. Khan TAUNSA GGHSS NUTKANI 32120042D. G. Khan TAUNSA GGHS Jallu Wali 32120043D. G. Khan TAUNSA GGES BHUTTY WALI 32120089D. G. Khan TAUNSA GGES TUB 32120090D. G. Khan TAUNSA GGES MANGORTHA GHARBI 32120091D. G. Khan TAUNSA GGES BUGHLANI DEH 32120092D. G. Khan TAUNSA GGES HAIRO GHARBI 32120093D. G. Khan TAUNSA GGES BINDI 32120094D. G. Khan TAUNSA GGES BASTI PIR DEH 32120095D. G. Khan TAUNSA GGES NARI JANOOBI 32120096D. G. Khan TAUNSA GGES RETRA 32120097D. G. Khan TAUNSA GGES BAIT LADHA 32120098D. G. Khan TAUNSA GGES KORA KHAN 32120099D. G. Khan TAUNSA GGES BAMBHAN NO 1 32120464D. G. Khan TAUNSA GGES BODO NO. 1 32120476D. G. Khan TAUNSA GGES SHERGARH 32120478D. G. Khan TAUNSA GGES LAKHANI 32120511D. G. Khan TAUNSA GGES GADDI NO. 2 32120539D. G. Khan TAUNSA GGES BOHAR NO. 2 32120558D. G. Khan TAUNSA GGES TIBBA IMAM 32120653D. G. Khan TAUNSA GGES LISHARI NUTKANI 32120662D. G. Khan TAUNSA GGES MUHAMMADNI 32120724D. G. Khan TAUNSA GGES BASTI YASEEN 32120900D. G. Khan TAUNSA GGES KOHAR 32120901D. G. Khan TAUNSA GGHS DAIRA SHAH 32122040Leiah CHAUBARA GGHS CHAK NO. 377/TDA 32210009Leiah CHAUBARA GGHS Chak No. 330/TDA 32210022Leiah CHAUBARA GGES Chak No. 475/TDA 32210023Leiah CHAUBARA GGES Chak No. 413/TDA 32210024Leiah CHAUBARA GGES Chak No. 315/TDA 32210025Leiah CHAUBARA GGHSS NAWAN KOT 32210026Leiah CHAUBARA GGES Chak No. 344/TDA 32210027Leiah CHAUBARA GGES Chak No. 402/TDA 32210028Leiah CHAUBARA GGES Chak No. 492/TDA 32210029Leiah CHAUBARA GGES CHAK NO. 126/ML 32210030Leiah CHAUBARA GGHS CHAK NO. 408/TDA 32210032Leiah CHAUBARA GGHS CHAK NO. 347/TDA 32210033Leiah CHAUBARA GGES Chak No. 364/TDA 32210129Leiah CHAUBARA GGES Chak No. 314/TDA 32210150Leiah CHAUBARA GGES Chak No. 325/TDA 32210154Leiah CHAUBARA GGES CHAK NO. 373/TDA 32210161Leiah CHAUBARA GGES CHAK NO. 441/TDA 32210166Leiah CHAUBARA GGES Chak No. 411/TDA 32210177Leiah CHAUBARA GGES CHAK NO. 484/TDA 32210183Leiah CHAUBARA GGES ADDA MOCHI WALA 32210284Leiah CHAUBARA GGCMES 369-A/TDA 32210301Leiah KAROR LALISAN GGHS Sahu Wala 32220024Leiah KAROR LALISAN GGHS CHAK NO. 94/TDA 32220025Leiah KAROR LALISAN GGHS Chak No. 218/TDA 32220026Leiah KAROR LALISAN GGHS Bagh Wala 32220027Leiah KAROR LALISAN GGHS Chak No. 98/ML 32220028Leiah KAROR LALISAN GGHS Chak No. 90/ML 32220029Leiah KAROR LALISAN GGES Chak No. 101/TDA 32220050Leiah KAROR LALISAN GGHS Wara Sehran 32220051Leiah KAROR LALISAN GGES Gara Jan Muhammad 32220052
R. Y. Khan KHANPUR GGHS FATEH PUR KAMAL 31310030R. Y. Khan KHANPUR GGHS CHACHRAN SHARIF 31310031R. Y. Khan KHANPUR GGHS CHAK NO. 31/P BAGHO BAHAR 31310032R. Y. Khan KHANPUR GGHS CHAK NO. 7/P 31310033R. Y. Khan KHANPUR GGHS CHAK NO. 45/P 31310034R. Y. Khan KHANPUR GGES CHAK NO. 8/P 31310073R. Y. Khan KHANPUR GGHS NAWAN KOT 31310074R. Y. Khan KHANPUR GGES DIN PUR SHARIF 31310075R. Y. Khan KHANPUR GGES CHAK NO. 12/P JETHA BHUTTA 31310076R. Y. Khan KHANPUR GGHS GHARHI IKHTIAR KHAN 31310078R. Y. Khan KHANPUR GGHS KOTLI MURAD 31310080R. Y. Khan KHANPUR GGES KOTLA PATHAN 31310081R. Y. Khan KHANPUR GGES GHOUS PUR 31310082R. Y. Khan KHANPUR GGHS SEHJA 31310084R. Y. Khan KHANPUR GGES BASTI HAJI ABDULLAH 31310085R. Y. Khan KHANPUR GGHS Chak No. 121/1-L 31310087R. Y. Khan KHANPUR GGHS BASTI SHAIR MUHAMMAD 31310088R. Y. Khan KHANPUR GGES CHAK NO. 103/1-L 31310089R. Y. Khan KHANPUR GGES BASTI KHAN MUHAMMAD 31310090R. Y. Khan KHANPUR GGES CHAK 109/1-L 31310091R. Y. Khan KHANPUR GGES LALOO WALA NO. 1 31310359R. Y. Khan KHANPUR GGES BASTI PANWARAN 31310379R. Y. Khan KHANPUR GGES BASTI ABDUL SALAM 31310416R. Y. Khan KHANPUR GGES CHAK LALA 31310433R. Y. Khan KHANPUR GGES Chak No. 17/P 31310443R. Y. Khan KHANPUR GGES ATA MUHAMMAD PO DHANDO 31310505R. Y. Khan KHANPUR GGES MAKHAN BELA 31310510R. Y. Khan KHANPUR GGES SHER GERH PO ZAHIR PEER 31310513R. Y. Khan KHANPUR GGES CHAK NO. 35/P KHANPUR 31310531R. Y. Khan KHANPUR GGES CHAK NO. 63/P 31310548R. Y. Khan KHANPUR GGES DERA MUHAMMAD ISMAIL 31310561R. Y. Khan KHANPUR GGES CHAK NO. 94/NP 31310562R. Y. Khan KHANPUR GGES CHAK NO.120/1-L 31310577R. Y. Khan KHANPUR GGES CHAK NO.92/1-L 31310580R. Y. Khan KHANPUR GGES Chak No. 129/1-L 31310582R. Y. Khan KHANPUR GGES Chak No. 107 1-L 31310586R. Y. Khan KHANPUR GGES CHAK NO.10/P 31310599R. Y. Khan KHANPUR GGES KOT SHER MOHAMMAD 31310611R. Y. Khan KHANPUR GGES MUD BHOORA 31310618R. Y. Khan KHANPUR GGES MUHAMMAD KHAN 31310788R. Y. Khan KHANPUR GGES Chak No. 69/P 31310789R. Y. Khan KHANPUR GGES MUSA WALA 31310790R. Y. Khan KHANPUR GGES CHAK NO. 111/NP 31310791
- 28 -
R. Y. Khan KHANPUR GGES Moeen Abad 31310792R. Y. Khan KHANPUR GGES Chak No. 27/P 31310801R. Y. Khan KHANPUR GGES CHAK NO. 93/1-L 31310803R. Y. Khan KHANPUR GGES CHAK NO. 9/P 31310804R. Y. Khan KHANPUR GGHSS CHAK NO. 1/P 31310817R. Y. Khan KHANPUR GGHSS ZAHIR PIR 31310831R. Y. Khan KHANPUR GGES JHORAN 31310919R. Y. Khan R. Y. KHAN GGHS CHAK NO. 140/P 31330048R. Y. Khan R. Y. KHAN GGHS CHAK NO. 125/P 31330049R. Y. Khan R. Y. KHAN GGHS CHAK NO. 118/P 31330050R. Y. Khan R. Y. KHAN GGHS CHAK NO. 113/P 31330051R. Y. Khan R. Y. KHAN GGHS CHAK NO. 51/P 31330052R. Y. Khan R. Y. KHAN GGHS ABU ZAHBI COLONY NO 1 31330053R. Y. Khan R. Y. KHAN GGHSS TRANDA SAWAY KHAN 31330054R. Y. Khan R. Y. KHAN GGHS Chak No. 100/P 31330056R. Y. Khan R. Y. KHAN GGHS RAJAN PUR KALAN 31330057R. Y. Khan R. Y. KHAN GGHS FATEH PUR ARAIN 31330058R. Y. Khan R. Y. KHAN GGES HASSAN COLONY 31330108R. Y. Khan R. Y. KHAN GGES Ali Akbar Sanghi 31330112R. Y. Khan R. Y. KHAN GGES Chak No. 46/P 31330113R. Y. Khan R. Y. KHAN GGES Chak No. 47/P 31330114R. Y. Khan R. Y. KHAN GGES CHAK NO. 55/P 31330115R. Y. Khan R. Y. KHAN GGES Chak No. 82/P 31330116R. Y. Khan R. Y. KHAN GGES CHAK No. 86/P 31330117R. Y. Khan R. Y. KHAN GGES CHAK NO. 92/P 31330119R. Y. Khan R. Y. KHAN GGES MISSAN ABAD 31330121R. Y. Khan R. Y. KHAN GGHS ADAM WALI 31330122R. Y. Khan R. Y. KHAN GGES ABDULLAH PUR 31330128R. Y. Khan R. Y. KHAN GGHS CHAK NO. 143/P 31330129R. Y. Khan R. Y. KHAN GGES MALIK PUR 31330130R. Y. Khan R. Y. KHAN GGES BASTI SHARIF 31330131R. Y. Khan R. Y. KHAN GGES Rukan Pur 31330132R. Y. Khan R. Y. KHAN GGES Mianwali Sheikhan 31330133R. Y. Khan R. Y. KHAN GGHS SARDAR GARH 31330134R. Y. Khan R. Y. KHAN GGES Chak No. 110/P 31330136R. Y. Khan R. Y. KHAN GGES AMIN GARH 31330137R. Y. Khan R. Y. KHAN GGES MOUZA CHANNA 31330138R. Y. Khan R. Y. KHAN GGHS MAU MUBARAK 31330139R. Y. Khan R. Y. KHAN GGES Wahi Shah Mohammad 31330140R. Y. Khan R. Y. KHAN GGES BASTI QADIR BAKHSH BHAGWALA 31330141R. Y. Khan R. Y. KHAN GGES MAD NOOR KOT SAMABA 31330142R. Y. Khan R. Y. KHAN GGES TIBBI GUL MUHAMMAD 31330143R. Y. Khan R. Y. KHAN GGES Chak No. 78/P 31330145R. Y. Khan R. Y. KHAN GGES Chak No. 87/P 31330146R. Y. Khan R. Y. KHAN GGES CHAK NO. 99/P 31330147R. Y. Khan R. Y. KHAN GGES Chak No. 101/P 31330148R. Y. Khan R. Y. KHAN GGHS Chak No. 102/P 31330149R. Y. Khan R. Y. KHAN GGES MANZOOR ABAD 31330150R. Y. Khan R. Y. KHAN GGES KOT DARRI AZEEM KHAN 31330151R. Y. Khan R. Y. KHAN GGES CHAK NO. 126/P 31330152R. Y. Khan R. Y. KHAN GGES CHAK NO. 136/P 31330154R. Y. Khan R. Y. KHAN GGES CHAK NO. 137/P 31330155R. Y. Khan R. Y. KHAN GGES CHAK NO. 142/P 31330156R. Y. Khan R. Y. KHAN GGES CHAK NO. 144/P EAST 31330157R. Y. Khan R. Y. KHAN GGES CHAK NO. 114/P 31330158R. Y. Khan R. Y. KHAN GGES DERA SHAMAS 31330159R. Y. Khan R. Y. KHAN GGHS HASAN ABAD 31330160R. Y. Khan R. Y. KHAN GGES SHER ABAD 31330161R. Y. Khan R. Y. KHAN GGES CHAK NO. 133/P 31330533R. Y. Khan R. Y. KHAN GGES CHAK NO. 247/P 31330551R. Y. Khan R. Y. KHAN GGCMES MANZOOR ABAD (BINDOOR) 31330610R. Y. Khan R. Y. KHAN GGES CHAK NO. 106/P 31330646
- 29 -
R. Y. Khan R. Y. KHAN GGES BASHEER AHMED SANGHI 31330652R. Y. Khan R. Y. KHAN GGES Tranda Ali Murad 31330655R. Y. Khan R. Y. KHAN GGCMS DUNIYA PUR GANGA BASTI YAR MUHAMMAD 31330687R. Y. Khan R. Y. KHAN GGES ABDUL RAHMAN WEEHA 31330691R. Y. Khan R. Y. KHAN GGES ALLAH DITTA KHAN 31330717R. Y. Khan R. Y. KHAN GGES CHAK 80/P 31330748R. Y. Khan R. Y. KHAN GGES BASTI IMAM DIN 31330771R. Y. Khan R. Y. KHAN GGES TAJ GARH 31330828R. Y. Khan R. Y. KHAN GGES AZEEM BUKHSH DHAREEJA 31330829R. Y. Khan R. Y. KHAN GGES BADLI SHARIF 31330834R. Y. Khan R. Y. KHAN GGES ABAD PUR 31330836R. Y. Khan R. Y. KHAN GGHSS CHAK NO. 56/P 31331087R. Y. Khan R. Y. KHAN GGHS WAPDA SCORP RYK 31331088R. Y. Khan R. Y. KHAN GGPS Kot Karam Khan 31331099R. Y. Khan R. Y. KHAN GGCMES DARI ALI AKBAR SANGHI 31331107R. Y. Khan R. Y. KHAN GGHS MODEL ABU ZAHBI PALACE CHAK 55/P 31331200R. Y. Khan R. Y. KHAN GGHS MEHMOOD ABAD 31331221R. Y. Khan SADIQABAD GGHS Chak No. 195/P 31340031R. Y. Khan SADIQABAD GGHS Chak No. 146/P 31340032R. Y. Khan SADIQABAD GGHS Chak No. 156/P 31340034R. Y. Khan SADIQABAD GGHS Chak No. 158/P 31340035R. Y. Khan SADIQABAD GGHS Jamal Din Wali 31340037R. Y. Khan SADIQABAD GGHS BASTI HAMID ULLAH BHATTI 31340038R. Y. Khan SADIQABAD GGHS AHMAD PUR LAMMA 31340039R. Y. Khan SADIQABAD GGES GHARI BEGHAR 31340073R. Y. Khan SADIQABAD GGES Chak No. 120/P 31340075R. Y. Khan SADIQABAD GGES Chak No. 128/P 31340076R. Y. Khan SADIQABAD GGES Chak No. 238/P 31340077R. Y. Khan SADIQABAD GGES Chak No. 148/P 31340078R. Y. Khan SADIQABAD GGHS Chandrami 31340079R. Y. Khan SADIQABAD GGHS Chak No. 145/P 31340080R. Y. Khan SADIQABAD GGES Chak No. 160/P 31340082R. Y. Khan SADIQABAD GGES Chak No. 173/P 31340083R. Y. Khan SADIQABAD GGES Chak No. 193/P 31340084R. Y. Khan SADIQABAD GGES Chak No. 188/P 31340085R. Y. Khan SADIQABAD GGES BHONG SHARIF 31340086R. Y. Khan SADIQABAD GGES METHA DANDAM 31340087R. Y. Khan SADIQABAD GGES Meray Shah 31340088R. Y. Khan SADIQABAD GGES CHAK NO. 199/P 31340090R. Y. Khan SADIQABAD GGES Chak No. 197/P 31340091R. Y. Khan SADIQABAD GGES SUBZAL PO KOT SABZAL 31340092R. Y. Khan SADIQABAD GGES MUHAMMAD NAWAZ WASA 31340093R. Y. Khan SADIQABAD GGES FATTO WALL 31340094R. Y. Khan SADIQABAD GGES PEER BUKHASH PUNJABI 31340095R. Y. Khan SADIQABAD GGCMES MUHAMMAD PUR LAMMA 31340096R. Y. Khan SADIQABAD GGES ROSHAN BHAIT 31340097R. Y. Khan SADIQABAD GGHS BASTI KAMAM 31340098R. Y. Khan SADIQABAD GGES Chak No. 25/NP 31340099R. Y. Khan SADIQABAD GGES Walana 31340100R. Y. Khan SADIQABAD GGES Chak No. 164/P 31340421R. Y. Khan SADIQABAD GGES Chak No. 151/P 31340423R. Y. Khan SADIQABAD GGES Chak No. 119/P 31340424R. Y. Khan SADIQABAD GGES WALHAR PO WALHAR 31340575R. Y. Khan SADIQABAD GGES Chak No. 7/NP 31340584R. Y. Khan SADIQABAD GGHS CHAK NO. 11/NP 31340586R. Y. Khan SADIQABAD GGES MALIK WAHID BUX 31340589R. Y. Khan SADIQABAD GGES SHAH PUR 31340612R. Y. Khan SADIQABAD GGES KOTLA HAYAT 31340618R. Y. Khan SADIQABAD GGES Bhutta Wahan 31340634R. Y. Khan SADIQABAD GGES Shahbaz Pur 31340652R. Y. Khan SADIQABAD GGCMES SONA GOTH 31340902Rajanpur JAMPUR GGHS Kotla Mughalan 32410018
- 30 -
Rajanpur JAMPUR GGHS Haji Pur 32410019Rajanpur JAMPUR GGHS Rasool Pur 32410020Rajanpur JAMPUR GGHS BASTI CHINA 32410021Rajanpur JAMPUR GGHS MUHAMMAD PUR 32410022Rajanpur JAMPUR GGHS Noshera Gharbi 32410023Rajanpur JAMPUR GGHS Harrand 32410025Rajanpur JAMPUR GGHS Kot Tahir 32410043Rajanpur JAMPUR GGES Saleem Abad 32410044Rajanpur JAMPUR GGES Allah Abad 32410045Rajanpur JAMPUR GGES Mastoi Wala 32410047Rajanpur JAMPUR GGES BASTI TUFQI 32410048Rajanpur JAMPUR GGES TIBBI LUNDAN 32410049Rajanpur JAMPUR GGES LAL GARH 32410050Rajanpur JAMPUR GGES Bukhara Shareef 32410051Rajanpur JAMPUR GGCMES KOTLA DEWAN 32410360Rajanpur JAMPUR GGES BASTI AWAN 32410378Rajanpur JAMPUR GGES MUD JAM DUR MUHAMMAD 32410428Rajanpur JAMPUR GGES Meeran Pur 32410434Rajanpur JAMPUR GGCMES TATAR WALA 32410563Rajanpur RAJANPUR GGHS SIKHANI WALA 32420017Rajanpur RAJANPUR GGHS Shikar Pur 32420020Rajanpur RAJANPUR GGHS KOTLA NASEER 32420021Rajanpur RAJANPUR GGES KOTLA SHER MUHAMMAD 32420039Rajanpur RAJANPUR GGES Mehry Wala 32420040Rajanpur RAJANPUR GGHS Wang 32420041Rajanpur RAJANPUR GGHS MURGHAI 32420042Rajanpur RAJANPUR GGES Pati Juma Arain 32420044Rajanpur RAJANPUR GGES KOTLA MALAM 32420046Rajanpur RAJANPUR GGES Hazrat Wala 32420047Rajanpur RAJANPUR GGES KOTLA ESAN 32420049Rajanpur RAJANPUR GGES Kotla Androon 32420271Rajanpur RAJANPUR GGES Noshera Sharqi 32420276Rajanpur RAJANPUR GGES NIZAM ABAD 32420287Rajanpur RAJANPUR GGES SAHAN WALA 32420308Rajanpur RAJANPUR GGES CHAH LAL KHAN 32420311Rajanpur RAJANPUR GGES BASTI PHALI 32420343Rajanpur RAJANPUR GGES Bukhari Shareef 32420345Rajanpur RAJANPUR GGES RAQBA NABI SHAH 32420446Rajanpur ROJHAN GGES MIRAN PUR 32430017Rajanpur ROJHAN GGHS BHAGSAR 32430018Rajanpur ROJHAN GGES KOTLA HUSSAIN SHAH 32430019Rajanpur ROJHAN GGES MOLVI MACHIAN 32430174Rajanpur ROJHAN GGCMES SHAUKAT ABAD 32430177 APPENDIX C: LIST OF MAUZAS AND SETTLEMENTS DISTRICT TEHSIL MAUZA SETTLEMENT NAMEDG Khan DG KHAN AGANI SHAHNI BASTI AHMAD WALIDG Khan DG KHAN ALI WALA BASTI ALI WALADG Khan DG KHAN CHHABRI BALA BASTI JAAN WALADG Khan DG KHAN CHORAHTTA BASTI PUL PAYARE WALIDG Khan DG KHAN CHORAHTTA BASTI PUL PAYARE WALIDG Khan DG KHAN CHORAHTTA PACHADH BASTI CHORAHTTA PACHADHDG Khan DG KHAN GHUMMAN BASTI BANGALI (S)DG Khan DG KHAN JARWAR BASTI KHO IMAM BAKSHDG Khan DG KHAN JATOI WALA BASTI CHAH KHOSAY WALADG Khan DG KHAN KAPER SHAH BASTI KAPPAR SHAHDG Khan DG KHAN LADAN BASTI JHANG WANIDG Khan DG KHAN Meeran BASTI MEERANDG Khan DG KHAN NOOR WAH BASTI JANDANIDG Khan DG KHAN NOOR WAH BASTI ZANGALANI
11 This settlement could not be visited during the baseline survey because of flooding. The random walk procedure described in Appendix D is to be used to draw 10 ‘eligible’ households.
RY Khan Muhammad Pur Quershian Basti Haji Allah Ditta
Rahim Yar Khan
RY Khan Murtaza Abad Basti Pasan Wali
Rahim Yar Khan
RY Khan Nabi Pur Basti Ghous Bakhsh
Rahim Yar Khan
RY Khan Nonu Shaheed Nonu Shaheed Khas
Rahim Yar Khan
RY Khan Rang Pur Basti Faqeer Bakhsh Rongha
Rahim Yar Khan
RY Khan Roshan Abad BASTI KOT SHAHBAZ
Rahim Yar Khan
RY Khan ROSHAN ABAD BASTI SHEIKH WAHAN JADID
Rahim Yar Khan
RY Khan ROSHAN ABAD DERA ALLAH DIWAYA SHAH
Rahim Yar Khan
RY Khan Talay Wali Basti Shar
Rahim Yar Khan
RY Khan Tranda Saway Khan Basti Azeem Colony
Rahim Yar RY Khan Tranda Saway Khan Basti Niaz Town
- 40 -
KhanRahim Yar Khan
RY Khan Wahkohna Basti Masay Puria
Rahim Yar Khan
Sadiqabad AliPur BASTI KAMAM
Rahim Yar Khan
Sadiqabad ALLAH ABAD BASTI ALLAH ABAD
Rahim Yar Khan
Sadiqabad BHONG BASTI BHONG
Rahim Yar Khan
Sadiqabad Chak 154/P BASTI MIAN DARA
Rahim Yar Khan
Sadiqabad Chak 178/P Chak 178/P
Rahim Yar Khan
Sadiqabad Chak 234/P Chak 234P
Rahim Yar Khan
Sadiqabad Chak No. 17/NP Basti Noor Ahmad
Rahim Yar Khan
Sadiqabad Chak No. 200 P BASTI CHAK 200 TIBBA
Rahim Yar Khan
Sadiqabad Chak No. 29/NP Basti 29/NP
Rahim Yar Khan
Sadiqabad Chak No. 5-A/NP BASTI DHAREJA
Rahim Yar Khan
Sadiqabad Chak No. 9/NP BASTI KHOKHAR COLONY
Rahim Yar Khan
Sadiqabad CHANDRAMI BASTI CHANDRAMI
Rahim Yar Khan
Sadiqabad JAFFAR PUR BASTI JAFFAR PUR
Rahim Yar Khan
Sadiqabad KACHA BHUTA BASTI KACHA BHATA
Rahim Yar Khan
Sadiqabad KOT FAQIRA BASTI WLAYA
Rahim Yar Khan
Sadiqabad KOT SABZAL Basti Ghullam Haider
Rahim Yar Khan
Sadiqabad KOT SABZAL Basti Haji Arain Colony
Rahim Yar Khan
Sadiqabad MUHAMMAD NAWAZ WASA BASTI JAM UMAR
Rahim Yar Khan
Sadiqabad PANDAT DARI PANDAT DARI
Rahim Yar Khan
Sadiqabad RANAG PUR BASTI MOTHA
Rahim Yar Khan
Sadiqabad TOHLA (Tawayla) BASTI TALHA
Rajanpur Jampur BHAMBA BASTI SOMARajanpur Jampur CHAK CHEENA BASTI GULFADRajanpur Jampur GARKENA WAZEERI BASTI AHMAD KHORajanpur Jampur HAJOO (JALWA) BASTI M JAFERRajanpur Jampur JHOK MAKWAL BASTI A GHANIRajanpur Jampur KOTLA DEWAN BASTI GHULAM SARWARRajanpur Jampur MUHAMMAD PUR NO. 2 BASTI GULAM HUSSAINRajanpur Jampur SIRLA BASTI MARAD BUKSHRajanpur Jampur TITAR WALI BASTI BOPER WALARajanpur Rajanpur CHAK DARISHAK BASTI ALLAH WSAYEARajanpur Rajanpur CHAK HULWANI BASTI FAIZ AHMEDRajanpur Rajanpur CHAK HULWANI BASTI KHADAM HUSSAINRajanpur Rajanpur CHAK PATYAT BASTI AWANRajanpur Rajanpur Dera Jeevan Khan Basti Ghulam AliRajanpur Rajanpur DHAGGO BASTI MALANARajanpur Rajanpur HAMOO WALA BASTI ABDUL HAMID BOSANRajanpur Rajanpur HAMOO WALA BASTI TALIB HUSSAN KAMBARNIRajanpur Rajanpur KOT BAHADUR BASTI HAMZA ABADRajanpur Rajanpur KOT BAHADUR BASTI MASTER AZEEM AREN
- 41 -
Rajanpur Rajanpur Kot Mithan Katcha BASTI GOTH MITHAN KACHARajanpur Rajanpur KOTLA HAZOORI BASTI GHULAM NABIRajanpur Rajanpur KOTLA HUSSAIN BASTI AHMED NAJAR GOPANGRajanpur Rajanpur KOTLA MURTAZA SHAH BASTI HAZOOR BUKSHRajanpur Rajanpur KOTLA MURTAZA SHAH BASTI MONO KHAN SAJRANIRajanpur Rajanpur KOTLA SHER MUHAMMAD PACCA BASTI AHMED KHANRajanpur Rajanpur KOTLA SHER MUHAMMAD PACCA BASTI SARWAR RASOGERajanpur Rajanpur MIRZA PUR BASTI MUHAMMAD RAFIQ JARRajanpur Rajanpur QASIMPUR BASTI DUR MUHAMMADRajanpur Rajanpur RAJANPUR NO 2 BASTI AWANRajanpur Rajanpur RAJANPUR NO 2 BASTI AWANRajanpur Rajanpur RAKH BANGLA DHEGAN BASTI CHUDERI LAQATERajanpur Rajanpur RAKH BANGLA DHEGAN BASTI LASHARIRajanpur Rajanpur RAKH SEHNWALA BASTI ALLAH BACHAYARajanpur Rajanpur SHIKAR PUR BASTI JAMALRajanpur Rajanpur WANG BASTI DATTI WALARajanpur Rajanpur WANG BASTI FAREED BUKSHRajanpur Rajanpur WANG BASTI JANJOEYA COLONYRajanpur Rojhan Bhagsar Basti Abdul Ghani ArainRajanpur Rojhan Chak Dilbar Basti Hayat SarganiRajanpur Rojhan Chak Dilbar Basti Master Ghulam HaiderRajanpur Rojhan Chak Tariqabad Basti HairanRajanpur Rojhan Thul Naseer Basti Thul Naseer
APPENDIX D: RANDOM WALK SAMPLING
The random walk method described here follows the EPI Cluster Survey of the World Health Organization and UNICEF’s Handbook ‘Monitoring Progress toward the Goals of the World Summit for Children’. It includes two separate steps. The first is to choose a starting point per settlement and the second to select households to be surveyed from that point onward.
Field workers should follow the following steps for selecting the starting point within each settlement:
1. Go to some central location within the settlement. This could be a market, a church, a health facility or the junction between two roads. If possible, find a local guide who can accompany you. He/she can introduce you to the families and help you find the households and the community boundaries.
2. Select a direction at random by spinning a bottle. Move in a straight line in this direction. Count all the houses you pass until you reach the edge of the settlement. If possible, number each house with chalk as you go.
- 42 -
3. Pick one of these numbered houses at random to form the starting point for the survey.
These steps should be followed to select 10 ‘eligible’ households per settlement:
1. The household nearest to the starting point should be the first to be included.
2. Spin a bottle or flip a coin to decide in which direction you should move after that. If you are uncertain about which way to move, use a random selection process to decide which household to interview (e.g. flip a coin).
3. Follow a road or a path to identify the next households to be interviewed. In-stead of selecting consecutive households, always interview one household and then skip one; interview another one and skip the next; and so on. Be sure not to leave out families living away from the main roads.
4. Continue this way until you have reached 10 ‘eligible’ households. I you reach the edge of the settlement before you have reached 10 ‘eligible’ households, again spin a bottle or flip a coin to decide in which direction to move next. Continue until you have reached 10 ‘eligible’ households.
5. If there are less than 10 ‘eligible’ households in a settlement, interview all ‘eligible’ households in the settlement.
For each mauza and settlement, the random walk sampling should be documented according to Template 1.
Template 1
District
Tehsil
Mauza
Settlement
Central Location
Edge of Settlement
Number of Houses between Central
Location and Edge of Settlement
Random Pick
Starting Point
Lat.
Long.
Lat.
Long.
Lat.
Long.
- 43 -
APPENDIX E: COLLECTING PANEL DATA
The households interviewed in the first follow-up round will be the same households that were interviewed in the baseline round – i.e. the household surveys are envisaged as panel household surveys. To ensure high quality and robustness of the impact evaluation of SSPP-II, it is imperative that an overwhelming proportion of households interviewed in the baseline survey will also be interviewed in the follow-up survey. The following six-step procedure is meant to assure this will indeed be the case.
1. Field workers are to be provided with the following information to identify panel households: Date of baseline interview, district name, tehsil name, union council name, mauza name, settlement name, house address, house GPS coordinates, name of household head, name of respondent of the baseline survey, names of other household members and mobile phone number provided in the baseline survey. With this information, field workers are to drive to the assigned settlement and use their GPS device to find the assigned household. There, they are to use the information provided to them to corroborate that they are indeed talking to the correct household. Note that the household composition might have changed since the baseline survey.12 In case of discrepancies or ambiguities, these are to be noted in writing and supervisors are to be informed.
2. As a further check as to whether field workers have approached the correct household, they are to have the household head or another adult over the age of 18 available to be interviewed verify whether the household has resided at this place since at least the date of the baseline interview. If the respondent reports that the household has resided at this place since at least the date of the baseline interview, the field workers are to commence the interview. In case no adult over the age of 18 is available to be
12 As a change in household composition might be a sensitive topic, it is to be approached with care and tact.
- 44 -
interviewed on the initial visit, field workers are to return to the household later to ensure that it can be included in the follow-up sample.
3. If the respondent reports that the household has moved to this place since the date of the baseline interview or if there are irreconcilable discrepancies or ambiguities in the information provided to the field workers or on the ground, this is to be noted in writing, supervisors are to be informed and interview is not to be conducted.13 Rather, field workers are to use all justifiable means to identify the current location of the household that was interviewed for the baseline survey. Such means are to include but need not be limited to
Calling mobile phone numbers provided at baseline.14
Using publicly available databases. Inquiring with dwellings’ current residents, neighbors and other
knowledgeable individuals in the respective settlement.
4. It is imperative that an overwhelming proportion of households that moved residences between the baseline and follow-up survey will be interviewed in the follow-up survey. In case such households’ new location can be identified and their new location is inside the Province of Punjab, field workers are to travel to this new location in order to conduct follow-up interviews.
5. If a household’s new location can absolutely not be identified or it is determined that it lies outside the Province of Punjab or if the household does not consent in conducting a follow-up interview, the random-walk procedure described in Appendix D is to be used to draw a replacement household in the same settlement as the one where the household was initially located.
13 In case only the GPS coordinates and a household’s address collected at baseline are at odds, an interview can still be conducted as long as sufficient information (e.g. names of household members combined with household address) all a verficiation that the respective household is indeed a panel household.14 The survey firm is free to use the mobile phone numbers provided at baseline to contact households interviewed at baseline before field workers are being send out to conduct follow-up interviews. However, a failure to reach a household by phone or ambiguities about whether the correct household answers the phone does not release the survey firm from conducting an in-person field visit.
- 45 -
6. Supervisors are not to provide CNIC numbers recorded as part of the baseline data collection to field workers. Instead, supervisors are to check whether CNIC numbers recorded as part of the follow-up survey are consistent with those on file. In case of any disparities these are to be noted in writing and supervisors are to make inquiries regarding whether inconsistencies can be explained. If yes, these explanations are again to be noted in writing. If not, field workers are to return to the respective settlement and identify the correct household so that it can be included in the follow-up sample.