IPUMS-International: high precision, household census samples integrated cross-nationally and chronologically * * * Robert.

IPUMS-International: high precision, IPUMS-International: high precision, household census samples integrated household census samples integrated cross-nationally and chronologicallycross-nationally and chronologicallywww.ipums.org/international

* * ** * *Robert McCaaRobert McCaa

Professor Emeritus of Population History, University of MinnesotaProfessor Emeritus of Population History, University of [email protected]

for additional details, please seefor additional details, please see::www.hist.umn.edu/~rmccaa/ipums-globalwww.hist.umn.edu/~rmccaa/ipums-global

1

Outline Outline

1.1. IPUMS-International: a global collaboratory, 1999- IPUMS-International: a global collaboratory, 1999- 5 slides 5 slides

2.2. UK: Users, Usage, SARs, and a planUK: Users, Usage, SARs, and a plan 22

3.3. 62 countries, 185 samples plus 20-25 annually62 countries, 185 samples plus 20-25 annually 3 3

4.4. Integrated census microdata and metadata Integrated census microdata and metadata Dynamic metadata Dynamic metadata 5 5

5.5. Impact: Teaching and ResearchImpact: Teaching and Research 5 5

6.6. Conclusion: InvitationConclusion: Invitation 11

2

1. IPUMS-International, a global 1. IPUMS-International, a global collaboratory to preserve, integrate and collaboratory to preserve, integrate and

disseminate high-precision census samples;disseminate high-precision census samples;90+ National Statistical Offices participate 90+ National Statistical Offices participate

See handouts:See handouts: Brochure for list of participating statistical offices, census Brochure for list of participating statistical offices, census

microdata available, and info on IPUMS-Internationalmicrodata available, and info on IPUMS-International

3

MPC assumes responsibilities and risks for integrating & MPC assumes responsibilities and risks for integrating & disseminating microdata and metadata (as CCSR for UK) disseminating microdata and metadata (as CCSR for UK)

» Uniform Memorandum of Understanding Uniform Memorandum of Understanding » Founding partners (2001): France, Spain, China, Vietnam, Kenya, Founding partners (2001): France, Spain, China, Vietnam, Kenya,

Colombia, Mexico, USA … now 97 countries …Colombia, Mexico, USA … now 97 countries …including UK (2004)including UK (2004)

» Specifies conditions for entrusting microdata and for accessSpecifies conditions for entrusting microdata and for access

» Uniform license agreement: transparent, democratic access Uniform license agreement: transparent, democratic access for qualified researchers and students for qualified researchers and students » Over 4,500 registered researchers in 90+ countries Over 4,500 registered researchers in 90+ countries

» Hundreds of publications (click Hundreds of publications (click http://bibliography.ipums.org & select & select “IPUMS-International”)“IPUMS-International”)

» NSOs—many formerly paralyzed by fear—are relieved to be NSOs—many formerly paralyzed by fear—are relieved to be freed of risks, responsibilities, and the work!freed of risks, responsibilities, and the work!

4

IPUMS-International: a global collaboratoryIPUMS-International: a global collaboratorydark greendark green = integrated and disseminating = integrated and disseminating 2002-2011 2002-2011

** 62 countries, 185 samples, 397 millon person records **** 62 countries, 185 samples, 397 millon person records **medium green = integrating. medium green = integrating. Light green = negotiatingLight green = negotiating

2015: 80 countries, 250 samples integrated2015: 80 countries, 250 samples integrated

Mollweide projection

Microdata

Disseminating

Integrating None entrusted

None inventoried

Invitation Invitation to to

Register Register and Use and Use

5

Europe Mirror Site: Europe Mirror Site: http://www.iecm-project.org

6

6 steps6 steps usingusing www.ipums.org/international:www.ipums.org/international:

2a. Study documentation2a. Study documentation2b. Create extract2b. Create extract

3. Receive email; 3. Receive email; logon with p/wordlogon with p/word

4. Download 4. Download extract (SSL extract (SSL encrypted)encrypted)

5. UnZip data5. UnZip data

1. Login with 1. Login with passwordpassword

6. Analyze 6. Analyze using favored using favored softwaresoftware

2. UK Users, Usage, SARs and IPUMS2. UK Users, Usage, SARs and IPUMS

9

~5k Users: UK ranks #2~5k Users: UK ranks #2 ~800 institutions, top 40: 2 UK – Sussex and LSE~800 institutions, top 40: 2 UK – Sussex and LSE ~25k extracts, by country: UK ranks #30 …~25k extracts, by country: UK ranks #30 …

• UK samples in IPUMS (H-SARs 91, SARs 01) are not UK samples in IPUMS (H-SARs 91, SARs 01) are not comparable, and are relatively poor in contentcomparable, and are relatively poor in content

• Do not despair: ONS-UK has agreed, in principle, to a Do not despair: ONS-UK has agreed, in principle, to a plan to construct a uniform series of high precision plan to construct a uniform series of high precision household samples for 1961-2001household samples for 1961-2001

~900k variables extracted, 33 most popular variables~900k variables extracted, 33 most popular variables

• Note MOMLOC, SPLOC—require household samplesNote MOMLOC, SPLOC—require household samples

• 1/3 use “Attach Characteristics”—require hhld. samples1/3 use “Attach Characteristics”—require hhld. samples

Usage StatisticsUsage Statistics

10

Good news from ONS: plan to assemble a completeGood news from ONS: plan to assemble a completeseries of high precision household samples, 1961-2001series of high precision household samples, 1961-2001

3. 62 countries, 185 samples available now; 3. 62 countries, 185 samples available now; 20-25 samples integrated annually 20-25 samples integrated annually

See handout:See handout: Card for list of available samples, density, and # of person Card for list of available samples, density, and # of person

records by country and census yearrecords by country and census year

12

397 million integrated person records in 185 samples, 397 million integrated person records in 185 samples,

representing 62 countries (Jun 2011)representing 62 countries (Jun 2011) Annually, new samples for 6-8 countries are incorporatedAnnually, new samples for 6-8 countries are incorporated Samples for 2010 round censuses have highest prioritySamples for 2010 round censuses have highest priority Hundred of variables are integrated:Hundred of variables are integrated:

DemographyDemography EducationEducation Work and incomeWork and income Migration, immigrationMigration, immigration DisabilityDisability DwellingsDwellings

IPUMS-International: IPUMS-International: Census samples for research and policy makingCensus samples for research and policy making

Universal population coverageUniversal population coverage High precision, confidentialized samples—most drawn to High precision, confidentialized samples—most drawn to

IPUMS-International specificationsIPUMS-International specifications Samples—microdata and metadata—are integrated: Samples—microdata and metadata—are integrated:

identical concepts have the same codes in all samplesidentical concepts have the same codes in all samples   Analyze: Analyze:

• People in household context: employment, education, etc. People in household context: employment, education, etc. 

• Fertility and mortality: own-child method (implicit, requires Fertility and mortality: own-child method (implicit, requires no fertility module)  no fertility module) 

• Migration, immigration, language, ethnicity, religion  Migration, immigration, language, ethnicity, religion 

• Household sanitation variables (water supply, toilet, and Household sanitation variables (water supply, toilet, and waste disposal, rooms)waste disposal, rooms)

IPUMS-I SamplesIPUMS-I Samples

1.1. Open metadata system: universal, free accessOpen metadata system: universal, free access

2.2. Dynamic, integrated metadata system to compare text of Dynamic, integrated metadata system to compare text of any question for any combination of countries and censusesany question for any combination of countries and censuses

3.3. Microdata integrated: cross-nationally and chronologicallyMicrodata integrated: cross-nationally and chronologically

4.4. Custom-tailored extracts constructed by each researcher: Custom-tailored extracts constructed by each researcher: • Select country/ies, census/es, variables, sub-populations, sample sizeSelect country/ies, census/es, variables, sub-populations, sample size

5.5. Pointer variables (momloc, poploc, sploc; also –rule): Pointer variables (momloc, poploc, sploc; also –rule): parent-child and spouse links.parent-child and spouse links.

6.6. Attach characteristics: of parents to children and spouses Attach characteristics: of parents to children and spouses to spousesto spouses

• Facilitates relational analysis with no programming requiredFacilitates relational analysis with no programming required

7.7. And much more… And much more…

IPUMS-International Value-Addeds: IPUMS-International Value-Addeds:

15

4. IPUMS-International open-access, 4. IPUMS-International open-access, integrated, dynamically generated,integrated, dynamically generated,

<ddi> <ddi> compatible metadata compatible metadata (copies shared with NSO partners and World Bank IHSN)(copies shared with NSO partners and World Bank IHSN)

See, p. 3: See, p. 3: 2011: “IPUMS-International: Free, Worldwide Microdata Access Now for Censuses of 62

Countries--80 by 2015,” 58th International Statistical Institute, Dublin, Ireland, 21-26 August.

.

16

User registration, conditions of use licenseUser registration, conditions of use license

Browse (metadata) and select dataBrowse (metadata) and select data

Link to Official Statistical Agency home pagesLink to Official Statistical Agency home pages

View sample descriptions (integrated View sample descriptions (integrated metadata)metadata)

Download data extract (and Download data extract (and <ddi> <ddi> codebook)codebook)

Bibliography: view cites, link to publicationsBibliography: view cites, link to publications

17

18

Metadata are integrated, open access, dynamically Metadata are integrated, open access, dynamically constructed. Example: Marital Statusconstructed. Example: Marital Status

IntegratedIntegratedIPUMS-I IPUMS-I

Metadata:Metadata:Codes and Codes and

FrequenciesFrequencies

Detailed, Detailed, Case-Count Case-Count

ViewView

2 rules:2 rules:1. Retain 1. Retain detailsdetails

2. Harmonize 2. Harmonize everythingeverything

IPUMS integration empowers the researcher to IPUMS integration empowers the researcher to make informed research decisionsmake informed research decisions

19

IntegratedIntegratedIPUMS-I IPUMS-I

Metadata:Metadata:Enumeration Enumeration

texttext

View text in View text in English for English for

any any combination combination of countries of countries

and censuses. and censuses.

2 documents:2 documents:1. Form1. Form

20

IntegratedIntegratedIPUMS-I IPUMS-I

Metadata:Metadata:Enumeration Enumeration

texttext

View text in View text in English for English for

any any combination combination of countries of countries

and censuses. and censuses.

2 documents:2 documents:1. Form1. Form

2. Instructions2. Instructions

scroll down scroll down for morefor more

21

5. Impact: teaching and research5. Impact: teaching and research

22

1.1. Free, easy access to data for many countries and censusesFree, easy access to data for many countries and censuses2.2. Large sample sizes: Large sample sizes: • Make it possible to include many different variables in a Make it possible to include many different variables in a

regression… multi-level model…regression… multi-level model…• Produce separate estimates for population sub-groupsProduce separate estimates for population sub-groups• Easy to extract samples with a target sample size (e.g., 50mb)Easy to extract samples with a target sample size (e.g., 50mb)• Easy to revise an extract for a larger size or to include more Easy to revise an extract for a larger size or to include more

countries, censuses, variables or sub-populationscountries, censuses, variables or sub-populations3.3. Students show a great deal of creativity in using IPUMS-IStudents show a great deal of creativity in using IPUMS-I4.4. Skills acquired have an immediate pay-off when applying for Skills acquired have an immediate pay-off when applying for

jobs (e.g., World Bank), graduate school, etc.jobs (e.g., World Bank), graduate school, etc.

““IPUMS-I is an excellent resource for teaching…” IPUMS-I is an excellent resource for teaching…” -- -- David Lam, President, Population Association America David Lam, President, Population Association America

Research: What are integrated census samples used for? Research: What are integrated census samples used for? see http://bibliography.ipums.orgsee http://bibliography.ipums.org

Or: www.scholar.google.com Or: www.scholar.google.com IPUMS-International + key-word: subject, country, etc.IPUMS-International + key-word: subject, country, etc.

Research Topics—amazingly diverseResearch Topics—amazingly diverse

» Economists:Economists:» Comparative study of labor force participationComparative study of labor force participation» Demand and supply of public services (water, electricity, sewage, etc.)Demand and supply of public services (water, electricity, sewage, etc.)» Economic impact of family planning and fertility declineEconomic impact of family planning and fertility decline» Brain drain, brain gainBrain drain, brain gain» Econometric analysis of labor force and incomeEconometric analysis of labor force and income» Effect of long-term youth unemploymentEffect of long-term youth unemployment» Effects of volume of human capital on returns to educationEffects of volume of human capital on returns to education» Human capital and agingHuman capital and aging» Impact of trade policies on growth, development, immigration, labor Impact of trade policies on growth, development, immigration, labor

markets, and inequalitymarkets, and inequality» Etc.Etc.

Vital registration data: among births to Arab parents in Vital registration data: among births to Arab parents in Michigan, prenatal exposure to Ramada fasting Michigan, prenatal exposure to Ramada fasting

• lower birth weightlower birth weight• first month of gestation, fewer male birthsfirst month of gestation, fewer male births

IPUMS-International census samples, Uganda 02 (n = 80k IPUMS-International census samples, Uganda 02 (n = 80k Muslims), Iraq 97 (250k) --disability, religion, month of birth.Muslims), Iraq 97 (250k) --disability, religion, month of birth.Long term “fetal origins” effect, where early pregnancy Long term “fetal origins” effect, where early pregnancy overlapped with Ramadan:overlapped with Ramadan:

• adults 20% more likely to be disabledadults 20% more likely to be disabled• effects are larger for mental (learning) disabilitieseffects are larger for mental (learning) disabilities• relatively mild prenatal exposures can have persistent effectsrelatively mild prenatal exposures can have persistent effects

““maternal behavior, particularly during the first month of maternal behavior, particularly during the first month of pregnancy, can have permanent impacts on offspring health”pregnancy, can have permanent impacts on offspring health”

Impact: Ramadan fasting and fetal healthImpact: Ramadan fasting and fetal healthD. Almond & B. Mazumder “Health Capital and the Prenatal Environment:D. Almond & B. Mazumder “Health Capital and the Prenatal Environment:

The Effect of Ramadan Observance During Pregnancy”The Effect of Ramadan Observance During Pregnancy”American Economic Journal (2011)American Economic Journal (2011)

6. Invitation to use IPUMS-International 6. Invitation to use IPUMS-International census samplescensus samples

28

1. Use data responsibly:1. Use data responsibly: a. Respect confidentiality.a. Respect confidentiality. b. Share data only with registered users.b. Share data only with registered users. c. Secure data from unregistered users. c. Secure data from unregistered users. 2. Analyze data carefully:2. Analyze data carefully: a. Apply weights where appropriate.a. Apply weights where appropriate. b. Use proper methods.b. Use proper methods. c. Report results accuratelyc. Report results accurately3. Support NSOs and IPUMS-International3. Support NSOs and IPUMS-International a. Cite NSOs and IPUMS in publicationsa. Cite NSOs and IPUMS in publications b. Register citations in IPUMS bibliographyb. Register citations in IPUMS bibliography c. Report data errors to [email protected]. Report data errors to [email protected]

Thank youThank you

[email protected]@umn.edu

30