Top Banner
Survey Metadata Survey Metadata Documentation Documentation Sue Ellen Hansen, Gina-Qian Cheung, Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen Pennell, Marsha Skoman Beth-Ellen Pennell, Marsha Skoman ISR ISR Janet Harkness, Peter Ph. Mohler Janet Harkness, Peter Ph. Mohler ZUMA ZUMA IASSIST 2005 IASSIST 2005 Edinburgh Edinburgh
17

Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

Dec 19, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

Survey Metadata Survey Metadata DocumentationDocumentation

Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Grant Benson, Ashley Bowers, Karl Dinkelmann,

Youhong Liu, Beth-Ellen Pennell, Marsha Skoman Youhong Liu, Beth-Ellen Pennell, Marsha Skoman ISRISR

Janet Harkness, Peter Ph. MohlerJanet Harkness, Peter Ph. MohlerZUMAZUMA

IASSIST 2005IASSIST 2005EdinburghEdinburgh

May 25, 2005May 25, 2005

Page 2: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

2

GoalsGoals

• Collect sufficiently detailed data about the survey design and implementation process: Facilitate standardization and cross-cultural

comparison

• Standard measures

• DDI compliant XML metadata

Archive survey information and materials

Facilitate replication

Meet contractual obligations

Reduce administrative burden

Page 3: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

3

GoalsGoals

Also to facilitate: Monitoring of processes

• E.g., review and approval of sample designs before implementation

Assessment of process quality Improvements in methods and measures Analysis and correct use of data

Page 4: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

4

Obstacles Obstacles

• Time and cost constraints

• Complexity of computer assisted interviewing (CAI) systems and instruments

• Lack of adequate tools for documenting survey lifecycle

Page 5: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

5

Survey Metadata Survey Metadata Documentation System (SMDS)Documentation System (SMDS)

• ISR and ZUMA collaborative development

• Tool designed to facilitate documentation of survey lifecycle from initial design through data collection to post-survey processing and archiving

Page 6: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

6

SMDSSMDS

• Features: Supports multiple users simultaneously

Modularized

Web-based

Easy navigation

Built in skip logic

Page 7: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

7

SMDSSMDS

• Features: Designed to follow the survey

documentation life-cycle

• capture relevant information when it happens

Data reporting options by country, module, or question

Data extraction to third party software package

Page 8: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

8

SMDSSMDS

• Metadata Modules General National Study Information Ethics Review/Consideration Sample Design Translation Process and Products Interviewers and Interviewer Training Pretesting Data Collection Quality Control Dataset Preparation/Final Report Information Data Depositing

Page 9: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

9

User LoginUser Login

Page 10: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

10

SMDS ModulesSMDS Modules

Select modules in any order; complete in multiple sessions.

Page 11: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

11

Module Contact InformationModule Contact Information

Page 12: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

12

Translation ModuleTranslation Module

Page 13: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

13

Quality Control ModuleQuality Control Module

Page 14: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

14

Sample Design ModuleSample Design Module

Dynamic display of fields based on skip logic

Page 15: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

15

Sample Design Module (4):Sample Design Module (4):ReportReport

Page 16: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

16

Example: Cross Country Example: Cross Country ComparisonComparison

Page 17: Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.

17

SummarySummary

• SMDS: Web- based data entry tool for capturing information

about all phases of survey life cycle Standardized, primarily closed questions, for all

surveys, all countries• Facilitates collection of comparative information• Can search on discrete variables for cross-national

comparisons Multiple user access, data entry for single survey Dynamic, incorporates skip logic Can generate comparative reports across countries,

surveys