Survey design 1

Research Methods and Designs

Ms. Bernadeth L. Ouano MA-LLI

Its definition

• It describes the trend in the data rather than offerrigorous explanations.

• it is used to collect the data and facts about somecertain situation or issue from the target populationexisting in surroundings.

• a survey is given to describe the attitudes, opinions,behaviors or characteristics of the population.

SURVEY DESIGN

Its purpose

•provide someone with information•to explain the situations • Identify and solve a problem•measure the change•study attitudes, behavior and habits

It is used to

Types of Survey Design

Cross Sectional Survey Longitudinal Survey

Trend Studies Cohort Studies Panel Studies

compared

• It provides information in a short amount of time such asthe time required for administering the survey andcollecting the information.

Cross-sectional Study

Group A ( 20-year-old)

Group B ( 50-year-old)

Group C ( 80-year-old)

Advantages

-Quicker to see changes across different time stages

-Larger sample size, therefore outcomes are easier to generalize

-inexpensive

Disadvantages

-cannot establish effects

-data collected relevant to conditions when researched.

-data provides "what" but not "why"

Cross-sectional Study

Group A at the age 20

Longitudinal Study

• A research technique that studies the same group ofindividuals over a long period of time.



Advantages- examines changes within individual over time

- provides a developmental analysis

Disadvantages- expensive

- takes a long time

- very time consuming

- usually a small sample,

- therefore outcomes are

- difficult to generalize

Longitudinal Study

Trend Studies

• focus on the same population of people useopinion poll surveys to look at their attitudesover time. While the population is always thesame, trend studies usually select differentmarket research survey samples from thatpopulation.

Cohort Studies

• is a method in which a specific population isstudied repeatedly as well, but these studiescenter around how given groups with acommon characteristic view social phenomenaover time.

Panel Studies

• utilize the same sample from the samepopulation over time. While more complicated anddifficult to carry out, this is the best design to trulyfind out changes over time, because you are trackingopinions of the exact same respondents repeatedly.

Time Data Collection

Trend Cohort Panel Group comparisons

National Assessment

•Sampling from a population •Collecting data •Designing instruments for data collection•Obtaining a high response rate

Key Characteristics of Survey Research

Questionnaires are printed forms that ask the samequestions of all individuals in the sample and forwhich respondents record their answers in verbalform.

Interviews consist of oral questions asked by theinterviewer and oral responses by the researchparticipants.

Methods of Collecting Data

1. Make all directions clear and unequivocal.

Guidelines in Constructing a Questionnaire

Example : Poor direction for a multiple response question:Answer the following questions.

Better: Choose the items or options that would best answer the question and write a check mark on the space before each option . You may have more than one choice.

2. Use correct grammar.


Example : Please accomplish the questionnaire as soon as possible return it.

Better: Please accomplish the questionnaire and return it as soon as possible.

3. Make all questions unequivocal.


Example : Are you graduate?

Better: Are you a high school graduate?

4. Avoid asking biased question..


Example : Do you use Colgate toothpaste? If not, what brand do you use?

Better: Which brand of toothpaste do you use?

5. Objectify the responses. .


Example : Why do you use Camay soap?

____ It is fragrant. ____ It makes my skin smoother.___ It is cheap.___ It is available all the time.

6. Relate all questions to the topic under study.


If the study is about teaching Science, allquestions should gather data that has somethingto do with Science.

7. Create categories or classes for approximate answers.


QUALITATIVE QUANTITATIVE

How efficient is your teacher? How many sticks of cigarettes do you consume a day?

____ Very efficient____ Efficient ____ Fairly Efficient

____ 0-4____ 5-9____ 10-14

8. Create sufficient number of response categories.


Example : Do you agree that the presidential form of government is betterthan parliamentary?

____ Agree _____ Disagree

Better: ___ Strongly Agree___ Agree___ Uncertain of No Comment ___ Disagree ___ Strongly Disagree

9. State all questions affirmatively.


Example : Poor: Are you not studying?

Better: Are you studying?

10. Word carefully or avoid questions that deal with confidential or embarrassing information.


Poor question: Why did you become unfaithful?

Better: What in your own opinion, are those reasonswhy wives sometimes fall in love with men other thantheir own husbands?

11. Add a catch-all word or phrase to options of multiple response questions.


Example : Why did you stop your studies?___ I am too poor. I cannot afford?___ I married early.___ I lost interest.___ My family moved to a place too far from a school.___ Others, please specify.

12. Make the respondents anonymous.


Guidelines in making the Cover Letter

• The purpose of the questionnaire or study;•Who is sanctioning , endorsing, or sponsoring the

study;•What will be done with the information gathered

by the questionnaire;• The reason why the respondent should answer the

questionnaire and giving importance to therespondent;

Guidelines in making the Cover Letter

• A guarantee of the anonymity and confidentiality of the respondent.

• An expression of gratitude for the respondent’s participation in the study; and

• An offer to inform the respondent of the results of the study if he is interested.

Overall Questionnaire Construction

• It must be short to encourage the bust professionals to return it• It must begin with a demographic or personal questions

that respondents can easily answer• It should also contain open-ended items to encourage

participants to elaborate on their experiences

Overall Questionnaire Construction

• It must also contain “white space” between the questions • It must also include closing instructions thanking the respondent for participating in the study.

Data Analysis of Research Questionnaire

• Typically , researchers are using mailed questionnaires also correlate all of the questions and attempt to build scales that reflect multiple questions.

• The researcher tests hypotheses or research questions using inferential statistics.

Designing and Conducting an Interview Survey

• Stance of the Interviewer • Interview procedures often involve the need for the

researcher to establish rapport with and gain thecooperation of the interviewee.

• Rapport builds through requests for an interview in thecover letter.

Designing and Conducting an Interview Survey continuation….

•Stance of the Interviewer • During an interview, the researcher should remain

neutral and should not share opinions. • It is also important to use a positive tone of questioning

and to have a neutral appearance.

Designing and Conducting an Interview Survey continuation…

• Training of Interviews• If more than one interviewer is involved in a research

project, each person needs training.• The training might consist of a role-playing demonstration

by an experienced researcher.

Designing and Conducting an Interview Survey continuation…

•Training of Interviews• It is important during this training to become familiar

with the questions .• Training also covers potential interruptions during an

interview or questions interview or questionsinterviewees might have about the interview.

Problems arise during the interview

•Does not ask the question in order•Brings certain expectations to the interview about how

the individuals will answer •Dresses or appears inappropriately for the interview• Is disrespectful by not using the interviewee wants to

be called

Steps in Interviewing

1.It involves obtaining an interview survey to use and trainingindividual interviewers.2.Then the researcher gains access to the participants through aformal invitation such as cover letter, and the time and place toconduct the interview.

Steps in Interviewing continuation…

3. During the interview , the survey researcher asksquestions, indicates the response options to questions ,and records participants answers.4. The pace of the interview is set to be comfortable forthe interviewee.


5. When asking open-ended questions , the interviewerwrites down answers to the questions or tape recordsthem.6. The interview ends with the researcher thanking theindividual for the interview and telling the participantwhat the next step will be in the study.

7.After the interview, the researcher may want towrite down comments that help explain the data,such as the demeanor of the interviewee orspecifics about the situation8. The interviewer might also record any personalfeelings about the interview


Steps in Interviewing continuation….

9. The interview ends with the researcher thanking theindividual for the interview and telling the participant what thenext step will be in the study.10. After the interview, the researcher may want to write downcomments that help explain the data, such as the demeanor ofthe interviewee or specifics about the situation

11. The interviewer might also record any personalfeelings about the interview12. The interview ends with the researcherthanking the individual for the interview and tellingthe participant what the next step will be in thestudy.


13. After the interview, the researcher may wantto write down comments that help explain thedata, such as the demeanor of the interviewee orspecifics about the situation14. The interviewer might also record anypersonal feelings about the interview


1. Identify the research and the hypotheses

2. Identify population sample3. Survey Design and Data Collection

Procedures

Steps in Conducting Research Survey

4. Develop Survey Instrument 5. Administer the Instrument 6. Analyze the Data 7. Write the Report

Steps in Conducting Research Survey

• Describes and specifies the target population and the sample.• Identifies how the sample was derived (ex. Random sampling,

nonrandom sampling)• Discusses the size of the sample and the means for deriving the

sample size.• Uses a type of survey (ex. Longitudinal or cross-sectional) that

matches the research questions or hypotheses.

Evaluating Survey Research

•Clearly identifies the instruments used in datacollection and how they were selected.•Reports information on the reliability and validity of

scores from past uses of the questionnaire orinterview.•Discusses the procedures for administering the

instruments

Evaluating Survey Research

• Mentions appropriate follow-up procedures to ensure a large return rate and lack of response bias.

• Provides an example of the questions on the questionnaire or interview.

• Uses data analysis procedures to answer the research questions or hypotheses.

• Writes the study in a scholarly way (ex. Follows a standard structure) and identifies potential ethical issues.

Evaluating Survey Research continuation…..

• Was the target population or sampling frame clearlyspecified?

• Was the sampling procedure specified? If a random samplewas not used, were modifications from it explained?

• Was the sample clearly identified and the basis on which itwas chosen specified?


• Did the type of survey match the questions orhypotheses advanced by the author?

• Was it clear whether a questionnaire or an interviewsurvey comprised the form of data collection? Didthe researcher identify the basis for selecting ordeveloping the instrument?


Prepared by: Ms. Bernadeth L. OuanoMALLI

Survey design 1

Data & Analytics