Design Research MMW3013 - Multimedia Universitypesona.mmu.edu.my/~neomai/research2012/Methods _2012.pdf · Interpret the research findings and see if they ... Triangulation is sometimes

Design ResearchMMW3013

Assoc. Prof. Dr. Mai Neo

Structure of a thesis

Common format – 5 Chapters Title, Abstract & Preliminary pages Chapter 1 – Introduction Chapter 2 – Literature Review Chapter 3 – Methodology Chapter 4 – Analysis and Results Chapter 5 – Conclusion and Discussion References Appendices

Writing an abstract

An abstract is a short summary of your completed research. If done well, it makes the reader want to learn more about your research.

Writing an abstract

An abstract usually contains the following basic components:

1) Motivation/problem statement: Why do we care about the problem? What practical, scientific, theoretical or artistic gap is your research trying to do?

2) Methods/procedure/approach: What did you actually do to get your results? (e.g. analyzed 3 novels, completed a series of 5 oil paintings, interviewed 17 students)

3) Results/findings/product: As a result of completing the above procedure, what did you find?

4) Conclusion/implications: What are the larger implications of your findings, with regards to the problem statement you identified in step 1?

The Research Process Thesis chapters Chapter 1: Introduction

State clearly the aim and plan of the research. Why you chose your topic, what the main research issues are, what aspects you investigated and how you investigated them

Chapter 2: Literature Review Show how your work relates to what other researchers have

done. Must relate theory to practice Chapter 3: Methodology

Describe how you studied your topic and what instruments you used to collect your data. Provide detail description of how the investigation was carried out

Chapter 4: Analysis Describes all the results obtained in Chapter 3. Provide full analysis of

the how you intepreted the data and include any tables, charts and figures to explain your results

Chapter 5: Discussion and Conclusion This section answers the research questions stated in Chapter 1.

Interpret the research findings and see if they agree with the aims and proposals of your research and provide recommendations, if any.

Chapter 1: Introduction

Background of the research Research questions Justification for the research Methodology ScopeOutline of the thesisDefinitions

Literature reviews should comprise the following elements:1. The general area of concern2. Overall trends in what has been published about the

topic; or a single problem or new perspective of immediate interest.

3. Division of works under review into categories (e.g. those in support of a particular position, those against, and those offering alternative theses entirely)

4. Summary of individual studies or articles. Paraphrase properly

5. Explanation of how each work is similar to and how it varies from the others

Chapter 2: Literature review

Literature reviews should comprise the following elements:

6. Make sure your sources are both classic AND current

7. Cover the basic categories on the area8. Select sources RELEVANT to your area

(focus!)9. Organise your articles properly10.Cite your sources!11.Practice good ethics in writing

Chapter 2: Literature review

Methods of research

Chapter 3: Methodology

Methodology refers to the basis on which the research is founded on.

Methods are the particular ways of collecting data.


Types of research methods:

1. Quantitative – highly numerical and experimental

2. Qualitative – descriptive and non-numerical ways of collecting data


Quantitative:Most commonly used by physical scientists, as well asSocial sciences, education and economics

Quantitative research should begin with an idea (usually articulated as a hypothesis), which then, throughmeasurement, generates data and, by deduction, allows a conclusion to be drawn.


Quantitative: The strength of the quantitative approach lies in its

reliability (repeatability)—that is, the same measurements should yield the same results time after time.

Quantitative research design is an excellent way of finalizing results and proving or disproving a hypothesis.


Quantitative: Disadvantages: Quantitative experiments can be difficult and

expensive and require a lot of time to perform

Quantitative studies usually require extensive statistical analysis, which can be difficult


Quantitative methods: Describes, explains and tests

relationships Examines cause and effect Research Question collect data

analysed data -> tables, charts, diagrams Analysis reported : means, percentages


Quantitative methods:

1. Experiments2. Surveys3. Questionnaires


Surveys – a way to describe and explain some aspect of the target population

1. Market research2. Opinion survey3. Attitudes and perceptions4. Use of samples

Chapter 3: MethodologyQuestionnaires – a series of questions each

providing a number of alternative answers from which the respondents can choose. Generate quantifiable results.

Eg. Likert ScaleQuestion 1: The use of multimedia technology in the

classroom is very motivating for me Strongly Disagree Disagree Undecided Agree Strongly Agree


Qualitative Research: Qualitative research, in contrast, begins with an

intention to explore a particular area, collects "data" (observations and interviews), and generates ideas and hypotheses from these data largely through what is known as inductive reasoning


Qualitative Research: The strength of qualitative research lies in validity

(closeness to the truth)—that is, good qualitative research, using a selection of data collection methods, really should touch the core of what is going on rather than just skimming the surface

Chapter 3: MethodologyQualitative Research: The two maior types of Qualitative Research are... Observation –

participant observation- fieldwork/naturalist. Data is gathered in a natural environment which engages natural behavior.

In-depth interviewing- Open ended questions are used in order to get as many details as possible. Open ended questions allow for the informant to answer from

their own frame of reference rather than being confined by the structure of pre-arranged questions. Informants express their thoughts more freely


Qualitative methods:

1. Interviews2. Observations3. Case studies4. Diaries


Interviews – popular form of data collection

Advantages:1. Can be used in a variety of situations2. Face to face interviews can clear up any

misconceptions of interviewees3. Allows for probing questions


Interviews – popular form of data collection

Disadvantages:1. Time-consuming2. May only get a small sample3. May not always get at truth


Observations – create an accurate record of what people are doing and saying

Types:1. Participant observation2. Non-participant observation3. Diary method to keep log


Case studies – an extensive study of a single situation such as an individual, family or organisation.

May employ a range of techniques, including questionnaires (quantitative), and interviews and observations (qualitative)

Chapter 3: MethodologyMixed method Mixed method studies attempt to bring

together methods from different paradigms. In a mixed method study you might conduct a series of

semi-structured interviews with a small number of students and also carry out a large-scale survey.

This kind of integration, of qualitative with quantitative methods, is also referred to sometimes as multi-strategy research.

Chapter 3: MethodologyMixed method Triangulation Triangulation is sometimes used to refer to all

instances in which two or more research methods are employed.

It might be used to refer to multi-method research in which a quantitative and a qualitative research method are combined to provide a more complete set of findings than could be arrived at through the administration of one of the methods alone.

(Source: Prof. Alan Bryman -http://www.referenceworld.com/sage/socialscience/triangulation.pdf)


Population and samples

Chapter 3: MethodologyPopulation Population is the group of interest to the

researcher or the group to whom the researcher would like to generalise the results of the study.

Examples of population: All girls in Higher Education All boys in Higher Education All Malaysians attending MMU All international students in Malaysia And so on…

Chapter 3: MethodologyType of population The actual population to which a

researcher would like to ideally use is called the Target population.

However, because the target population is rarely available, researchers used what is known as accessible population or population in which a researcher is able to access.

Chapter 3: MethodologyFor example: Research to be investigated – The effects

of using multimedia in secondary classrooms in Selangor.

Target population – All secondary schools students in Selangor

Accessible population – All secondary schools in Klang Valley

Chapter 3: MethodologySampleA sample is a group that represents the population in which the researcher intends to study.

The results from this study are to be applied to the population.

For example Accessible Population - All secondary schools in Klang Valley Sample – 10% of secondary schools in the Klang Valley.

The results found from the 10% sample should be generalised to the accessible population.


Example A researcher is interested in studying the use of

diet on attention span of standard 5 students in KL. There are 15000 standard 5 students in KL. The researcher then selects 1500 of these standard 5 students, 300 each in five different schools. What is the population? What is the sample size?


Example A researcher is interested in studying the use of

diet on attention span of standard 5 students in KL. There are 15000 standard 5 students in KL. The researcher then selects 1500 of these standard 5 students, 300 each in five different schools.

What is the population? Answer: 15000

What is the sample size? Answer: 1500

Chapter 3: MethodologyThe process of selecting samples from a population is called sampling.

Types of sampling methods Random sampling – Every member of the

population presumably has an equal chance of being selected. The basic idea behind this is that the sample selected is

very much like the population. One can never be sure of course but if the sample

selected randomly and is sufficiently large enough, the researcher should get an accurate view of the population.


For example: The Dean of a Design school wants to find out how

the faculty feels about a new digital image database. He places all faculty members’ names (200) in a hat, mixes them and draws about 40 names from the hat.

Chapter 3: MethodologyNon-random sampling Not every member of the population has equal chance of being selected. The idea behind here is to select a sample that is

available or convenient to the researcher or the researcher set certain criteria.

Chapter 3: MethodologyFor example: A bookstore owner wants to know how her

customers feel about her service. So she decides to ask every person who comes to the store during lunch time. At the end of a certain period of time, she gets a sample of 235.

Is this random sampling? Why?

Chapter 3: MethodologyIs this random sampling? No.

Why? Because not all her customers have an equal

chance to be selected, only those who come in during lunch time.

Chapter 3: MethodologyTypes of random sampling methods Simple random sampling – each and every member

of the population has an equal chance. (Put all the names in a hat example or use random number tables)

Stratified – certain subgroups or strata are selected for the sample in the population based on the same proportion as they exist in the population. Eg 100 members in population. 60 are men and 40 women.

So the ratio is 60/40. Therefore the sample will be 36 men and 16 women.

Chapter 3: MethodologyTypes of random sampling methods Cluster random sampling – selection of groups or

cluster rather than individuals. This takes place when it is hard sample individuals from a population. For example – Population is all the schools in Klang

Valley which is about 50 schools. Therefore it is hard to random sample or stratified sample individuals.

So the researcher decides to do cluster random sampling from the 50 schools by arranging the schools from 1-50 and then using a table of random numbers to select 10 schools or 20% of the population.

Therefore, all the individuals or teachers in that school are selected and each of the school is a cluster.


Types of random sampling methods Two-stage random sampling – first

performing a cluster sampling, then using simple random sampling to select the individuals. Eg From that 10 schools or cluster, you can

randomly select 100 teachers.

Chapter 3: MethodologyTypes of non random sampling methods Systematic sampling – choosing every nth of the

population. Eg, you have a population of 1000 storekeepers

and list them 1-1000. Then you take numbers 1-10 and put them in a

hat. You then select a number from 1-10, say 2. Then you select 2, 12, 22, 32, 42 etc as your

sample.

Chapter 3: MethodologyTypes of non random sampling methods Convenient sampling – a group of individuals who

are conveniently available for the study. For example, researcher wants to do research

on MI students in Cyberjaya. Researcher uses the MI students who belong to

his class only.

Chapter 3: MethodologyTypes of non random sampling methods Purposive sampling – the researcher selects the

sample who he or she thinks represents the population based on previous knowledge. For example – teacher selects two individuals

with the highest- GPA, middle GPA and lowest GPA from her class to find out how they feel about her class.

Chapter 3: MethodologyChapter 3 - Introduction- Research Design- Scope and sample- Research Instruments- Implementation or procedure- Other relevant details about your study


Research Instruments

Chapter 3: MethodologyResearch Instruments- Survey- Tests- Open-ended questions- Interviews- Observation

Chapter 3: MethodologySurveys Research – Quantitative

The main purpose of a survey is to describe the characteristics of a population.

In essence, what researchers want to find out is how the members of the population distribute themselves on one or more variables (eg age, gender, intelligence etc)

Chapter 3: MethodologySurveys Research – Quantitative

Since the entire population is rarely used, a sample of the population is surveyed and a description of the population is inferred from what is found out about the sample.

Chapter 3: MethodologySurveys Research – QuantitativeTypes of surveys(1) Cross-sectional surveyCollects inform from a sample that has been chosen from a predetermined population.

When an entire population is surveyed, it is called a census.

Chapter 3: MethodologySurveys Research – QuantitativeTypes of surveys(1) A cross-sectional surveyInformation is collected at just one point in time.

For example, to find out if buyers like ice-cream. Give survey to buyers at point of ice-cream purchase.

Chapter 3: MethodologySurveys Research – QuantitativeTypes of surveys(2) Longitudinal surveyInformation is collected at different points in time in order to study the changes over time.

For example, to study the effects of divorce on children. Study may take place at the start of the divorce, 3 years later, and 5 years later etc.

Chapter 3: MethodologySurveys – The Steps in a Survey Project Establish the goals of the project - What you

want to learn What is the problem? Issue? Research Question?

Determine your population Who is the target population? All boys? All girls? All FCM students? Target population should also be accessible population

Chapter 3: MethodologySurveys – The Steps in a Survey Project Choose method – What mode will you collect

your data? Face-to-face, Email / Mail Internet – IM / Facebook Telephone

Select your sample Random / Non random Size / number of participants

Chapter 3: MethodologySurveys – The Steps in a Survey Project Create your questionnaire - What you will ask? Define your parameters / constructs / areas Close-ended – Objective questions Which subjects to you like the best? (a) Design (b)

Computer (c) Liberal Scale – 1-Strongly disagree, 2- Disagree, 3 Undecided

4- Agree and 5 – Strongly Agree

Open-ended – Allows for more individual responses (eg – What do you think are the characteristics of a hero?)

Chapter 3: MethodologySurveys – The Steps in a Survey Project Conduct survey and enter data - Ask the

questions on your sample Analyse the data - Produce the reports


Questionnaires – tips1. Ask straightforward questions2. Ask “”Yes” / “No” questions (CLOSED

QUESTIONS) when you want only yes or no answers

3. If you want opinions, do not ask “Do you like multimedia”. Instead, ask, “What do you think about using multimedia in your learning?” (OPEN QUESTIONS)

Chapter 3: MethodologyTests – For comparative studiesUsually done in an experimental design research using single samples, two samples or more.

This is to find out the outcome of one event over the other. (eg learning outcome)- Pre-tests

- To find out what the participants know prior the event / experiment

- Post-tests- To find out the effects of the event or experiment


ObservationUsed to observe the participants in their natural state. To see how people naturally act or how things look.

Four types:Participant observationNon-participant observationNaturalistic ObservationSimulations

Chapter 3: MethodologyParticipant ObservationThe researcher takes part in the event or situation(a) Complete participant – he takes part in the situation

and does not reveal his identity. He interacts with the group as naturally as possible.

(b) Participant-as-observer – he fully participates in the activity but his identity as the researcher is known.

Chapter 3: MethodologyNon Participant ObservationObserver does not participate in the activity but remains on the sideline and just observe.

(a) Observer-as participant – he identifies himself as an observer to the members or group that is being observed (eg MQA visits)

(b) Complete observer – the researcher observes the group without in any way participating and the group being observed may or may not know. He does not reveal himself to them.

Chapter 3: MethodologyNaturalist ObservationObserving individuals in their natural settings. The researcher makes no effort what so ever to manipulate or control the activities of the individuals but simple observe and record.

Eg To observe students reaction during class when the teacher is not present in the classroom.

Chapter 3: MethodologySimulationsTo investigate certain variables, researchers sometimes will

create a situation and ask subjects to act out or simulate certain roles. In this case, the researcher actually tells the subjects what to do (but not how to do it) like role playing.

Eg. Individual may need to act out how a teacher disciplines a student.

This will allow the researcher to observe what happens in a certain kinds of situations

Chapter 3: MethodologySimulationsIndividual role- playing- A person may be asked to role play how he

or she thinks a particular individual might act in a given situation. The researcher then observes and records what happens.

- Eg. You are the teacher and you just caught your student cheating. What will you say?

Chapter 3: MethodologySimulationsTeam role playingA group of individuals is asked to act out a particularsituation with the researcher just observing and recording. Special attention is given to how the members interact.

For example 5 members are to assume the role of UN security counsel to discuss nuclear arms. What to you propose to do?

Chapter 3: MethodologyInterviews

Interviewing is an important way for a researcher to check the accuracy of the impressions he or she has gained through observation.

The purpose of interviewing people is to find out what is on their minds, what do they think, why and how they feel about something.

Chapter 3: MethodologyInterviewsTypes:(1) Structured interviewFormal interviews that consists of a series of questions designed to elicit a specific answer.

For example, getting background info on the participant like their education, qualifications, experience, out of office activities etc.

Chapter 3: MethodologyInterviewsTypes:(2) Informal interviewsThey are less structured and resemble a casual conversation. They do not involve any specific type or sequence of questions. The primary goal is to find out what people think and how the views of one individual compares to another.

Chapter 3: MethodologyInterviewsTypes:(3) Retrospective interviewsA researcher conducting this type of interview tries to get a respondent to recall and then reconstruct from memory something that has happen in the past.

Eg Interviewing someone who was there during the 1st

merdeka celebration to share the experience.

Chapter 3: MethodologyImplementation / Procedure

A detail account of how the study was conducted:(1) What(2) How(3) Who(4) Why

THANK-YOU!

Design Research MMW3013 - Multimedia Universitypesona.mmu.edu.my/~neomai/research2012/Methods _2012.pdf · Interpret the research findings and see if they ... Triangulation is sometimes

Documents