8/13/2019 Blog - Evaluation Research - Social Research Methods
1/7
Friday, November 26, 2010
20101127 - Evaluation Research
(SocialResearchMethods.net)
One specific form of social research -- evaluation research -- is of particular interest here. The Introduction
to Evaluation Researchpresents an overview of what evaluation is and how it differs from social research
generally. We also introduce several evaluation models to give you some perspective on the evaluation
endeavor. Evaluation should not be considered in a vacuum. Here we consider evaluation as embedded
within a larger !lanning-Evaluation "ycle.
Evaluation can be a threatening activity. #any groups and organi$ations struggle with how to build a good
evaluation capability into their everyday activities and procedures. This is essentially an organi$ationalculture issue. Here we consider some of the issues a group or organi$ation needs to address in order to
develop an evaluation culturethat wor%s in their conte&t.
'ource( http())www.socialresearchmethods.net)%b)evaluation.php
Introduction to
Evaluation
Search This Blog
'earch
LinsMobile Learning portal [prototype]WAP Blog: Mobile Learning & Usability
Blog !rchive* 2010 (144)
+ e!e"ber (4)
* #o$e"ber (%)
Mobile 'W''* pros & !ons
Mobile P+one is "ore !on$enient t+an #oteboo,-o"p...
rea/ing Bible on Mobile p+one in !+r!+
2010112 -on!eptal3'+eoreti!al ra"e5or,(5i,ip...
Usability ra"e5or, (6+a!,el)
2010112 !on!epts & /e7intions o7 $alation res...
2010112 $alation resear!+3"et+o/ (Patton)
2010112 $alation *esear!+ (Wi,ipe/ia)
2010112 $alation *esear!+ (Po5ell)
2010112 $alati$e *esear!+ (Winsett8 #A'-9)
2010112 '+e Planning$alation -y!le (6o!ial*e...
2010112 $alation *esear!+(6o!ial*esear!+Met+...
2010112 iagra" o!s rop as a ;alitati$e ...
2010112 Pee, & ot+ergill8 Using o!s rops 7...
Share 0 #ore ,e&t log valve/oem0gmail.com 1ashboard 'ign Out
Michael "ea#...$h% &andidate
Page 1 of 7Michael Yeap...PhD Candidate: 20101127 - Evaluation Reseach !"ocialReseachMethods.net#
2$%1%201&http:%%'ichael(eap.)logspot.co'%2010%11%2010112*-evaluation-eseach.ht'l
8/13/2019 Blog - Evaluation Research - Social Research Methods
2/7
8/13/2019 Blog - Evaluation Research - Social Research Methods
3/7
8/13/2019 Blog - Evaluation Research - Social Research Methods
4/7
P 5 f 7Mi h l Y PhD C did t 20101127 E l ti R h "# i lR hM th d t$
8/13/2019 Blog - Evaluation Research - Social Research Methods
5/7
F meta-analysisintegrates the outcome estimates from multiple studies to arrive at an overall orsummary udgement on an evaluation &uestion
Evaluation Questions and MethodsEvaluators ask many different kinds of &uestions and use a variety of methods to address them. These areconsidered within the framework of formative and summative evaluation as presented above.
In formative research the major questions and methodologies are:
What is the definition and scope of the problem or issue, or what's the question?
Formulating and conceptualizing methods might be used including brainstorming, focus
groups, nominal group techni&ues, Delphi methods, brainwriting, stakeholder analysis, synectics,lateral thinking, input!output analysis, and concept mapping.
Where is the problem and how big or serious is it?
The most common method used here is "needs assessment"which can include% analysis of
e$isting data sources, and the use of sample surveys, interviews of constituent populations, &ualitative
research, e$pert testimony, and focus groups.
How should the program or technolog be deli!ered to address the problem?
*ome of the methods already listed apply here, as do detailing methodologies like simulation
techni&ues, or multivariate methods like multiattribute utility theory or e$ploratory causal modeling;
decision!making methods; and proect planning and implementation methods like flow charting,
/E3T4/5, and proect scheduling.
How well is the program or technolog deli!ered?
ualitati!e and quantitati!e monitoring techniques, the use of management information
sstems, and implementation assessmentwould be appropriate methodologies here.
he questions and methods addressed under summative evaluation include:
What tpe of e!aluation is feasible?
Page 5 of 7Michael Yeap...PhD Candidate: 20101127 - Evaluation Reea!ch "#ocialReea!chMethod.net$
2%&1&201'http:&&(ichael)eap.*logpot.co(&2010&11&2010112+-evaluation-!eea!ch.ht(l
Page 6 of 7Michael Yeap PhD Candidate: 20101127 Evaluation Reea!ch "#ocialReea!chMethod net$
8/13/2019 Blog - Evaluation Research - Social Research Methods
6/7
Evaluability assessmentcan be used here, as well as standard approaches for selecting an
appropriate evaluation design.
What was the effectiveness of the program or technology?
One would choose from observational and correlational methodsfor demonstrating whether
desired effects occurred, and quasi-experimental and experimental designs for determining
whether observed effects can reasonably be attributed to the intervention and not to other sources.
What is the net impact of the program?
Econometric methods for assessing cost effectiveness and cost/benefitswould apply here,along with qualitative methods that enable us to summarize the full range of intended and unintended
impacts.
Clearly, this introduction is not meant to be exhaustive. Each of these methods, and the many not
mentioned, are supported by an extensive methodological research literature. This is a formidable set of
tools. ut the need to improve, update and adapt these methods to changing circumstances means that
methodological research and development needs to have a ma!or place in evaluation wor".
#ource$ http$%%www.socialresearchmethods.net%"b%intreval.phpPosted by Michael "ISO" at 5:53 PMLabels: evaluation research, research method, SocialResearchMethods.net
No comments:
Post a Comment
Page 6 of 7Michael Yeap...PhD Candidate: 20101127 - Evaluation Reea!ch "#ocialReea!chMethod.net$
2%&1&201'http:&&(ichael)eap.*logpot.co(&2010&11&20101126-evaluation-!eea!ch.ht(l
Page 7 of 7Michael Yeap PhD Candidate: 20101127 - Evaluation Reea!ch "#ocialReea!chMethod net$
8/13/2019 Blog - Evaluation Research - Social Research Methods
7/7
e!er Post Older Post
Sign out
Notify me
Enter your comment...
Comment as: Michael Valve
Publish Preview
Links to this post
reate a Lin#
$ome
Subscribe to: Post omments %&tom'
Page 7 of 7Michael Yeap...PhD Candidate: 20101127 - Evaluation Reea!ch "#ocialReea!chMethod.net$
2%&1&201'http:&&(ichael)eap.*logpot.co(&2010&11&20101126-evaluation-!eea!ch.ht(l