Top Banner
Rajinder Koul, Ph.D., CCC‐SLP Professor and Chairperson Department of Speech, Language and Hearing Sciences Texas Tech University Health Sciences Center EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN BEHAVIORAL SCIENCES: IMPLICATIONS FOR PRACTICE UNIVERSITY OF PRETORIA CENTRE FOR AUGMENTATIVE AND ALTERNATIVE COMMUNICATION (CAAC)
28

EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

Jan 15, 2017

Download

Documents

nguyenkhue
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

• RajinderKoul,Ph.D.,CCC‐SLP• ProfessorandChairperson• DepartmentofSpeech,LanguageandHearingSciences• TexasTechUniversityHealthSciencesCenter

EXPERIMENTAL AND NON-EXPERIMENTAL RESEARCH IN BEHAVIORAL SCIENCES: IMPLICATIONS FOR PRACTICE

UNIVERSITY OF PRETORIACENTRE FOR AUGMENTATIVE AND ALTERNATIVE COMMUNICATION (CAAC)

Page 2: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

RESEARCH DESIGNResearchdesignsareastructureoftemporal‐spatialarrangementswithinwhichtheselectedvariablesarecontrolled,manipulated,andmeasured(Hegde,2003).

Researchdesignshelprevealrelationshipsbetweenandamongvariables: Independent:notrelated Cause‐effectrelationships Correlativerelationships Interactiverelationships:multiplevariablescombinetogethertoproduceaneffect;thetotaloutcomeistypicallygreaterthanthemereadditiveeffects

Page 3: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

NON‐EXPERIMENTAL RESEARCH

Lackofcontroloverextraneousand/orassignedindependentvariables(IVs)

Independentvariablesarenotintroduced,withdrawn,ormanipulated

Relationshipbetweencauseandeffectcannotbeestablished

Page 4: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EX‐POST FACTO RESEARCH

Page 5: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EX‐POST FACTO

Ex‐PostFactoResearch(afterthefact,“retrospectivesearch”) Independentvariableshaveoccurredinthepast‐ oneisstudyingthedependentvariable(DVs)

Unabletodeducecause‐effectrelationshipsbecauseindependentvariablescannotbemanipulated

Casehistorymethod

Page 6: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EX‐POST FACTO

Weaknesses ItisnotexperimentalbecauseIVsarenotmanipulated

LackscontrolbecauseextraneousIVsarenotruledout(internalvalidityconcerns)

CannotsupporttheoryStatisticalcorrelations

Page 7: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EX‐POST FACTO

AdvantagesUncoversimportantvariablesExploratoryscienceSocialvs.scientificviewpoint

Page 8: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

NORMATIVE RESEARCH

Page 9: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

NORMATIVE RESEARCH

AlsocalleddevelopmentalordescriptiveresearchDistributionofselecteddependentvariablesacrossdifferentagegroupsisobservedandrecorded

Helpsdifferentiatetypicalfromatypical(standardizedtests)

HelpsguideclinicalinterventionNotabletomanipulateIndependentvariablesandthuscannotdrawcause‐effectrelationship

Page 10: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

NORMATIVE RESEARCH

Howtoconduct: IdentifypopulationDrawarepresentativesample(i.e.,allparticipantshaveanequalchanceofparticipatinginthisstudy)

SamplethebehaviorofselectedparticipantsGeneralizeresultstothepopulation

Page 11: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

NORMATIVE RESEARCH

WeaknessesDifficultyobtainingtruerandomsamples Inadequate(brief)samplingofresponsesDoesnotsupportatheory

TwoTypesCrossSectionalresearchLongitudinalresearch

Page 12: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

STANDARD‐GROUP COMPARISONS

Page 13: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

STANDARD‐GROUP COMPARISON

Extensionofnormativeresearch GroupsareformedonthebasisofoneDVand

arethencomparedonthebasisofthesameoranotherDV

TwostrategiestoperformStandard‐GroupComparison:

1. Criterionandcomparisonmeasuresarethesame2. Criterionandcomparisonmeasuresaredifferent

Page 14: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

STANDARD‐GROUP COMPARISON

Strengths:CandescribedifferencesHelpsdistinguishclinicalgroups

Weaknesses:Cannotassigncause/effectrelationshipsCannotmanipulateIV

CohortStudiesandCase‐controlstudiesarevariationsofStandard‐groupcomparisonresearch

Page 15: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

SURVEY RESEARCH

Assesssomefeaturesofagroupofpeopleoraparticularsociety

DistributionofDVinthepopulationisdetermined(+or‐)4‐6%rangeoferror

Errorratedependsupontherepresentativenatureofthesample

Realthoughtsandactionsmaynotbethesameasopinionsandattitudes

Page 16: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH

Page 17: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH

ControlledarrangementinwhichoneormoreIVsaremanipulatedandtheeffectsofsuchmanipulationontheDVsaremeasuredCanisolatecause/effectrelationship(seekstoexplainaneventbydiscoveringitscausalvariables)

Control‐canruleoutcompetinghypothesisCanexplainphenomenaandsupporttheories

Page 18: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH

Twovarieties:BasicandAppliedResearchClinical:usedtodescriberesearchthatisinsomewayconnectedwithdiseasesanddisorders;researchaimedatunderstandingandtreatingvariousdisordersofcommunicationisclinical

Applied:non‐clinicalasinbuildingbetterbridgesorsaferhighways

Page 19: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH

BasicResearch:Givesusinsightstodoappliedresearch‐veryimportantOftentheoretical

Page 20: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH

Twostrategiestoruleoutextraneousvariablesa) Groupstrategyb) Singlesubjectstrategy

Page 21: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH‐BETWEEN GROUP STRATEGYIngroupdesigns,youcomparemeansandstandarddeviationsof2ormoregroupsondependentvariablesofinterest(e.g.,randomizedcontroltrials)

Useinferentialstatisticstoseeifthedifferencesacrossthegroupsaresignificant.

Taketheaverageperformanceandcompareacrossgroups,thendetermineifthegroupsaredifferent.

Page 22: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH‐BETWEEN GROUP STRATEGY

Randomization:randomselectionandassignment

Matching:MatchingpairsofparticipantsEquivalentfrequencydistribution‐matchedonastatisticalbasisGroupsareequalonassignedvariablesexceptontheIVthatoneismanipulated

Page 23: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH‐BETWEEN GROUP STRATEGY

Wellcontrolledgroupdesignshaveatleasttwogroups(onecontrolandoneexperimental)

Majorityofgroupdesignsmeasurepre/posttestdifferences

Groupdesignshaveinferentialgenerality(sampletothepopulation),notlogicalgenerality

Page 24: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EXPERIMENTAL RESEARCH‐BETWEEN GROUP STRATEGY

Typesofgroupdesigns:Pre‐ExperimentalDesignsTrueExperimentalDesignsQuasi‐experimentaldesignsCorrelationalDesigns

Page 25: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

TREATMENT RESEARCH

Uncontrolledtreatmentresearch (e.g.,casestudies)Controlledtreatmentresearch‐establishacause/effectrelationshipbetweentreatmenttechniqueandtheDV(i.e.,positivechangesinthepatientswhoreceiveit)

Directlyreplicatedtreatmentresearch‐sameinvestigators,originalsetting,differentsubjects(samemethodology)

Systematicallyreplicatedtreatmentresearch‐othercliniciansinothersettings

Page 26: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

EVIDENCE HIERARCHY

Page 27: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...

QUESTIONS/DISCUSSION

Page 28: EXPERIMENTAL AND NON- EXPERIMENTAL RESEARCH IN ...