This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Final PreparationsFinal PreparationsBefore Data Before Data CollectionCollectionGraziano and RaulinGraziano and RaulinResearch Methods: Chapter 14Research Methods: Chapter 14This multimedia product and its contents are protected under copyright law. The following are This multimedia product and its contents are protected under copyright law. The following are prohibited by law: (1) Any public performance or display, including transmission of any image prohibited by law: (1) Any public performance or display, including transmission of any image over a network; (2) Preparation of any derivative work, including the extraction, in whole or in over a network; (2) Preparation of any derivative work, including the extraction, in whole or in part, of any images; (3) Any rental, lease, or lending of the program.part, of any images; (3) Any rental, lease, or lending of the program.
procedures is part of the design procedures is part of the design processprocess
Based on the characteristics of the Based on the characteristics of the studystudy
Use the information about the study to Use the information about the study to follow the flowcharts to arrive at follow the flowcharts to arrive at decisions about statistics to usedecisions about statistics to use
Need not memorize the flowchartsNeed not memorize the flowcharts
Structure of the Structure of the FlowchartsFlowcharts Initial Flowchart (14.1)Initial Flowchart (14.1)
– Prompts for the details of the studyPrompts for the details of the study– Sends to other flowcharts based on data Sends to other flowcharts based on data
typetype Secondary FlowchartsSecondary Flowcharts
– Score Data Flowchart (14.2)Score Data Flowchart (14.2)– ANOVA Flowchart (14.3)ANOVA Flowchart (14.3)– Ordered Data Flowchart (14.4)Ordered Data Flowchart (14.4)– Nominal Data Flowchart (14.5)Nominal Data Flowchart (14.5)
Defined as analyses that do not directly Defined as analyses that do not directly test the hypothesis of the studytest the hypothesis of the study
Three types of secondary analysesThree types of secondary analyses– Post hoc analysesPost hoc analyses: Such as specific : Such as specific
means comparisons in ANOVAmeans comparisons in ANOVA– Secondary analyses to explain resultsSecondary analyses to explain results– Data snoopingData snooping: Exploring the data for : Exploring the data for
clues that might form hypotheses for later clues that might form hypotheses for later researchresearch
Caveats and Caveats and DisclaimersDisclaimers Flowcharts are a teaching device onlyFlowcharts are a teaching device only NOT every statistical procedure is NOT every statistical procedure is
includedincluded– Only the most common (e.g., testing mean Only the most common (e.g., testing mean
differences)differences) Procedures suggested by flowcharts, Procedures suggested by flowcharts,
although the correct procedures to although the correct procedures to use, are NOT the only correct use, are NOT the only correct procedures for that situationprocedures for that situation
Robust Statistical Robust Statistical ProceduresProcedures A statistical procedure is robust to an A statistical procedure is robust to an
assumption IF the assumption can be assumption IF the assumption can be violated without distorting resultsviolated without distorting results
Evaluated with Monte Carlo proceduresEvaluated with Monte Carlo procedures– Computer simulations of the effects of various Computer simulations of the effects of various
situations on the effectiveness of a statisticsituations on the effectiveness of a statistic Evidence suggests that assumption Evidence suggests that assumption
violations have little effect violations have little effect IFIF your sample your sample sizes about equal in each groupsizes about equal in each group
A final check before beginning the A final check before beginning the researchresearch
Also serves as an excellent check Also serves as an excellent check during the planning for the studyduring the planning for the study
CoversCovers– Study definition and designStudy definition and design– Selection of all proceduresSelection of all procedures– Participant selection and assignmentParticipant selection and assignment– Preparation for running the studyPreparation for running the study
Initial Problem DefinitionInitial Problem Definition– Literature reviewed?Literature reviewed?– Problem statement developed?Problem statement developed?– Variables operationally defined?Variables operationally defined?
Research HypothesesResearch Hypotheses– Clear hypotheses stating the Clear hypotheses stating the
direction and type of relationship direction and type of relationship expected?expected?
Statistical AnalysesStatistical Analyses– Descriptive statistics planned?Descriptive statistics planned?– Inferential statistics planned?Inferential statistics planned?– Post hoc and secondary analyses planned?Post hoc and secondary analyses planned?
Theory and operational definitionsTheory and operational definitions– Theoretical base for study clear?Theoretical base for study clear?– Do hypotheses and procedures address Do hypotheses and procedures address
Controls in placeControls in place– For threats to internal validity For threats to internal validity – For threats to external validityFor threats to external validity
ParticipantsParticipants– Adequately sampling target population?Adequately sampling target population?– Descriptive demographics collected?Descriptive demographics collected?– Sample large enough?Sample large enough?– Participants properly assigned to Participants properly assigned to
Preparation of setting (continued)Preparation of setting (continued)– Adequate space available?Adequate space available?– Space free of distractions?Space free of distractions?– Equipment checked out?Equipment checked out?– Enough research help available?Enough research help available?– Assistants adequately trained for Assistants adequately trained for
emergencies?emergencies?– Assistants trained on research procedures?Assistants trained on research procedures?– Blind procedures in place (if necessary)?Blind procedures in place (if necessary)?
Participant Preparation, Participant Preparation, Instruction, and ProceduresInstruction, and Procedures– Instructions to participants clear?Instructions to participants clear?– Instructions and procedures pilot Instructions and procedures pilot
Select statistical procedure as part of Select statistical procedure as part of design processdesign process– Statistical procedures selected before data Statistical procedures selected before data
collectioncollection– Selection based on study characteristicsSelection based on study characteristics
Pre-data checklistPre-data checklist– A final check before beginning researchA final check before beginning research– Covers design, ethical, and practical issuesCovers design, ethical, and practical issues