Everything I wish I Everything I wish I had known about had known about research design and research design and data analysis… data analysis… Statlab Workshop Statlab Workshop Spring 2005 Spring 2005 Heather Lord Heather Lord and Melanie Dirks and Melanie Dirks
15
Embed
Everything I wish I had known about research design and data analysis…
Everything I wish I had known about research design and data analysis…. Statlab Workshop Spring 2005 Heather Lord and Melanie Dirks. Outline of a paper. Introduction Theory Data Description Analysis Conclusion. Introduction. Topic Question What is the question you want to answer? - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Everything I wish I had Everything I wish I had known about research known about research
design and data design and data analysis…analysis…
Can find most data you’ll need on-line!Can find most data you’ll need on-line!Statlab Webpage Statlab Webpage (http://statlab.stat.yale.edu)(http://statlab.stat.yale.edu)
So, you want to make a So, you want to make a surveysurvey
Extensive on-line resources and softwareExtensive on-line resources and software Question types determine analysesQuestion types determine analyses
Open vs. close ended questions, Likert scales, rank order Open vs. close ended questions, Likert scales, rank order datadata
Assumptions of normalcyAssumptions of normalcy ValidityValidity
Internal & External validityInternal & External validity Pilot testingPilot testing
You need variance to analyze!You need variance to analyze! Sample sizeSample size
It depends; power, effect size, cost (UCLA power calculator)It depends; power, effect size, cost (UCLA power calculator)
Once You’ve Found or Once You’ve Found or Collected your dataCollected your data
Download the data and documentationDownload the data and documentation StatTransfer (Statlab)StatTransfer (Statlab)
Determine data file typeDetermine data file type Probably a text file (.txt, .dat, .raw)Probably a text file (.txt, .dat, .raw)
Converting text & delimited filesConverting text & delimited files
Choose a statistical software programChoose a statistical software program SPSSSPSS
Managing your dataManaging your dataBack up all Master Data FilesBack up all Master Data Files
CDR/CDRW, USB Key CDR/CDRW, USB Key
CodebookCodebook All codes All codes Adding variables, cases, computing new Adding variables, cases, computing new
variablesvariables
Keep a roadmap Keep a roadmap Keep a log of all analyses with what you Keep a log of all analyses with what you
have donehave done Save syntax filesSave syntax files
Syntax FilesSyntax FilesWhat are they?What are they?
Text-files used to enter commands in bulkText-files used to enter commands in bulk
Is it worth learning?Is it worth learning?You will make mistakes, need to make You will make mistakes, need to make
changeschanges
SPSS and many other programs let you use SPSS and many other programs let you use pull down menus pull down menus
How do I know what to write?How do I know what to write?Program’s manual provides the underlying Program’s manual provides the underlying
commandcommand
So, how do I analyze my So, how do I analyze my data?data?
Correlational designCorrelational design Correlation allows you to quantify relationships Correlation allows you to quantify relationships
between variables (r, r-squared)between variables (r, r-squared) Correlation, partial correlationCorrelation, partial correlation Regression allows you predict scores on 1 variable Regression allows you predict scores on 1 variable
from subjects score on another variable(s) from subjects score on another variable(s)
Group differencesGroup differences t-test & ANOVAt-test & ANOVA Chi-square for categorical and frequency dataChi-square for categorical and frequency data
Significance v. effect sizeSignificance v. effect size
Important Control Variable(s)Important Control Variable(s)
GraphsGraphs
Summary Statistics on Key VariablesSummary Statistics on Key VariablesNumber, Mean, Minimum, Maximum, Standard Number, Mean, Minimum, Maximum, Standard
DeviationDeviation
Cross-TabsCross-Tabs
Putting Output into a Putting Output into a PaperPaper
Cut and PasteCut and PasteGraphsGraphs
Cut and Paste into Word Processing documentCut and Paste into Word Processing document
Save as .jpeg or .tif fileSave as .jpeg or .tif file
TablesTablesCut and PasteCut and Paste
Format in Word Processing documentFormat in Word Processing document
Import into Excel, format, and then place in WordImport into Excel, format, and then place in Word
More Advanced AnalysisMore Advanced AnalysisMultivariate techniques help to account for Multivariate techniques help to account for
confounding factors, allow for testing confounding factors, allow for testing change over time and more complex change over time and more complex hypotheseshypotheses……
(See: Tabachnick & Fidell, Using Multivariate (See: Tabachnick & Fidell, Using Multivariate Statistics)Statistics)
1)1) Be honest about your abilities.Be honest about your abilities.
2)2) Ask for helpAsk for help
3)3) Best off including techniques that you fully Best off including techniques that you fully understand.understand.
Take Away MessagesTake Away Messages
1)1) Determine your question, methods Determine your question, methods and statistics before you startand statistics before you start
2)2) Keep a codebook of everythingKeep a codebook of everything
3)3) Back up dataBack up data
4)4) Ask for helpAsk for help
5)5) Don’t Get In Over Your HeadDon’t Get In Over Your Head