WSU_August_2016 The next MERC (MARCS Monday Afternoon Research Colloquium), will be held Monday 1 August, 2016 @ 1pm in Bankstown Campus, Bldg 3.G.55. Lunch included before at 12pm MARC BLOCKBUSTER MARC Assoc Prof Alex Holcombe Title: Reproducibility, preregistration, et cetera: Making good science even better Abstract: Reproducibility problems afflict many sciences, including psychology. The problems are, to some extent, rooted in the criteria for and process of scientific publication. In response, many journals, funders and professional societies have begun incentivising change. For example, study preregistration, although traditionally used only by clinical trials researchers, is becoming more common. In this seminar, you will learn how it is now used even in basic experimental psychology, and how you can take advantage of preregistration and other new practices to smooth your path to publication and dissemination of your work. Bring your laptop (optional), walk with me through preregistering a study, and also learn how sites such as Open Science Framework facilitate project management and collaboration. One object of this seminar is to spark discussion of how we can all make our already wonderful system of science even better. Bio: Associate Professor Alex Holcombe has been active in several initiatives related to publishing innovations and open science, beginning in 2006 when he joined the founding advisory board of the journal PLoS ONE. He has been involved with PsychFiledrawer.org (co-founder), CurateScience.org, and the openness article badges (https://osf.io/tvyxz/) adopted by Psychological Science and others to reward open practices. Two years ago, he co-founded a new article type, the Registered Replication Report, at the journal Perspectives on Psychological Science.
29
Embed
Reproducibility, preregistration, etc.: Making good science even better
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
WSU_August_2016
The next MERC (MARCS Monday Afternoon Research Colloquium), will be held Monday 1 August, 2016 @ 1pm in Bankstown Campus, Bldg 3.G.55. Lunch included before at 12pm
MARCBLOCKBUSTER MARC
Assoc Prof Alex Holcombe
Title: Reproducibility, preregistration, et cetera: Making good science even better
Abstract:Reproducibility problems afflict many sciences, including psychology. The problems are, to some extent, rooted in the criteria for
and process of scientific publication. In response, many journals, funders and professional societies have begun incentivising change. For example, study preregistration, although traditionally used only by clinical trials researchers, is becoming more common. In this
seminar, you will learn how it is now used even in basic experimental psychology, and how you can take advantage of preregistration and other new practices to smooth your path to publication and dissemination of your work. Bring your laptop
(optional), walk with me through preregistering a study, and also learn how sites such as Open Science Framework facilitate project management and collaboration. One object of this seminar is to spark discussion of how we can all make our already wonderful
system of science even better.
Bio:Associate Professor Alex Holcombe has been active in several initiatives related to publishing innovations and open science,
beginning in 2006 when he joined the founding advisory board of the journal PLoS ONE. He has been involved with PsychFiledrawer.org (co-founder), CurateScience.org, and the openness article badges (https://osf.io/tvyxz/) adopted by
Psychological Science and others to reward open practices. Two years ago, he co-founded a new article type, the Registered Replication Report, at the journal Perspectives on Psychological Science.
1. Pre-registration does not intend to prevent researchers from conducting exploratory analysis or prevent serendipitous findings
2. It is solely to ensure that the distinction between exploratory and confirmatory findings is clear and transparent
For the times, they are a’changin’
Edwards, Lindman, & Savage (1963)
my other concern is more difficult to address. I has to do with your very small samples…Publication of low power studies is simply not good for the field in the long run - they inflate both the rate of false negatives and false positives in the literature (e.g., Ellis, 2010).
WSU_August_201623
https://osf.io/tvyxz/wiki/home/
100% P-hacking FreeHere, check our numbers.
Here’s how you can replicate our result.
CC-ZERO Alex Holcombe
For the times, they are a’changin’
WSU_August_201624
For the times, they are a’changin’
WSU_August_201625
Concerns
WSU_August_201626
New article formats,
WSU_August_201627
courtesy Chris Chambers (Cardiff)
WSU_August_2016
Any one of you go it alone, he’ll say you messed up. But if we first get him to approve the protocol, and then all run
the replication together…
WSU_August_2016
No
effe
ct
Hagger, M., & Chatzisarantis, N. (2016). A Multilab Preregistered Replication of the Ego-Depletion Effect. Perspectives on Psychological Science, 11 (4), 546-573