Top Banner
Data Reproducibility as a Social System of Trust Orfeu M. Buxton, PhD Professor, Biobehavioral Health Data Reproducibility Boot Camp 2019-06-03 (4 Shashi)
23

Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Aug 11, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Data Reproducibility as a Social System of Trust

Orfeu M. Buxton, PhDProfessor, Biobehavioral Health

Data Reproducibility Boot Camp 2019-06-03(4 Shashi)

Page 2: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Sleep, Health & Society Collaboratory

Biopsychosocial model

v Collaboratory research topics:

• causes of sleep deficiency in the workplace, home, and society

• health consequences of sleep deficiency, especially cardiometabolic outcomes, and the mechanisms by which these outcomes arise

Page 3: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Lifecourse Context of Health Behaviors

v this matters for health and well-being

v can influence health disparities

v bias for action (intervention)

Page 4: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

The Myth of Sisyphus

Page 5: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Why are you here?

Page 6: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

PipelineIdea > funding > collect data. >. manage > analyze > interpret

The time is past where you can do it all yourself

Page 7: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

data entry and double-checking1990 Alone or in pairs, analog to digital

2000 Merging across systems, narrow queries

2010 Merge/query complex databases

2020

Page 8: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Harmonizing1990 Consistency of measurement

2000 Consistency across studies

2010 Consistency across studies, teams, time

2020

Page 9: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

That Jerk at my Talk

Page 10: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Firing a Cheater

Poison to a social system

Page 11: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Unblinding

A social contract

Page 12: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Harmonizing again1990 Consistency of measurement

2000 Consistency across studies

2010 Consistency across studies, teams, time

2020

Page 13: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Ars Longica

Life is shortand the art long,Occasion instantExperiment perilousDecision difficult

Page 14: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

SCALING

Page 15: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

PennState.Pure

Accessed 2019-05-15

https://pennstate.pure.elsevier.com/en/persons/orfeu-m-buxton/publications/

Network

Page 16: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”
Page 17: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”
Page 18: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”
Page 19: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Worst thingyou can call a scientist?

Sloppy

Page 20: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Sausage-makingunfundableIrreproducibleP-hackingWasting timeFlop at reviewJerky

Open Science Frameworkhttps://osf.io/

Productivity & citationsEfficiency (Jupyter.org)Developing lines of researchTrust of peers

Page 21: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Attention to Purpose

Pre-specification, documentation

Scaling a data pipeline

Science, a social system

Page 22: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

The Myth of Sisyphus

“One must imagine Sisyphus happy.” - Albert Camus

Page 23: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Data Reproducibility as a Social System of Trust

Orfeu M. Buxton, PhDProfessor, Biobehavioral Health

Data Reproducibility Boot Camp 2019-06-03(4 Shashi)