Scott Edmund Data dissemination in the era of “big data” www.gigasciencejournal.com William Gibson: "Information is the currency of the future world” Sir Tim Berners-Lee: "Data is a precious thing and will last longer than the systems themselves” G-Europe Meeting, 24 th May 2012 Image: s-ariga
50
Embed
Scott Edmunds: Data Dissemination in the era of "Big-Data"
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Scott Edmunds
Data dissemination in the era of “big data”
www.gigasciencejournal.com
William Gibson: "Information is the currency of the future world”
Sir Tim Berners-Lee: "Data is a precious thing and will last longer than the systems themselves”
ICG-Europe Meeting, 24th May 2012
Image: s-ariga cc/Flickr
Is data “the new oil”?
Data Bonanza?
Data Deluge?
1.2 zettabytes (1021) of electronic data generated each year1
1. Mervis J. U.S. science policy. Agencies rally to tackle big data. Science. 2012 Apr 6;336(6077):22.
Editor-in-Chief: Laurie Goodman, PhDEditor: Scott Edmunds, PhDAssistant Editor: Alexandra Basford, PhDLead BioCurator: Tam Sneddon, DphilData Platform: Peter Li, PhD
Cultural: inertiano incentives to share unaware of how
There are many hurdles…
Technical challenges…
Cloud solutions?
Better handling of metadata…
Novel tools/formats for data interoperability/handling.
Data quality assessment
Tools making work more easily reproducible…
WorkflowsInteroperability/Ease of use
Technical challenges…
Cloud?
More efficient handling of data…
Do we need to keep everything?
Compression?
Technical challenges…
Cultural challenges…
Data Re-use
($)
Effort
Usability
Need to lower the hurdles…
($)
Effort
Usability
Better incentives?
($)
Effort
Usability
Incentives/creditCredit where credit is overdue:“One option would be to provide researchers who release data to public repositories with a means of accreditation.”“An ability to search the literature for all online papers that used a particular data set would enable appropriate attribution for those who share. “Nature Biotechnology 27, 579 (2009)
Prepublication data sharing (Toronto International Data Release Workshop)“Data producers benefit from creating a citable reference, as it can later be used to reflect impact of the data sets.” Nature 461, 168-170 (2009)
Datacitation: Datacite and DOIsDigital Object Identifiers (DOIs)
offer a solution
Mostly widely used identifier for scientific articles
Researchers, authors, publishers know how to use them
Put datasets on the same playing field as articles
DatasetYancheva et al (2007). Analyses on sediment of Lake Maar. PANGAEA.doi:10.1594/PANGAEA.587840
“increase acceptance of research data as legitimate, citable contributions to the scholarly record”.
Aims to:
“data generated in the course of research are just as valuable to the ongoing academic discourse as papers and monographs”.
Datacitation: Datacite and DOIsCentral metadata repository:
• >1 million entries to date
• Stability
• Data discoverability
• Open & harvestable
• Potential to track & credit use
www.gigasciencejournal.com
Data publishing/DOINew journal format combines standard manuscript publication with an extensive database to host all associated data, and integrated tools. Data hosting will follow standard funding agency and community guidelines.DOI assignment available for submitted data to allow ease of finding and citing datasets, as well as for citation tracking.
Plans in 2012 to link central metadata repository with WoS
- Will finally track and credit use!
To be continued…
DataCite metadata in harvestable form (OAI-PMH)
Final step: open licensing
To maximize its utility to the research community and aid those fighting the current epidemic, genomic data is released here into the public domain under a CC0 license. Until the publication of research papers on the assembly and whole-genome analysis of this isolate we would ask you to cite this dataset as:
To the extent possible under law, BGI Shenzhen has waived all copyright and related or neighboring rights to Genomic Data from the 2011 E. coli outbreak. This work is published from: China.
“Last summer, biologist Andrew Kasarskis was eager to help decipher the genetic origin of the Escherichia coli strain that infected roughly 4,000 people in Germany between May and July. But he knew it that might take days for the lawyers at his company — Pacific Biosciences — to parse the agreements governing how his team could use data collected on the strain. Luckily, one team had released its data under a Creative Commons licence that allowed free use of the data, allowing Kasarskis and his colleagues to join the international research effort and publish their work without wasting time on legal wrangling.”
Other consequences: speed/legal-freedom
The era of the data consumer?
The era of the data consumer?
?
The era of the data consumer?
?
Free access to data – but analysis hubs/nodes for will form around it
Data Modeling
Pipeline design
Validation
Commercial applications
Genomic Data Submission and Analytical platform
Big data from the
“Sequencing Oil Field”
GDSAP:
Data, Data, Data…
Tin-Lap Lee, CUHK
“Apps”
Genomic Data Submission and Analytical platform
GDSAP:
Genomic Data Submission and Analytical platform
GDSAP:
mirror/open platform
Papers in the era of big-data
To review: (>6TBp, >1500 datasets)
S3 = $15,000
EC2 (BLASTx) = $500,000
$1000 genome = million $ peer-review?
Source: Folker Meyer/Wilkening et al. 2009, CLUSTER'09. IEEE International Conference on Cluster Computing and Workshops
Papers in the era of big-data
Analysis Data
Tools/Workflows
Compute
goal: Executable Research Objects
Citable DOI
Papers in the era of big-dataInterested in Reproducible Research?
Take part in our session on: “Cloud and workflows for reproducible bioinformatics”
• Rapid review/Open Access/High-visibility• Article Processing Charge covered by BGI• Hosting of any test datasets/workflows in GigaDB