A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations Yolanda Gil 1 , Daniel Garijo 1 , Varun Ratnakar 1 , Deborah Khider 2 , Julien Emile-Geay 2 and Nicholas McKay 3 1 Information Sciences Institute, University of Southern California, 2 Department of Earth Sciences, University of Southern California, 3 School of Earth Sciences and Environmental Sustainability, North Arizona University @yolandagil, @dgarijov {gil,dgarijo}@isi.edu Information Sciences Institute ISWC In-Use Track, Vienna, 2017
14
Embed
A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
A Controlled Crowdsourcing Approach for Practical
Ontology Extensions and Metadata Annotations
Yolanda Gil1, Daniel Garijo1, Varun Ratnakar1,
Deborah Khider2, Julien Emile-Geay2 and Nicholas McKay3
1Information Sciences Institute, University of Southern California,2Department of Earth Sciences, University of Southern California,
3School of Earth Sciences and Environmental Sustainability, North Arizona University
@yolandagil, @dgarijov
{gil,dgarijo}@isi.edu
Information
Sciences
Institute
ISWC In-Use Track, Vienna, 2017
Data reuse in paleoclimate and environmental sciences
A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations (Gilt et al, ISWC In use track, Vienna, 2017)
• Data is collected using idiosyncratic notation and protocols by independentscientists.
• Hundreds of types of observations• Physical samples may be from ice, tree, coral, marine sediment, etc.
• Hundreds of types of measures• Temperature, rainfall, PH, etc.
• Diversity is so great that no one dares to embark on standards.
• Typical situation for environmental sciences (water modeling, hydrology etc.)
Challenges
• How can we leverage basic core agreements?
• How can scientist create new properties that they want to use to describetheir data?
• How to facilitate consensus on new extensions to core agreements?
• How can the scientific community immediately benefit from these continuedexpansion of core agreements?
• Coordination and maintenance of new extensions to core agreements
A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations (Gilt et al, ISWC In use track, Vienna, 2017)
Approach: Controlled crowdsourcing
• A metadata crowdsourcing platform
• Controlled standardization process for new metadata properties
• Framework for updating metadata of previously annotated datasets
A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations (Gilt et al, ISWC In use track, Vienna, 2017)
A Framework for Controlled Crowdsourcing
Data AnnotationCore
ontology
Snapshot
Snapshot Repository
Update
Ontology Repository
Coreontology revision
Crowdvocabulary
revision
Revision
Annotation Framework
Revision Framework
Update Framework
Version 0
Version 1
Requests & issues (core ontology)
Requests& issues
Extendedcrowd
vocabulary
Dataset metadata
Dataset metadata store
Changes-Monotonic changes-Non-monotonic changes
Crowdvocabulary
Load/reload
Load/reload
Reload datasets
Changes tocrowd vocabulary
Editorial Board
Basic editor
Datasets
Advancededitor
Core ontology
A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations (Gilt et al, ISWC In use track, Vienna, 2017)
Specifying metadata for a dataset
Data Download
Completed properties
Missing properties
Crowd Properties
Category
Category Annotation
A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations (Gilt et al, ISWC In use track, Vienna, 2017)
Fostering standardization
Suggestion of renames
Autocompletion
A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations (Gilt et al, ISWC In use track, Vienna, 2017)
Dynamic map-based visualizations
Dataset annotationinterface
Author credit Polls for decision makingCommunity discussions
Implementation: The Linked Earth Platform
A Controlled Crowdsourcing Approach for Practical Ontology Extensions and Metadata Annotations (Gilt et al, ISWC In use track, Vienna, 2017)
• Working Groups discuss new changes to the ontology
• Once a new version is approved, the core vocabulary released and versionedoutside the wiki:• Naming schema: http://linked.earth/ontology/module/version