Batch import of large RDF datasets using RDFIO or the new rdf2smw tool Samuel Lampa - @smllmp PhD Student in Pharmaceutical Bioinformatics @ pharmb.io with Assoc. Prof. Ola Spjuth - @ola_spjuth @ Dept. of Pharm. Biosci. / Uppsala University Semantic MediaWiki Conference Fall 2016, Frankfurt am Main,
28
Embed
Batch import of large RDF datasets into Semantic MediaWiki
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Batch import of large RDF datasets using RDFIO or the new
● Importing 300K triples can take like 24h........
● What if you realize a mis-configurationonly after 24h?
Solution:
rdf2smw(new tool)
The new rdf2smw tool
● Convert RDF → MediaWiki XML (Really fast!)● Import via MediaWiki XML import (Still slow...)● But: Can now preview before the XML import!
More rdf2smw facts:
● Written in Go for compiled, multi-core performance● Very pluggable architecture● Easy to install: Just download and run!● Get it: github.com/samuell/rdf2smw
5) Surf in on localhost:8080/w/index.php/Special:RDFIOAdmin
6) Log in with Admin and changethis
7) Click “Setup”
Done!
Acknowledgements
● Denny Vrandečić (@vrandezo) - Basically had the same idea for an extension already when the (eventually accepted) GSOC proposal was submitted in 2010, and supported the project with valuable ideas and though mentoring the GSOC 2010 project.
● Ali King (@ali_king) – Has done great work at updating the extension to the latest standards and versions, and added the new template editing functionality, as part of aOPW 2014 project.
● Joel Sachs (@xjsachs) - Championed the addition of the template editing functionality, provided valuable encouragement and mentored Ali King’s FOSS OPW project.
● Egon Willighagen (@egonwillighagen) - Has supported the project with valuable testing, constructive feedback, encouragement and new ideas.
● Ola Spjuth (@ola_spjuth) – Has provided constructive feedback and encouragement, as well as financed parts of the further development of the project.
● Google Inc. - Supported the initial development through it’s summer of code program (GSOC) in 2010.
● Gnome Foundation - Supporting further development as part of its outreach program for women (OPW) in 2014.