Nuxeo World Session: Semantic Technologies - Update on Recent Research

Nov. 17 2010 - S. Fermigier & O. Grisel, Nuxeo

Towards semantic ECM:report on the IKS and Scribo projects

Monday, November 22, 2010

Outline

• Introduction to semantic technologies

• Collaborative R&D within the Scribo and IKS projects

• Fise & Apache Stanbol / Nuxeo Integration

1. Introduction to semantic technologies

Illustration source: Mills Davis, “Semantic Social Computing”, sept. 2007Monday, November 22, 2010

Photo source: http://www.flickr.com/photos/pixelydixel/Monday, November 22, 2010

Invented the web in 1989(yeah!)

Invented the semantic web in 1999 (duh?)

Historical perspective

• From web 1.0: web of pages, aka the World Wide Web

• To web 2.0: web of people and of participation, aka the Social Web

• To web 3.0: web of data, of meaning and of connected knowledge, aka the Semantic Web

Picture source: http://www.flickr.com/photos/pixelydixel/Monday, November 22, 2010

A “layer cake” of technologies

“Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/”

Linked Online Data in 2007

Good for Enterprise apps too!

Diagram source: http://www.w3.org/2007/Talks/0130-sb-W3CTechSemWeb/Monday, November 22, 2010

Key Enablers

• Open Data and Linked Online Data

• Advances in automatic content analysis (linguistics, image processing)

• Computing power (Moore’s law + MapReduce)

• Classical logic and classical AI

let’s put them to use!

The technologies and data are available,

Content Meaning

Metadata

Relations

EntitiesTags

Reasoning

Semantic ECM

Goals for Semantic ECM(& Nuxeo)

• Repurpose existing content

• Improve search and collaboration

• Make information contextual

• Extract and use information from your content

•Make your content smarter!

Challenges

• Extract meaning from content

• Enrich content with knowledge

• Enhance interaction with content thanks to added meaning

Business valuefrom semantic ECM

• Efficiency gains: 20% to 90% (ex: in search, collaboration)

• Effectiveness gains: better returns from your assets (ex: news and images from AFP)

• Strategic edge: growth, value capture, new services, gain unfair strategic advantage (ex: vertical ontologies for CEVAs / CCAs)

2. SCRIBO and IKS

• Project under the french FUI program, with 9 partners, and a budget of 4.7 M€

• Goal: to develop algorithms and collaborative tools for extracting knowledge from unstructured documents and images

• Started in 2008, finishing in Dec. 2010, with results already integrated as a Nuxeo plugin

• European project under the FP7, with 13 partners (6 SMEs) and a 8.5 M€ budget

• Goal: create a semantic software “stack” that will be used by CMS vendors to add semantic features to their products

• Started in Jan. 2009, will last until Dec. 2012

• First tangible result: FISE, already integrated in a Nuxeo plugin

3. Linking Semantic EntitiesApache Stanbol - Nuxeo integration

What are entities?

What is wrong with tags?

• Many terms for same meaning

• NYC, New York, New York City

• Many meanings for same terms

• Need context to remove any ambiguity

Washington is...

Tagging with Entities

• Global namespace / universal meaning context

• Interoperability across domains

• Interoperability across applications

Demo time!

Screencast online at http://blogs.nuxeo.com/dev

How does this work?

• Open Source Semantic Engine

• HTTP Services

• For content driven applications

• OSGi: loosely coupled components

• Analysis Engines

• Knowledge RDF vocabularies

What is a semantic engine?

• Unstructured content => Knowledge

• Language guessing

• Topic classification (Business, Sports, Media, ...)

• Named Entities extraction and linking

• Relationships and properties extraction

RESTfulis

Beautiful

curl -X POST \ -H "Accept: application/json" \ -H "Content-type: text/plain" \ --data "John Smith works at Smith Consulting in Paris." \ http://fise.demo.nuxeo.com/engines

{ "urn:enhancement-1564680b-861c-df6f-fdf9-d34a75d68dfe": { "http://fise.iks-project.eu/ontology/selected-text": [ { "datatype": "http://www.w3.org/2001/XMLSchema#string", "type": "literal", "value": "Paris" } ], "http://fise.iks-project.eu/ontology/selection-context": [ { "datatype": "http://www.w3.org/2001/XMLSchema#string", "type": "literal", "value": "John Smith works at Smith Consulting Paris." } ], "http://purl.org/dc/terms/type": [ { "type": "uri", "value": "http://dbpedia.org/ontology/Place" } ] }, …

= fise +

fast Linked Data local index +

semantic rule engine+

more ?

Apache Stanbol / Nuxeo integration

Local IT infrastructure (LAN) 45

Nuxeo DM

Apache Stanbol

Engine 1

Engine 2

Engine 3

DBpedia

Freebase

GeonamesLDAP

• Implemented as an Operation for Studio

• Entities & Relationships stored in Nuxeo Core

• CMIS interoperability

Soon available on marketplace.nuxeo.com

• http://iks-project.eu

• http://fise.demo.nuxeo.com

• http://scribo.ws

• http://incubator.apache.org/stanbol

• http://blogs.nuxeo.com/dev

Questions?

Nuxeo World Session: Semantic Technologies - Update on Recent Research

web of data

semantic ecm nuxeo

semantic features

semantic webmonday

semantic technologiesmonday

social web

unstructured content

open data cloud diagram

Technology

Nuxeo - OpenSocial

Nuxeo World Session: Building Packages for the Nuxeo...

Nuxeo World 2010 — Contributing to Nuxeo

Nuxeo Drive

[Nuxeo World 2013] NUXEO DRIVE: AN EXTENSIBLE SOLUTION FOR.....

Nuxeo - Instalación Nuxeo

Nuxeo Enterprise Platform - Version...

Creating and Exploiting a Web of Semantic Data. Overview...

Nuxeo Enterprise Platform: Guide...

Nuxeo and JavaScript

Nuxeo Semantic ECM: from Scribo and Stanbol to valuable...

Apogée Nuxeo RCP - EclipseCon 2020€¦ · Nuxeo • OSS.....

nuxeo use cases

[Nuxeo World 2013] Workshop - Build your data model and UI.....

ECM and Semantic Web -...

[Webinar] Build Plugins Easily, with Nuxeo Studio and Nuxeo....