Top Banner
Semantic Search Andreas Blumauer powered by
31

Semantic search

Jan 14, 2015

Download

Technology

Semantic search based on thesaurus management. The use of thesauri improves search engines. Scenarios will be shown in this presentation.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Semantic search

Semantic Search

Andreas Blumauer

powered by

Page 2: Semantic search

Agenda

• Semantic search scenarios

• The role of thesauri in semantic search

• PoolParty Semantic Search

– Live Demo – http://bit.ly/semantic_search

2

Page 3: Semantic search

3

Semantic search scenarios

Semantic search has many faces

htt

p:/

/ww

w.f

lickr

.co

m/p

ho

tos/

tech

bu

rst/

27

96

42

12

48

/

Page 4: Semantic search

Situations in which semantic search can help

4

I can´t remember how

to spell the search term

I can´t remember how

to spell the search term

I can´t remember

exactly what I was looking for

I can´t remember

exactly what I was looking for

I want to gain background

knowledge to a certain

document

I want to gain background

knowledge to a certain

document

I want to know more about

this entity in a certain context.

I want to know more about

this entity in a certain context.

I want to see facts from

different sources describing this

entity.

I want to see facts from

different sources describing this

entity.

I want to search in different

languages simultaneously

I want to search in different

languages simultaneously

I forgot some of the names for the entity I´m looking for

I forgot some of the names for the entity I´m looking for

I want the software to understand

what I mean by „Jaguar“

I want the software to understand

what I mean by „Jaguar“

Page 5: Semantic search

Types of Search

5

(1) Pinpoint-Search (factual knowledge) i.e. „Eyjafjallajökull“

(2) Collecting and Researchi.e. „volcanoes in Iceland“

(3) Associative Search / Discovery of interrelationsi.e. Volcanic eruptions and climate change

(4) Questions & Answersi.e. „Which volcanoes in Iceland erupted in 2010?“

(5) Serendipity Discovery of unexpected, but relevant contexts and coherencesLe

arni

ng/N

avig

atin

g

S

earc

h

Page 6: Semantic search

Four demands for a smarter search

1. Find information faster Provide search assistants

2. Reveal hidden information Enrich the search index with background knowledge

3. Find more specific informationQuery the semantic web

4. Find linked informationIntegrate data sources

6

Page 7: Semantic search

Find information faster – Auto-Complete

7

I can´t remember how

to spell the search term

I can´t remember how

to spell the search term

To provide powerful auto-complete also for enterprise searchscenarios you need to establish an enterprise vocabulary.To provide powerful auto-complete also for enterprise searchscenarios you need to establish an enterprise vocabulary.

Page 8: Semantic search

Find information faster – Status quo

8

hydropower plantsSearc

h

I can´t remember

exactly what I was looking for

I can´t remember

exactly what I was looking for

Small hydro

Search

Page 9: Semantic search

Find information faster with related search terms

9

hydropower plantsSearc

h

http://www.reegle.info/clean-energy-search

Page 10: Semantic search

Reveal hidden information – Status quo

10

SNCRSearc

h

SNCR OR „Selective non-

Search

I forgot some of the names for the entity I´m looking for

I forgot some of the names for the entity I´m looking for

Page 11: Semantic search

Reveal hidden information with query expansion

11

SNCRSearc

hOR "selective non catalytic reduction"

SNCR

selective non catalytic reduction

alternative Label

preferred Label

Page 12: Semantic search

Multi-lingual search based on a thesaurus

12

clean energy Searc

hOR energía limpia

clean energy

energía limpiapreferredLabel @es

preferred Label @en

I want to search in different

languages simultaneously

I want to search in different

languages simultaneously

Page 13: Semantic search

Reveal hidden information and relations

13

Find documentsor images relatedto any other text.

http://poolparty.punkt.at/demozone

I want to gain background

knowledge to a certain

document

I want to gain background

knowledge to a certain

document

Page 14: Semantic search

Find more specific information – Status quo

14

Goldman SachsSearc

h

3 different contexts for„Goldman Sachs“:• Bond issuer• Analyst• Stock

3 different contexts for„Goldman Sachs“:• Bond issuer• Analyst• Stock

I want to know more about

this entity in a certain context.

I want to know more about

this entity in a certain context.

Page 15: Semantic search

Find more specific information with faceted search

15

facets supportstructured queries

facets helpto drill down search results,adapt dynamically

Zero-result querieswon´t happen anymore

Page 16: Semantic search

Complex queries with faceted search over linked data

16

„Show me all airlines whose parent company is Lufthansa“

„Show me all airlines whose parent company is Lufthansa“

http://dbpedia.neofonie.de/

Page 17: Semantic search

My Energy-Dossier about

Find linked information – Status quo

17

I want to see facts from

different sources describing this

entity.

I want to see facts from

different sources describing this

entity.

The user has to put together manually energy-relatedinformation about a country.

The user has to put together manually energy-relatedinformation about a country.

Page 18: Semantic search

360O views: Find linked information

18

Energy-relatedinformation about countriesare „mashed“ automaticallyby using „linked data“

Energy-relatedinformation about countriesare „mashed“ automaticallyby using „linked data“

http://www.reegle.info/countries

Page 19: Semantic search

Add personal context to the search

19

I want the software to understand

what I mean by „Jaguar“

I want the software to understand

what I mean by „Jaguar“

JaguarSearc

h

Page 20: Semantic search

20

The role of thesauri in semantic search

How vertical search can benefit from knowledge models

htt

p:/

/ww

w.f

lickr

.co

m/p

ho

tos/

tech

bu

rst/

27

96

42

12

48

/

Page 21: Semantic search

The role of thesauri in semantic search

21

Page 22: Semantic search

The role of thesauri in semantic search (contd.)

22

Thesaurus as the central pointto control:

•labels & query expansion•facets•refine search mechanisms•metadata integration

Thesaurus as the central pointto control:

•labels & query expansion•facets•refine search mechanisms•metadata integration

Page 23: Semantic search

Data integration and schema mapping based on thesauri

23

<person> Thomas Miller</person>

Source 1

<employee> Tom Miller</employee>

Source 2

Page 24: Semantic search

24

PoolParty Semantic Search (PPSS)

Make semantic search come true!

htt

p:/

/ww

w.f

lickr

.co

m/p

ho

tos/

tech

bu

rst/

27

96

42

12

48

/

Page 25: Semantic search

PoolParty System Architecture

25

Search Services

Search Application

Collector<xml>

Semantic Indexer

Document Index

Cartridge

Page 26: Semantic search

Indexing and Mapping with PoolParty

• Metadata Standards

– Rich metadata in a standardized, extensible format (SKOS / RDF)

– Document metadata is mapped to concepts in the thesaurus

• Cost efficient metadata management

– Thesaurus is managed with PoolParty´s easy-to-use Thesaurus Manager

– One central metadata repository

• Improved end-user experience

– Semantic information improves search experience26

Page 27: Semantic search

PoolParty Search API & Standard GUI

27

• Available web services:• Search Service• Suggest Service• Similarity Service

• Supported formats:• JSON• XML• RSS

• Available web services:• Search Service• Suggest Service• Similarity Service

• Supported formats:• JSON• XML• RSS

http://bit.ly/semantic_search

Page 28: Semantic search

PoolParty Semantic Search Demo – Background Info

2828

Search Services

Search Application

CollectorSemantic Indexer

Document Index

Cartridge

Thesaurus

Projects DB

Web catalogueof actors

Actors DB

Page 29: Semantic search

Data integration based on Reegle thesaurus

29

<sector> Hydro Power small scale</sector>

Actors DB

<category> Micro Hydro</category>

Web catalogue

Page 30: Semantic search

PoolParty Semantic Search Demo – Result

30

http://bit.ly/semantic_search

select properfacets

store querieswith search basket

facets supportstructured queries

find similar documents forrelevant results

specify your querywith categorisedauto-complete

Page 31: Semantic search

Contact

Andreas BlumauerManaging [email protected]+43-1-8974122-27

Alexander KreiserSystem [email protected] +43-1-8974122-38

31

punkt. netServices GmbH

Lerchenfelder Guertel 43A—1160 Wien / Austria

http://www.punkt.at/ http://poolparty.punkt.at/

http://bit.ly/semantic_searchhttp://lod2.eu/

http://twitter.com/PoolParty_Teamhttp://www.facebook.com/pages/

PoolParty/134189476633941

powered by