Tmql tutorials (english)

Introduction to Topic Maps

topicmapslab.de

Topic Maps Query Language

Sven Krusty M. Sc.

Topic Maps Lab at the University of Leipzig

[email protected]

Session 1


topicmapslab.de

Agenda

1. Basics

● TMQL metamodel

- Compared to TMDM● Grammar

2. TMQL as language

● Topic identification● Navigation concept


topicmapslab.de

BasicsMetamodel


topicmapslab.de

Metamodel

● represented as a topic map

● each topic can be used in the query

● Topic Maps represent different elements in TMDM


topicmapslab.de

TMDM


topicmapslab.de

TMQL

● Topic Map construct does not exist● no reification of topic maps possible● Query all topics difficult or Association


topicmapslab.de

TMDM


topicmapslab.de

TMDM → TMQL


topicmapslab.de

TMQL

● No distinction between name and Occurrence

→ Characteristics


topicmapslab.de

TMDM


topicmapslab.de

TMDM → TMQL


topicmapslab.de

TMQL

● no direct support of variants

→ Query only special feature


topicmapslab.de

TMDM


topicmapslab.de

TMDM → TMQL


topicmapslab.de

TMQL

● no role constructs

→ no reification of roles


topicmapslab.de

Summary

● No distinction between name andOccurrences

● No variations of name

● no role constructs

● A topic map construct


topicmapslab.de

BasicsGrammar


topicmapslab.de

Grammar

● defined in three levels

● each level was inspired by other standards


topicmapslab.de19

Token Level

● Terminal symbols of the language

● Definition based on regular expressions

Token Level


topicmapslab.de20

Canonical Level

● Definition of production rules

Example: tuple-expression: = <value-expression>

Token Level

Canonical Level


topicmapslab.de21

Non-Canonical Level

Token Level

Canonical Level

Non-Canonical Level

● Term substitution as new production rules

● Definition of shorter terms

anchor / tm: name ==> anchor>> chracteristics tm: name


topicmapslab.de

Language skills ofLiterals and constants


topicmapslab.de

Literals and constants

● Constants (atoms) are data types and operators

● Acquisition of CTM data types


topicmapslab.de

Literals and constantsAtom possible valueAtom Undefined | boolean | number | date | datetime | string | iri

undefined undef

boolean true or false

number decimal or integer

decimal /[+-]?/ +(/./ D d +)? /

integer /[+-]?/ D + /

date '-'? yyyy '-' mm '-' dd (zzzzzz)?

DateTime '-'? yyyy '-' mm '-' dd 'T' hh ':' mm ':' ss ('.' s +)? (Zzzzzz)?

iri see RFC 3987

string /"([^"]|/")*"/ | /'([^']|/')*'/


topicmapslab.de

Language skills ofTopic identification


topicmapslab.de

Topic identification

● Use of references or string literals

● String literals translated by axes

● References are automatically translated

● Subject identifier● Subject Locator● Item Identifier


topicmapslab.de


● item-identifier

puccini

● subject-identifier

http://en.wikipedia.org/wiki/Puccini

● subject-locator

http://en.wikipedia.org/wiki/Puccini


topicmapslab.de


● Item identifier

"Puccini" <<item

● Subject-identifier

"Http://en.wikipedia.org/wiki/Puccini"<<Indicators

● Subject locator

"Http://en.wikipedia.org/wiki/Puccini"<<Locators


topicmapslab.de

Language skills ofNavigation concept


topicmapslab.de30

Navigation concept

● based on the proxy concept of TMRM

● Model of the topic map as an abstract bi-directional graph

● Definition of 12 axes (+2 NCL)


topicmapslab.de31

Navigation concept - Syntax

DIRECTION:: = '<<' | '>>'

AXIS-NAME:: = 'item' | 'indicators' | 'locators' | 'traverse' |'Players' | 'roles' | 'types' | 'reifier' | 'atomify' |'Characteristics' | 'super types' | 'scope'

STEP:: = DIRECTION AXIS-NAME [TOPIC-REF]


topicmapslab.de32

Axis - indicators

● no optional types

● Next: All Subject identifier of a topic

● Prev: addressing a topic with subject identifier


topicmapslab.de33

Axis - indicators

http://en.wikipedia.org/wiki/Puccini>> indicators

"Http://en.wikipedia.org/wiki/Puccini" <<indicators


topicmapslab.de34

Axis - locators


● Next: All Subject locator of a topic

● Prev: addressing a topic with subject Locator


topicmapslab.de35

Axis - locators

http://en.wikipedia.org/wiki/Puccini>> locators

"Http://en.wikipedia.org/wiki/Puccini" <<locators


topicmapslab.de36

Axis - item


● without pluralization!

Items →

● Next: all item identifier of a topic

● Prev: Addressing a topic of Item Identifier


topicmapslab.de37

Axis - item

http://en.wikipedia.org/wiki/Puccini>> item

"Http://en.wikipedia.org/wiki/Puccini" <<item


topicmapslab.de38

Axis - types


● Next: all types of a topic or the type of topic mapsConstruct

● Prev: all instances of a type Topic

● NCL: instances - Axis

● Next: all instances of a topic type● Prev: all types of topics or the type of Topic

Maps construct


topicmapslab.de39

Axis - types

http://en.wikipedia.org/wiki/Puccini>> types

http://psi.ontopia.net/music/composer <<types

http://en.wikipedia.org/wiki/Puccini <<instances

http://psi.ontopia.net/music/composer>> instances


topicmapslab.de40

Axis - super types


● forward: all the super types of a type Topic

● Prev: all sub-types of a type Topic

● NCL: subtypes - Axis

● Next: all sub-types of a type Topic● Prev: all super types of a type Topic


topicmapslab.de41

Axis - super types

http://psi.ontopia.net/music/composer>> super types

http://psi.ontopia.net/music/musician <<super types

http://psi.ontopia.net/music/composer <<subtypes

http://psi.ontopia.net/music/musician>> subtypes


topicmapslab.de42

TMQL - Type Hierarchy

e1

A

B CD

E F G

e2 g1 g2


topicmapslab.de43

e1

A

B CD

E F G

e2 g1


e1>> types


topicmapslab.de44

e1

A

B C

E F

e2 g1 g2


E>> super types

45

e1

A

B CD

F G

g1 g2


TMQL Query: A>> instances


46

Axis - characteristics

● forward: all the features of a topic

● Prev: the topic with the property

● predefined types

● all name● All Occurrences

topicmapslab.de47

>> Characteristics

http://en.wikipedia.org/wiki/Puccini>> Characteristics tm: occurrence

topicmapslab.de

e1

Name 1 t

g

Occurrence 1 t

g


topicmapslab.de

e1

Name 1 t

g

Occurrence 1

Occurrence 2

t

g

TMQL - characteristics axis

TMQL Query: e1>> characteristics g


topicmapslab.de

END


topicmapslab.de


Sven Krusty M. Sc.


[email protected]

Session 2


topicmapslab.de

Agenda

1. Navigation Concept II

2. Path Language - Draft 2010 (short view)


topicmapslab.de

Language skills ofNavigation concept


topicmapslab.de4

Navigation concept

● based on the proxy concept of TMRM

● Definition of 12 axes (+2 NCL)

topicmapslab.de5

DIRECTION:: = '<<' | '>>'

AXIS-NAME:: = 'item' | 'indicators' | 'locators' | 'traverse' |

'Characteristics' | 'super types' | 'scope'

STEP:: = DIRECTION AXIS-NAME [TOPIC-REF]


topicmapslab.de

Axis - indicators

●

● Next: All Subject identifier of a topic

●

7

Axis - indicators

http://en.wikipedia.org/wiki/Puccini>> indicators

topicmapslab.de

topicmapslab.de


topicmapslab.de10

no optional types

Items →

Next: all item identifier of a topic


11

Axis - item

topicmapslab.de


●

Construct

●

Next: all instances of a topic type● Prev: all types of topics or the type of Topic


13

http://en.wikipedia.org/wiki/Puccini <<instances

http://psi.ontopia.net/music/composer>> instances

topicmapslab.de

no optional types

forward: all the super types of a type Topic

●

-

http://psi.ontopia.net/music/musician <<super types


topicmapslab.de16

e1

A

B CD

E F G

e2 g1 g2


topicmapslab.de17

e1

A

B CD

E F G

e2 g1 g2


e1>> types

topicmapslab.de

A

B

F G

g2

TMQL Query:

topicmapslab.de

e1

C

G

forward: all the features of a topic

all name● All Occurrences

topicmapslab.de

Axis - characteristics

http://en.wikipedia.org/wiki/Puccini>> Characteristics tm: name


Name 2

t

e1>> characteristics g


Next: Literal of the specific object

http://en.wikipedia.org/wiki/Puccini>> Characteristics>> atomify

topicmapslab.de26

Axis - players

● Next: all players an association

● by an association of type Topic● optional type = Role Type

● Prev: all association with the player

● optional type = Role Type


topicmapslab.de27

Axis - players

http://en.wikipedia.org/wiki/Puccini <<players

http://psi.ontopia.net/music/composed-by>> players


topicmapslab.de

Axis - roles

● Next: all types of roles an association

●

●

optional type = type of association


topicmapslab.de29

http://psi.ontopia.net/music/composed-by>> roles

30

● Concatenation of an association between two topics

●

●

topicmapslab.de31


32

p1 p3p2

r2

TMQL - association axes

p2 <<play>> roles [. >> Players == p2]

r1 a1

p2

r3

35

p1

http://psi.ontopia.net/music/composed-by>> scope

Axis - reifier

● no optional type

Next: the construct of Reifier

● Prev: the reified element

topicmapslab.de

Axis - reifier

http://psi.ontopia.net/music/composed-by>> reifier


topicmapslab.de

Language skills ofDraft 2010


topicmapslab.de41

Draft 2010

● only path expression

● Changes

● navigation similar concept with a modified syntax●

● additional axes● Removal of some axes

Syntax closer to XPath

Standard axles for each construct type (axes optional)


topicmapslab.de42

pathspec → axis '::' anyref | axis '::' | anyref | assocpattern

filter → boolfilter | scope filter


topicmapslab.de

type, direct-type, instance, direct-instance

topicmapslab.de

●

- Boolean expression- Filter types

● Projection

2. Operators


topicmapslab.de

Language skills ofPostfix


Postfix

as a supplement for Path Expression (simple content)

● allow precise definition of the result set in PathExpressions

● Types

● Filter● Projection


topicmapslab.de

Language skills ofFilter


7

Filter

●

●

topicmapslab.de

●

NOT

● Number of satisfying tuples

At most 3$ Opera IN / / o: opera

]

/ / O: composer

$ Opera IN / / o: operaSatisfies $ opera>> traverse o: composed-by ==.

]

Condition


topicmapslab.de15

Quantitative Boolean expression

% Prefix o http://psi.ontopia.net/music/

/ / O: composer

[

At most 3$ Opera IN / / o: operaSatisfies $ opera>> traverse o: composed-by ==.

]

→ all the composers who composed more than 3 operahave

topicmapslab.de16

Quantitative Boolean expression

numerically-free condition

● exact number of satisfying tuples irrelevant

● Maximum upper

EVERY binding-set satisfies boolean-expression


topicmapslab.de17

/ / O: composer

topicmapslab.de


]

all composers, which at least one opera

NCL-Filter - Filter Index

● special tuple from the result sequence

● empty set if index is outside the possible range

● Syntax:

[Number] → [$ # == number]● Example:

/ / Http://psi.ontopia.net/music/composer / tm: name [0]


topicmapslab.de24

●

● Zero-based indexes

all items covered by the index range

● Syntax

[A .. b] → [a <= $ # $ # AND <b]●


topicmapslab.de

NCL-Filter - Filter Scope

Filtering by Themes

@ Theme → [. >> Scope == theme]

[@ Theme] → [. >> Scope == theme]

● Example:

/ / Http://psi.ontopia.net/music/composer / tm: name

[@ Http://psi.ontopia.net/basename/short-name]

26

NCL-filter - Type filter

Filtering by Type


Compare Draft 2010

Combination of filters


topicmapslab.de33


/ / O: composer

(

. ,

. / Tm: occurrence,

. >> Indicators


topicmapslab.de34

Projection


/ / O: composer

(

. ,

. / Tm: name,

. / Tm: occurrence,

. >> Indicators)

Projektionstupel


topicmapslab.de

Language skills ofOperators


36

● allowed in so-called value-expression or content

● eg part of a Boolean expression● different types

Mathematical Operators

Comparison operators●


43

less-than "<"

Number- String-

-

-


topicmapslab.de44

Comparison operators

● less than or equal '<='

● Supported data types:

- Number- String- Date- Time- DateTime


topicmapslab.de


greater-than '>'

Supported data types:

-

-

Time


DateTime

regular expressions '= ~'

●

NOTE: replaces the Draft 2010 by "minus"

51

● Intersection of '=='

● returns the intersection of both sets● Example:

Note: Draft 2010 replaced by 'intersect'


topicmapslab.de

END

topicmapslab . De


[email protected]

Session 4


topicmapslab.de

Review - Session 3

Postfix

● Filter

- Boolean expression- Filter types

Projection

Operators


topicmapslab.de

1. Features

● Draft 2007 Features

topicmapslab.de


5

Features

●

● Description:

● returns the length of string literals

other constructs are converted to literal

Note Draft 2010: renamed 'string-length'


topicmapslab.de11

Feature - length

● Example


→ all the names of Puccini with length 10


topicmapslab.de12

Construct literal transformation

● Topic → Name, Subject, Identifier, Subject locator Item Identifier

● Name → string literal

● Occurrence → string literal

● Variant → string literal

● Role → Item Identifier

Association → Item Identifier


topicmapslab.de13

Function - slice

●

●

● Description:

topicmapslab.de

● Identifier:

Functions TMQL4J

● Identifier:

● Arguments: a set and two numeric values

● Description:

Sub-set of strings defined by numerical values● numeric values define maximum range● Example: substring ("abc", 0, 9)

= {"Abc"}

Note Draft 2010: 3 Argument defines the set of characters


topicmapslab.de20

Features - Draft 2010

● Identifier: starts-with

● Arguments: a set of literals and Vergleichsliteral

● Description:

Checking whether literal begins with Vergleichsliteral● Example: starts-with ({"ab", "bc"}, "a")

Identifier: ends-with

Example:

=

22

{"", "C"}

topicmapslab.de


Identifier: normalize-space

● Arguments:

● Description:

● remove multiple occurrences of spaces● normalize-space ({"ab", "bc"})

= {"Ab", "bc"}

26


● Identifier: translate

● Arguments: a set of literals, and two more literals

● Description:

replaces each character of the 2nd Literal characters by the 3rd

Example: translate ("Puccini", "PCI", "xyz")

= {"Xuyyznz"}

● find

a set of literals and other literal

Example:

=

extract-regexp

Description:

●

{"Pucc"}

a lot of numeric literals

●

●

● round ({1.5, - 1.5, 5.1})

= {2, -1, 5}


topicmapslab.de32

Identifier: TopicMap

Arguments: no

● Description:

● returns the instance of the Topic Map


topicmapslab.de33


● Lite Ralf fonctions

● Transformation of construct to literals of theType

● Features

string● boolean● number

END

topicmapslab . De

Sven Krusty M. Sc.

[email protected]

Session 5

No sorting, as no keyword found!

unsorted result

{["C", "AA"] ["A", "BA"] ["C", "AB"] ["D", "AD"]}

Result?

1: {["A", "BA"] ["C", "AA"] ["C", "AB"] ["D", "AD"]}

2:


10

Sorting - Routine

... (/ Tm. Name [0] / tm. Name [1] ASC)

unsorted result

{["C", "AA"] ["A", "BA"] ["C", "AB"] ["D", "AD"]}

{["A", "BA"] ["C", "AA"] ["C", "AB"] ["D", "AD"]}


topicmapslab.de11

Sorting - Routine

Query

... (/ Tm. Name [0] DESC, / tm. Name [1])

unsorted result

{["C", "AA"] ["A", "BA"] ["C", "AB"] ["D", "AD"]}

sorted result?


topicmapslab.de12

Sorting - Routine

Query

... (/ Tm. Name [0] DESC, / tm. Name [1])

unsorted result

{["C", "AA"] ["A", "BA"] ["C", "AB"] ["D", "AD"]}

{["D", "AD"] ["C", "AA"] ["C", "AB"] ["A", "BA"]}

topicmapslab.de13

... (/ Tm. Name [0] DESC, / tm. Name [1] DESC)

{["C", "AA"] ["A", "BA"] ["C", "AB"] ["D", "AD"]}

sorted result?

topicmapslab.de

Sorting - Routine


Transitivity

topicmapslab.de

Pragma-definition - transitivity

Draft only defined as a transitive pragma

Signature

● identifier: taxonometry

QIRI: tm: intransitive


topicmapslab.de23

Pragma-definition - transitivity

% Prefix o http://psi.ontopia.net/

% Prefix tml http://www.topicmapslab.de/

% Pragma taxonometry tm: intransitive

/ / O: Composer + + / / tml: person


topicmapslab.de

Language skills ofSelect - Style


topicmapslab.de25

Select Style

syntactic similarity to SQL

● consists of a set of sub-expressions

● allow binding of variables

● single type with key word for duplicate - treatment andSelection

26

<Value-expression>

order

[

Limit

●

Commitment to values at run time by conditions●

-


predefined variables

● reserved system variables

@ _ Current Tuple

$ # current index

%% Environment Topic Map

% _ requested Topic Map

$ [0-9] + indexed element of a tuple

$ _ write-only variable


topicmapslab.de36

Where clause


SELECT $ composer

WHERE $ o ISA composer: composer


% Prefix l http://psi.ontopia.net/literature/

SELECT $ composer, $ opera

WHERE $ composer ISA o: o AND composer: composed-by (l: work:$ Opera, o: composer: $ composer)


topicmapslab.de

Language skills of


topicmapslab.de

Definition of path expressions

●

●

3. Content Types

● CTM


topicmapslab.de

Language skills ofFLW (O) R-Style


topicmapslab.de5

FLW (O) R-Style

● syntactic similarity to XML FLW (O) R or

●

● limited syntactic thickness (um Cf SELCT)

● allow binding of variables

●


topicmapslab.de6

[< for <Binding-set>>]

[ boolean-expression]

[ by <Value-expression>]

return


topicmapslab.de

●

→ defined content type and content of return

9

→ Topic for Puccini

RETURN wiki: Puccini / tm: name, wiki: Puccini>> indicators

RETURN $ composer, $ opera

→ Sort by Name of the composer


Language skills ofFor - Clause


topicmapslab.de18

For clause

defined range of values to bind variables

can contain multiple binding definitions

● Pattern

FOR variable IN context

For other IN other context-

...


topicmapslab.de19

For clause



IN FOR $ composer / o: composer

WHERE o: composed-by (l: work: $ opera, o: composer: $ composer)

ORDER BY $ composer / tm: name [0], $ opera / tm: name [0] DESC

RETURN $ composer, $ opera

→ Area of the variable $ composer limited to all composers


topicmapslab.de

For clause


IN FOR $ composer http://en.wikipedia.org/wiki/Puccini

WHERE o: composed-by (l: work: $ opera, o: composer: $ composer)

ORDER BY $ composer / tm: name [0], $ opera / tm: name [0] DESC


●

Variables only have validity within their queries(Inheritance of "child" query)

23

RETURN "" "$ {composer}" ""



XML - Content

● XML fragments are defined by XML tags

XML fragments can contain a lot of queries

●

● To use information as XML fragmentsExport (Web Services)


topicmapslab.de31

XML - Content



RETURN <yml>

{

IN FOR $ composer / o: composer

RETURN <composer> $ {Composer} </composer>

}

</yml>


topicmapslab.de32

XML - Content

● Topic Maps elements are transformed into XTM fragment

● simple data types are translated into strings

Strings are not processed in the current written


topicmapslab.de


Sven Krusty M. Sc.


[email protected]

topicmapslab.de

WHERE Clause


Conditional statement NCL

IN FOR $ topic / / tm: subject

RETURN

$ Topic>> indicators>> atomify [0] | | $ topic>> locator>> atomify [0]


topicmapslab.de

TMQL - Part II


topicmapslab.de11

TMQL Part II●

● TMQL based on Part I (TMQL - Query Language)

● syntactically based on the Draft 2007


topicmapslab.de12

TMQL Part II● defined change operations for Topic Maps

● Insert operation● Delete operation● Change operation● Merge rules


topicmapslab.de

Language skills of


topicmapslab.de14

Insert Expression●

Use of CTM as a definition language


topicmapslab.de23

Merge expression● Merging of Topics under TMDM

● Definition of a set of topics that are to be merged

● Using variables

● Where clause restricts a range of values of the variables

● Grammar

merge-expression:: = MERGE <value-expression>

WHERE boolean-expression


topicmapslab.de24

Merge expression

MERGE / / http://psi.example.org/type [. / Email == "[email protected]"]

→ all topics that meet the following condition to be merged

Instance of type http://psi.example.org/type●

● Occurrence is worth at least one of these [email protected]

topicmapslab.de25

Merge expression

AND $ person / email == $ other / email

→ People with the same e-mail address are merged


topicmapslab.de

Definition of a set of association which are to merge

merge-expression:: = MERGE association definition

WHERE boolean-expression


27

equivalent to Predicate Invocation (limited syntax)

● supply quantity of the Association to match the defined pattern

● Ellipse highlights strict processing

association-definition :: = <Part [...]>

part :: = (Ident | variable) ':' (ident | variable)


topicmapslab.de28

Association definition

m: composed-by (

m: composer: http://en.wikipedia.net/wiki/Puccini)

→ delivers all the associations which● of type "composer" is● exact role of type "composer" played by

Puccini has


topicmapslab.de29

Association definition

m: composed-by (

tm: subject: http://en.wikipedia.net/wiki/Puccini, ...)

→ delivers all the associations which

● at least played a role of Puccini has→ type of role is not restricted

30

% Prefix m http://psi.ontopia.net/music/

MERGE m: composed-by (

tm: subject: http://en.wikipedia.net/wiki/Puccini, ...)

→ merge all associations of type "composed"

Conditions

own type

themselves Scope

Sven Krusty M. Sc.

optional argument

Value-Ex: new value of the change


topicmapslab.de

● context-free changes (context, topic map!)

Add new association

→ without CTM

topicmapslab.de8

Create New Topic

● Keyword: topics

● Definition of Identifier

● Identifier already in use? → no change

UPDATE topics ADD "http://psi.example.org/topic"

→ no identifier type defined (default: Subject identifier)


topicmapslab.de9

Topic with subject identifiers to create

UPDATE topics ADD "http://psi.example.org/topic"

UPDATE topics ADD "http://psi.example.org/topic" ~

UPDATE topics ADD "http://psi.example.org/topic" <<indicators

→ new topic with a subject identifier


topicmapslab.de

Topic with Item Identifier Create

UPDATE topics ADD "http://psi.example.org/topic!

topicmapslab.de11


●

UPDATE associations ADD association-type (role-type: player)

→ all topics are not produced in existence


Variables can be bound by where clause

Keyword: names

● Optional: Name type

Context: Topic

WHERE http://en.wikipedia.org/wiki/Puccini


topicmapslab.de19

Name change

● Keyword: names

● Optional: no

● Context:

UPDATE names SET "name"

WHERE http://en.wikipedia.org/wiki/Puccini>> characteristicstm: name @ short-name


20

Create New Occurrence

● Keyword: occurrences

● Optional:

● Context:

topicmapslab.de

● Keyword: occurrences

no

UPDATE SET occurrences "1" ̂ ̂ xsd: integer

super types

Optional:

● Context: Topic

WHERE http://en.wikipedia.org/wiki/Puccini


27

Add new subtype

● subtypes

no

Context: Topic

UPDATE ADD subtypes http://en.wikipedia.org/wiki/Puccini

WHERE http://psi.example.org/type


topicmapslab.de28

Players change

● Keyword: players

● Optional: Role type (default: all roles!)

●

UPDATE players SET composer http://psi.example.org/me

WHERE http://en.wikipedia.org/wiki/Puccini <<players


topicmapslab.de

Keyword:

● Topic (players)

Context:

WHERE http://en.wikipedia.org/wiki/Puccini <<players


Reifier change

Keyword:

no

Tmql tutorials (english)

Technology