Top Banner
Proposition Knowledge Graphs Gabriel Stanovsky Omer Levy Ido Dagan Bar-Ilan University Israel 1
39

Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

Dec 18, 2015

Download

Documents

Julie Ward
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

1

Proposition Knowledge Graphs

Gabriel Stanovsky Omer Levy Ido DaganBar-Ilan University

Israel

Page 2: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

2

Problem

End User

Page 3: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

3

Case Study: Curiosity (Mars Rover)

The Mars rover Curiosity is a mobile science lab.

Mars rover Curiosity will look for environments where life could have taken hold.

Curiosity will look for evidence that Mars might have had conditions for supporting life.

Curiosity, the Mars rover, functions as a mobile science laboratory. Curiosity successfully landed on Mars. Mars rover Curiosity successfully landed on

the red planet.

Curiosity is a fully equipped lab. Curiosity is a rover.

Page 4: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

4

Goal: Representation for Information Discovery• Representing a Single Sentence:

Captures maximum of the meaning conveyed

• Consolidation Across Multiple Sentences: Groups semantically-equivalent propositions

• Traversable Representation: Allows its end user to semantically navigate its structure

Page 5: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

5

Talk Outline

• Single Sentence Representation• SRL• AMR• Open-IE• Proposition Structure

• Proposition Knowledge Graphs • From Single to Multiple Sentence Representation

Page 6: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

6

SRLAMR

Open-IE

Existing Frameworks

Representing a Single Sentence

Page 7: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

7

Semantic Role Labeling (SRL)

• Maps predicates and arguments in a sentence to a predefined ontology

• Existing ontologies:• PropBank• FrameNet• NomBank

Page 8: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

8

Semantic Role Labeling (SRL)

“Curiosity successfully landed on Mars, after entering its atmosphere.”

Page 9: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

9

Semantic Role Labeling (SRL)

“Curiosity successfully landed on Mars, after entering its atmosphere.”

thing landing

manner location

time

entity entering

place entered

Page 10: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

10

Semantic Role Labeling (SRL)

Pros Cons

✔ Semantically expressive ✘ Misses propositions “Mars has an atmosphere”

✘ Relies on an external lexicon such as Propbank

Page 11: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

11

SRLAMR

Open-IE

Existing Frameworks

Representing a Single Sentence

Page 12: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

12

Abstract Meaning Representation (AMR)• Maps a sentence onto a hierarchical structure of propositions

• Uses PropBank for predicates, where possible

Page 13: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

13

Abstract Meaning Representation (AMR)

“Curiosity successfully landed on Mars, after entering its atmosphere.”

(l / land-01:arg1 (c / Curiosity):location (m / Mars):manner (s / successful):time (b / after

:op1 (e / enter-01:arg0 c:arg1 (a / atmosphere

:poss m))))

Page 14: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

14

Abstract Meaning Representation (AMR)Pros Cons

✔ Semantically expressive ✘ Imposes a rooted structure “Mars has an atmosphere”

✔ Unbounded by lexicon

✘ Requires deep semantic analysis

Page 15: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

15

SRLAMR

Open-IE

Existing Frameworks

Representing a Single Sentence

Page 16: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

16

Open Information Extraction (Open IE)• Extracts propositions from text based on surface/syntactic patterns• Represents propositions as predicate-argument tuples• Each element is a natural language string

Page 17: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

17

Open Information Extraction (Open IE)“Curiosity successfully landed on Mars, after entering its atmosphere.”

((“Curiosity”, “successfully landed on”, “Mars”);ClausalModifier: “after entering its atmosphere”)

Page 18: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

18

Open Information Extraction (Open IE)Pros Cons

✔ Unbounded by lexicon Uses syntactic patterns

✘ Misses propositions “Mars has an atmosphere”

✔ Extracts discrete propositions Information retrieval scenario

✘ Does not analyse semantics

Page 19: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

19

Representing a Single SentenceConsolidation Across Multiple Sentences

Traversing the Representation

Proposition Knowledge Graphs

Page 20: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

20

Representing a Single Sentence

“Curiosity will look for evidence that Mars might have had conditions for supporting life.”

Page 21: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

21

Representing a Single Sentence

“Curiosity will look for evidence that Mars might have had conditions for supporting life.”

Predicate: haveTense: futureModality: mightSubject: MarsObject: conditions Predicate: supporting

Object: life

Predicate: look forTense: futureSubject: CuriosityObject: evidence

Nodes are propositions

Page 22: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

22

Representing a Single Sentence

“Curiosity will look for evidence that Mars might have had conditions for supporting life.”

Predicate: haveTense: futureModality: mightSubject: MarsObject: conditions Predicate: supporting

Object: life

Predicate: look forTense: futureSubject: CuriosityObject: evidence

Edges are syntactic relations

Page 23: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

23

Representing a Single Sentence

“Curiosity will look for evidence that Mars might have had conditions for supporting life.”

Predicate: haveTense: futureModality: mightSubject: MarsObject: conditions Predicate: supporting

Object: life

Predicate: look forTense: futureSubject: CuriosityObject: evidence

Edges are syntactic relations

Object

Page 24: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

24

Representing a Single Sentence

• Propositions can be implied from syntax

• Implied propositions can also be introduced by adjectives, nominalizations, conjunctions, and more

Curiosity’s robotic arm is used to collect samples Curiosity has a robotic arm Possessiv

es

Curiosity, the Mars rover, landed on Mars Curiosity is the Mars roverApposition

Page 25: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

25

Proposition Knowledge Graphs (PKG)

Pros Cons

✔Marks implied propositions ”Curiosity has a robotic arm”

✘ Does not analyse semantics

✔Marks discrete propositions along with inner structure

✔ Unbounded by lexicon

Page 26: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

26

Proposition Knowledge Graphs (PKG)

• We have seen:• PKG adopts Open-IE robustness• PKG improves over its expressiveness

• Semantic relations are left for higher level representation• Which we will see next

Page 27: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

27

Representing a Single SentenceConsolidation Across Multiple Sentences

Traversing the Representation

Proposition Knowledge Graphs

Page 28: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

28

Consolidation

Proposition structures serve as backbone for higher level representation

Curiosity will look for evidence that Mars might have had conditions for supporting life.

Predicate: haveTense: futureModality: mightSubject: MarsObject: conditions Predicate: supporting

Object: life

Predicate: look forTense: futureSubject: CuriosityObject: evidence

Page 29: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

29

Consolidation

• Semantic edges are drawn between sentences• Entailment• Temporal• Conditional• Causality

Page 30: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

30

Paraphrases

NASA uses Curiosity rover, to take a closer look at rock samples found on Mars

NASA utilizes the Mars rover, Curiosity, to examine rock samples from Mars

paraphrase

Page 31: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

31

Entailment

NASA utilizes the Mars rover, Curiosity, to examine rock samples from Mars

NASA uses Curiosity rover, to take a closer look at rock samples found on Mars

Curiosity is a rover.

entailment

Page 32: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

32

Temporal

NASA utilizes the Mars rover, Curiosity, to examine rock samples from Mars

NASA uses Curiosity rover, to take a closer look at rock samples found on Mars

Curiosity is a rover.

entailment

temporal

Curiosity successfully landed on Mars.

Page 33: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

33

Representing a Single SentenceConsolidation Across Multiple Sentences

Traversing the Representation

Proposition Knowledge Graphs

Page 34: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

34

Q: “What did Curiosity do after landing?”

NASA utilizes the Mars rover, Curiosity, to examine rock samples from Mars

NASA uses Curiosity rover, to take a closer look at rock samples found on Mars

Curiosity is a rover.

entailment

temporal

Mars rover Curiosity successfully landed on the red planet.

Curiosity successfully landed on Mars.

Page 35: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

35

Q: “What did Curiosity do after landing?”

NASA utilizes the Mars rover, Curiosity, to examine rock samples from Mars

NASA uses Curiosity rover, to take a closer look at rock samples found on Mars

Curiosity is a rover.

entailment

temporal

Mars rover Curiosity successfully landed on the red planet.

Curiosity successfully landed on Mars.

Page 36: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

36

NASA utilizes the Mars rover to examine rock samples from Mars

Predicate: utilizeSubject: NASAObject: the Mars roverComp: examine

Predicate: examineSubject: the Mars roverObject: rock samples

rock samplesModifier: from Mars

Page 37: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

37

NASA utilizes the Mars rover to examine rock samples from Mars

Predicate: utilizeSubject: NASAObject: the Mars roverComp: examine

Predicate: examineSubject: the Mars roverObject: rock samples

rock samplesModifier: from Mars

Q: “Who utilizes the Mars rover?”

Page 38: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

38

NASA utilizes the Mars rover to examine rock samples from Mars

Predicate: utilizeSubject: NASAObject: the Mars roverComp: examine

Predicate: examineSubject: the Mars roverObject: rock samples

rock samplesModifier: from Mars

Q: “Who utilizes the Mars rover?”Q: “What did the Mars rover examine?”

Page 39: Proposition Knowledge Graphs Gabriel StanovskyOmer LevyIdo Dagan Bar-Ilan University Israel 1.

39

Challenges (Ongoing Work)

• Extract rich propositions from text

• Extract inter-proposition relations implied by text

• Discover semantic relations between sentences not implied by text

Thank you for listening!