Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex Tantos Alex Tantos Segmented Discourse Representation Segmented Discourse Representation Theory Theory A theory of discourse interpretation A theory of discourse interpretation 14/05 14/05 Course: “Computerlinguistik II” Course: “Computerlinguistik II” Alexandros Tantos Alexandros Tantos Alexandros.Tantos@uni- Alexandros.Tantos@uni- konstanz.de konstanz.de
50
Embed
Segmented Discourse Representation Theory Alex Tantos Segmented Discourse Representation Theory A theory of discourse interpretation 14/05 Course: “Computerlinguistik.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Segmented Discourse Representation Segmented Discourse Representation Theory Theory
A theory of discourse interpretationA theory of discourse interpretation
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
The structure of the sessionThe structure of the session
• The placement of computational discourse The placement of computational discourse semantics and SDRT in NLPsemantics and SDRT in NLP
• The need for dynamic semantics in the The need for dynamic semantics in the discourse (inter-)(re-)presentation discourse (inter-)(re-)presentation (Discourse (Discourse Representation Theory: advantages and Representation Theory: advantages and drawbacks) drawbacks)
• Evidence for SDRT and rhetorical relationsEvidence for SDRT and rhetorical relations
• Possible NLP applications based on such a Possible NLP applications based on such a framework: what comes next?framework: what comes next?
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
The theory in our mind and in NLPThe theory in our mind and in NLP
MacrostructureMacrostructure of semantic “deep” NLP of semantic “deep” NLP applicationsapplications
Understanding Understanding
““Input”Input”
systemssystems
GenerationGeneration
““Output”-Output”-ResponseResponse
systemssystems
InterpretationInterpretation
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Discourse semanticsDiscourse semantics
Static vs. Dynamic semanticsStatic vs. Dynamic semantics
•Static semantics (sentential level): satisfaction of first-order Static semantics (sentential level): satisfaction of first-order logical (FOL) formulas in a model with respect to (x-variant) logical (FOL) formulas in a model with respect to (x-variant) assignment functions assignment functions
Every boy loves a girl. (2 readings nicely translated by FOL, Every boy loves a girl. (2 readings nicely translated by FOL, the one straightforwardly by syntax, the other by Montague’s the one straightforwardly by syntax, the other by Montague’s QR or by Cooper’s storage, etc..)QR or by Cooper’s storage, etc..)
Diverse intersentential anaphoric Diverse intersentential anaphoric phenomena in NLphenomena in NL
Anaphora resolution is processed considering discourse Anaphora resolution is processed considering discourse factors.factors.
Until Kamp (1981), Heim (1982) compositional semantics Until Kamp (1981), Heim (1982) compositional semantics were assigned until the end of the sentence.were assigned until the end of the sentence.
““The meaning of a sentence is the set of models it The meaning of a sentence is the set of models it satisfies.”satisfies.”
A man walked in. He was wearing a hat.A man walked in. He was wearing a hat.
Solution…the interpretation is assigned contextuallySolution…the interpretation is assigned contextually
Kamp (1981) introduced the Context Change Potential Kamp (1981) introduced the Context Change Potential (CCP) -- dynamic way of thinking about meaning…(CCP) -- dynamic way of thinking about meaning…
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
DRT-CCPDRT-CCP
Dynamic notion of meaningDynamic notion of meaning
Meaning a Meaning a relationrelation between a set of «input» between a set of «input» contexts which represents the content of the contexts which represents the content of the discourse prior to the sentence being processed, discourse prior to the sentence being processed, and a set of «output» contexts which represents and a set of «output» contexts which represents the content of the discourse including that the content of the discourse including that sentence.sentence.
A man walked in. He ordered a beer.A man walked in. He ordered a beer.
Input context Input context
OutputOutput contextcontext
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
DRSs: formal objects realising the dynamic DRSs: formal objects realising the dynamic notion of meaning in the interpretation of notion of meaning in the interpretation of discoursediscourse
DRSs consist of the universe (entities) and the DRSs consist of the universe (entities) and the conditions (relations between entities) conditions (relations between entities) supported by an «appropriate» modelsupported by an «appropriate» model
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Anaphora resolution according to Anaphora resolution according to availability constraintsavailability constraints
DRS B1 is accessible from DRS B2 when: a. B1 equals B2 b. B1 subordinates B2 B1 subordinates B2 when:
a. B1 immediately subordinates B2b. There is some DRS B such that B1 subordinates B and B subordinates B2
B1 contains a condition of the form B2; orB1 contains a condition of the form B2B or BB2, for some DRS B; orB1 contains a condition of the form B2B (or some quantifier), for some DRS B; orB1B2 is a condition in some DRS B.
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
a.a. One plaintiff was passed over for promotion three One plaintiff was passed over for promotion three times.times.
b.b. Another didn’t get a raise for five years.Another didn’t get a raise for five years.
c.c. A third plaintiff was given a lower wage compared A third plaintiff was given a lower wage compared to males who were doing the same work.to males who were doing the same work.
d.d. But the jury didn’t believe this. But the jury didn’t believe this.
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Temporal phenomena Temporal phenomena
Kamp and Reyle (1993) - syntax determines the Kamp and Reyle (1993) - syntax determines the aktionsart of the sentence aktionsart of the sentence
• Max entered the room. The room became dark.Max entered the room. The room became dark.
• Max entered the room. The room was dark.Max entered the room. The room was dark.
For a: eFor a: et (the event is within the reference time)t (the event is within the reference time)
t’t’t (for forward movement in narratives)t (for forward movement in narratives)
ttn (past tense) n (past tense)
For b: t’ For b: t’ s (the state may still be ongoing), t’s (the state may still be ongoing), t’n n
c.c. Max fell. John helped him up.Max fell. John helped him up.
d.d. Max fell. John pushed him.Max fell. John pushed him.
Not even pure default world-knowledge can help us...Not even pure default world-knowledge can help us...
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
PresuppositionPresupposition
Van der Sandt (1992) (constraints on Van der Sandt (1992) (constraints on accommodation are too weak) accommodation are too weak)
Beaver (1996) (no precise definition of the “most Beaver (1996) (no precise definition of the “most plausible pragmatic interpretation”)plausible pragmatic interpretation”)
a.a. If David scuba dives, he will bring his regulator.If David scuba dives, he will bring his regulator.
b.b. If David scuba dives, he will bring his dog.If David scuba dives, he will bring his dog.
c.c. I doubt that the knowledge that this seminal logic I doubt that the knowledge that this seminal logic paper was written by a computer program running on a PC paper was written by a computer program running on a PC will confound the editors.will confound the editors.
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Lexical disambiguationLexical disambiguation
a.a. The judge demanded to know where the defendant was.The judge demanded to know where the defendant was.
b.b. The barrister apologized and said that he was drinking The barrister apologized and said that he was drinking across the street.across the street.
c.c. The court bailiff found him asleep beneath the The court bailiff found him asleep beneath the barbar..
Solutions provided only by data-intensive linguistics (Guthrie, Solutions provided only by data-intensive linguistics (Guthrie, 1991)1991)
Pr(sense(w)=s|C)Pr(sense(w)=s|C)
What would they say in case of c’ instead of c?What would they say in case of c’ instead of c?
c’.c’. But the bailiff found him slumped underneath the bar.But the bailiff found him slumped underneath the bar.
Clearly, we need hybrid approaches where semantic, Clearly, we need hybrid approaches where semantic, pragmatic and statistical factors are involved…pragmatic and statistical factors are involved…
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Why SDRT (Asher (1993), Why SDRT (Asher (1993), Asher and Lascarides Asher and Lascarides
b.b. It does not exclude pragmatics or AI techniques for the It does not exclude pragmatics or AI techniques for the representation of knowledge…it only formalize them in a representation of knowledge…it only formalize them in a better way and face more effectively the problemsbetter way and face more effectively the problems
c.c. It keeps things modular…every source of knowledge is It keeps things modular…every source of knowledge is kept separate and interactivekept separate and interactive
d.d. It separates the logic of information content and the logic It separates the logic of information content and the logic of information packagingof information packaging
e.e. And…assumes underspecification appropriate for And…assumes underspecification appropriate for composition relying on constraint-based frameworks…composition relying on constraint-based frameworks…(HPSG, LFG)(HPSG, LFG)
But first let’s see…what the rhetorical relations look like and But first let’s see…what the rhetorical relations look like and what they can do…what they can do…
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Rhetorical relations..what are Rhetorical relations..what are they?they?
a.a. Anaphoric connectors of the discourseAnaphoric connectors of the discourse
b.b. Carriers of illocutionary force sourcing from the Carriers of illocutionary force sourcing from the discourse itselfdiscourse itself
c.c. Connectors of labels or Connectors of labels or speech act discourse speech act discourse referentsreferents and not of propositions…tokens of and not of propositions…tokens of propositions and not types (identity criteria, propositions and not types (identity criteria, etc..)etc..)
d.d. Validate the defeasibility floating around in Validate the defeasibility floating around in language production..language production..
a.a. Max fell. John pushed him.Max fell. John pushed him.
b.b. John and Max were at the edge of the cliff. John and Max were at the edge of the cliff. Max felt a sharp blow to the back of his neck. Max felt a sharp blow to the back of his neck. Max fell. John pushed him. Max rolled over Max fell. John pushed him. Max rolled over the edge of the cliff.the edge of the cliff.
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Rhetorical relations-MDCRhetorical relations-MDCUse of Maximise Discourse Coherence (MDC), the Use of Maximise Discourse Coherence (MDC), the
strongest principle of SDRT with monotonic strongest principle of SDRT with monotonic consequences, which:consequences, which:
a.a. formalizes the notion of relevance introduced formalizes the notion of relevance introduced informally [by Sperber and Wilson’s informally [by Sperber and Wilson’s Relevance Theory (1986)] by defining Relevance Theory (1986)] by defining “scalar” coherence…“scalar” coherence…
b.b. Overrides conflicting world knowledge.Overrides conflicting world knowledge.
According to MDC:According to MDC:
1.1. The more rhetorical connections between the The more rhetorical connections between the segments of text..the more coherent is the text segments of text..the more coherent is the text meaningmeaning
2.2. The more anaphoric expressions are resolved the The more anaphoric expressions are resolved the higher the qualityhigher the quality
3.3. Some relations are inherently scalar..(Narration, Some relations are inherently scalar..(Narration, Contrast)..we are looking for the interpretation Contrast)..we are looking for the interpretation that maximises the quality of the relation under that maximises the quality of the relation under questionquestion
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Rhetorical relationsRhetorical relationsHow are semantically to be understood? How are semantically to be understood?
The definition of a veridical rhetorical relationThe definition of a veridical rhetorical relation
A relation R is veridical iff the following axiom is A relation R is veridical iff the following axiom is valid:valid:
R(R(α,βα,β))(K(KααΚβ)Κβ)
is to be understood dynamically and not as is to be understood dynamically and not as logical conjunctionlogical conjunction
c.c. Captures successfully the fact that there is Captures successfully the fact that there is incoherence going on in case (f) is addedincoherence going on in case (f) is added
d.d. Different approach to discourse update process Different approach to discourse update process from that of DRT (which is simple amending from that of DRT (which is simple amending DRSs)…take a look at the copy…DRSs)…take a look at the copy…
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Temporal phenomenaTemporal phenomena
a.a. Max fell. John pushed him.Max fell. John pushed him.
π0π0
π1, π2π1, π2
π0π0: e: eπ1, π1, t, xt, x eeπ2, π2, t’, y, zt’, y, z
π1π1: max(x) : max(x) π2π2: john(y): john(y)
fall(efall(eπ1,π1, x) push(e x) push(eπ2,π2, y, z) y, z)
holds(eholds(eπ1π1, t) z=x, t) z=x
ttnow holds(enow holds(eπ2π2, t’), t’)
t’t’nownow
Explanation(Explanation(π1, π2)π1, π2)
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Temporal phenomenaTemporal phenomena
By the semantics of Explanation…we have..By the semantics of Explanation…we have..
Pragmatics (Grice (1975), Searle (1969), Sperber and Pragmatics (Grice (1975), Searle (1969), Sperber and Wilson(1986,1995)) and AI techniques (Hobbs et Wilson(1986,1995)) and AI techniques (Hobbs et al. (1993), Grosz and Sidner(1993)):al. (1993), Grosz and Sidner(1993)):
Direct interpretation of “intended” meaning both in Direct interpretation of “intended” meaning both in pragmatics and AI…pragmatics and AI…
PragmaticsPragmatics
Meaning is what speakers intend to say under what Meaning is what speakers intend to say under what they expressthey express
Full access to the cognitive state of the speakerFull access to the cognitive state of the speaker
AIAI
Hobbs et al. (1993) unmodular architecture of the Hobbs et al. (1993) unmodular architecture of the information flow between the participants in the information flow between the participants in the conversation..conversation..
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
• No formal way of inferring implicatures No formal way of inferring implicatures
• Static full access to the logic of cognitive states, Static full access to the logic of cognitive states, which apparently complicates the interpretation which apparently complicates the interpretation task and base the inferencetask and base the inference
c.c. Computability issueComputability issue
d.d. Fail to provide explanation about the dramatic Fail to provide explanation about the dramatic changes in the interpretation provided by small changes in the interpretation provided by small changes in the surface (no contact to linguistic changes in the surface (no contact to linguistic evidence-dynamic semantics)evidence-dynamic semantics)
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
• Blair has caused chaos in Iraq. He sent his troops Blair has caused chaos in Iraq. He sent his troops and killed the hopes of the people there.and killed the hopes of the people there.
Temporal consequence of Elaboration:Temporal consequence of Elaboration:
If Narration(If Narration(π1,π2)π1,π2), then the poststate of e, then the poststate of eπ1π1 must overlap the prestate of emust overlap the prestate of eπ2π2
a.a. The terrorist Blair planted a mine near the The terrorist Blair planted a mine near the bridge. bridge.
20m south, he planted another.20m south, he planted another.
b.b. The terrorist Blair planted a mine near The terrorist Blair planted a mine near the bridge.the bridge.
Topic constraint like Narration but in Background the Topic constraint like Narration but in Background the eeαα maintains available for anaphoric binding maintains available for anaphoric binding since it is considered the “main story line”since it is considered the “main story line”
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Some words about the connectives between two Some words about the connectives between two fully specified formulas:fully specified formulas:
,,,,…DRT’s truth functional approach…DRT’s truth functional approach
In SDRT, they are represented by rhetorical In SDRT, they are represented by rhetorical relations…relations…
Consequence, Alternation and no conjunction…Consequence, Alternation and no conjunction…conjunction is too poor…conjunction is too poor…
What does it mean that the compositional semantics What does it mean that the compositional semantics of two clauses are true and nothing more?of two clauses are true and nothing more?
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
>: means defeasible consequence…or conditional of >: means defeasible consequence…or conditional of normality (normally if…then..)normality (normally if…then..)
Used heavily in the logic of information packaging, Used heavily in the logic of information packaging, where defaults are placed and defeated when where defaults are placed and defeated when new information comes to play…new information comes to play…
An exampleAn example on applying the relational-dynamic on applying the relational-dynamic semantics of SDRT on an intentional model…semantics of SDRT on an intentional model…
M=<AM=<Aμ,μ,WWμ ,μ ,**μ,μ,IIμ>μ>
Tasha is a cat.Tasha is a cat.
**μμ(w,[[(w,[[π]]π]]))
The SDRS KThe SDRS Kπ π for the sentence…under the special for the sentence…under the special element *element *μμ gives us all the output contexts gives us all the output contexts where the cat is a normal one..(has a tail, four where the cat is a normal one..(has a tail, four legs, two eyes…)legs, two eyes…)
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Unpacking truth conditions:Unpacking truth conditions:
a.a. Max fell. Max fell.
b.b. Either John pushed him orEither John pushed him or
c.c. He slipped on a banana peel.He slipped on a banana peel.
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Unpacking truth conditions:Unpacking truth conditions:π0π0
By the semantics of By the semantics of there are variable assignment there are variable assignment functions h and i such that:functions h and i such that:
a)a) (w,f)[[K(w,f)[[Kπ1]]π1]]MM(w,h)(w,h)
b)b) (w,h)[[K(w,h)[[Kππ22]]]]MM(w,i); and(w,i); and
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Unpacking truth conditions:Unpacking truth conditions:
Condition (b) for KCondition (b) for Kπ2π2 contains a complex SDRS containing contains a complex SDRS containing an Alternation relation…an Alternation relation…
So either e3 happens or e4 in the KSo either e3 happens or e4 in the Kπ2π2::
Reminder: KReminder: Kπ1 π1 is connected to Kis connected to Kπ2 π2 and not to Kand not to Kππ3 or to3 or to KKππ4. K4. Kπ2π2 is dependent on the truth conditions of K is dependent on the truth conditions of Kππ3 3 and Kand Kππ4.4.
For the condition (c)…the meaning postulate of explanation For the condition (c)…the meaning postulate of explanation must hold…must hold…
φφExplanation(Explanation(α,β)α,β) ( (eeααeeββ))
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Some words about Some words about UnderspecificationUnderspecification
What is underspecification?What is underspecification?
A way to deal with ambiguity phenomena unable to be A way to deal with ambiguity phenomena unable to be covered by the grammar…the most classic one:covered by the grammar…the most classic one:
scope ambiguitiesscope ambiguities
What does underspecification really do?What does underspecification really do?
Keeps “labels” or “holes” in the semantic representation Keeps “labels” or “holes” in the semantic representation and fills them with the adequate candidates..and fills them with the adequate candidates..
In essence, it is a way of delaying things until the bits of In essence, it is a way of delaying things until the bits of information have been provided…information have been provided…
Approaches of underspecification: [Reyle(1993), Bos(1995), Approaches of underspecification: [Reyle(1993), Bos(1995), Bos et al. (1996), Asher and Fernando(1997), Egg et al.Bos et al. (1996), Asher and Fernando(1997), Egg et al.(2001) and Copestake et al.(1999)](2001) and Copestake et al.(1999)]
To the point with “labels”…To the point with “labels”…
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
Some words about Some words about UnderspecificationUnderspecification
Many problems preoccupy every politician.Many problems preoccupy every politician.
Segmented Discourse Representation Theory Segmented Discourse Representation Theory Alex TantosAlex Tantos
What is next?What is next?
SDRT is a new theory..it does not include…SDRT is a new theory..it does not include…
• Implicatures that follow from social status, gender and Implicatures that follow from social status, gender and so onso on
• The contents of dialogues where discourse participants The contents of dialogues where discourse participants have different communicative agendashave different communicative agendas
• The repair strategies that occur when dialogue The repair strategies that occur when dialogue participants realise they have interpreted the dialogue participants realise they have interpreted the dialogue differentlydifferently