Top Banner
Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech Speech
40

Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Mar 26, 2015

Download

Documents

Haley Buchanan
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Text

Language Technology

Natural Language Understanding

Natural Language Generation

Speech Recognition

Speech Synthesis

Text

Meaning

Speech Speech

Page 2: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Text

Language Technology

Natural Language Understanding

Natural Language Generation

Speech Recognition

Speech Synthesis

Text

Meaning

Speech Speech

Page 3: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

What is NLG?

Natural language generation is the process of deliberately constructing a natural language text in order to meet specified communicative goals.

[McDonald 1992]

Page 4: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Example System: FoG• Function:

– Produces textual weather reports in English and French

• Input: – Graphical/numerical weather depiction

• User: – Environment Canada (Canadian Weather Service)

• Developer: – CoGenTex

• Status: – Fielded, in operational use since 1992

Page 5: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

FoG: Input

Page 6: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

FoG: Output

Page 7: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Example System: TEMSIS

• Function: – Summarises pollutant information for environmental officials

• Input: – Environmental data + a specific query

• User: – Regional environmental agencies in France and Germany

• Developer: – DFKI GmbH

• Status: – Prototype developed; requirements for fielded system being analysed

Page 9: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

TEMSIS: Output Summary

• Le 21/7/1998 à la station de mesure de Völklingen -City, la valeur moyenne maximale d'une demi-heure (Halbstundenmittelwert) pour l'ozone atteignait 104.0 µg/m³. Par conséquent, selon le decret MIK (MIK-Verordnung), la valeur limite autorisée de 120 µg/m³ n'a pas été dépassée.

• Der höchste Halbstundenmittelwert für Ozon an der Meßstation Völklingen -City erreichte am 21. 7. 1998 104.0 µg/m³, womit der gesetzlich zulässige Grenzwert nach MIK-Verordnung von 120 µg/m³ nicht überschritten wurde.

Page 10: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

A further system

• ILEX– generation of virtual museum information

online– http://www.hcrc.ed.ac.uk/ilex/demos/museum.cgi

• SUMTIME– generation of weather reports– http://www.csd.abdn.ac.uk/~ssripada/cgi_bin/StartSMT.html

Page 11: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

TEMSIS: Input Query

((LANGUAGE FRENCH)(GRENZWERTLAND GERMANY)(BESTAETIGE-MS T)(BESTAETIGE-SS T)(MESSSTATION \"Voelklingen City\")(DB-ID \"#2083\")(SCHADSTOFF \"#19\")(ART MAXIMUM)(ZEIT ((JAHR 1998) (MONAT 7) (TAG 21))))

Page 12: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Basic Generation Problem

• How to go from an abstract semantic input to a concrete linguistic form that is

– semantically correct– stylistically appropriate– textually appropriate

???

Page 13: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Standard Pipelined Architecture

Document Planning

Microplanning

Surface Realisation

Document Plan

Text Specification

Page 14: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

KPMLlexicogrammar

semantics

sentence

Semantic specification

TACTICAL GENERATOR

Page 15: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

KPMLlexicogrammar

semantics

sentence

Semantic specification

TACTICAL GENERATORKPML is a

Resources

Processgeneration

engine

Page 16: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

lexicogrammar

semantics

sentence

Semantic specification

TACTICAL GENERATION

Page 17: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

What is NLG?

Natural language generation is the process of deliberately constructing a natural language text in order to meet specified communicative goals.

NLG is a process of choice under specified constraints

[McDonald]

Page 18: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

syntagmatic

Linguistic Description with system networks

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finiteparadigmatic

AXES

Page 19: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

lexicogrammar

Resource Architecture in KPML:system networks

imperative

indicative

interrogative

declarative

Page 20: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Resource Architecture in KPML:system networks

imperative

indicative

interrogative

declarative

grammaticalsystems

Page 21: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Resource Architecture in KPML:system networks

imperative

indicative

interrogative

declarative

grammaticalfeatures

Page 22: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Resource Architecture in KPML:system networks

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 23: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Resource Architecture in KPML:system networks

imperative

indicative

interrogative

declarative

realizationstatements

+Finite

Finite^Subject

Subject^Finite

Page 24: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:system networks

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 25: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:system networks

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 26: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:traversal

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 27: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:traversal

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 28: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:traversal

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 29: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:traversal

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 30: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:traversal

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 31: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:traversal

imperative

indicative

interrogative

declarative+Finite

Finite^Subject

Subject^Finite

Page 32: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:traversal

indicative

interrogative

+Finite

Finite^Subject

Page 33: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:structure

+Finite

Finite^Subjectinterrogative

Page 34: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Generation Process:structure

+Finite

Finite^Subject

interrogative

Page 35: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Immediate Dominance

Linear Precedence

Generation Process:realization statements

+Finite

Finite^Subject SubjectFinite

[clause]

Are you going?

[interrogative]

Page 36: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Types of Realization Statements

• Ordering (immediate, relative)

• Structure building

• Lexicalization

Page 37: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Functionally Motivated Grammatical

Choices

USER

Page 38: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Functionally Motivated Grammatical

Choices

USER

user = language engineer:developing and debugging the “grammatical competence”of a language resource

Page 39: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Functionally Motivated Grammatical

Choices

USER

SemanticSpecifications

Page 40: Text Language Technology Natural Language Understanding Natural Language Generation Speech Recognition Speech Synthesis Text Meaning Speech.

Functionally Motivated Grammatical

Choices

USER

user = system builder:developing and debugging asystem that expects naturallanguage generationfunctionality

SemanticSpecifications