Top Banner
1 Statistical NLP Spring 2010 Lecture 21: Coreference Resolution Dan Klein – UC Berkeley
22

SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

Apr 07, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

1

Statistical NLPSpring 2010

Lecture 21: Coreference Resolution

Dan Klein – UC Berkeley

Page 2: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

2

Page 3: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

3

Page 4: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

4

Page 5: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

5

Page 6: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

6

Page 7: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

7

Page 8: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

8

Infinite Mixture Model

MUC F1

The Weir Group , whose headquarters is in

the U.S is a large specialized corporation.

This power plant , which , will be situated in

Jiangsu, has a large generation capacity.

Enriching the Mention Model

W

Z

Mention Model

P(W | Weir Group):

“Weir Group”=0.4,

“whose”=0.2,

.......

Page 9: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

9

Enriching the Mention Model

Pronoun

W

Z

TGNNumber

Sing, Plural

W

Z

Non-Pronoun

Gender

M,F,N

Type

PERS, LOC,

ORG, MISC

Enriching the Mention Model

W | SING, MALE, PERS

“he”:0.5, “him”: 0.3,...

W | PL, NEUT, ORG

“they”:0.3, “it”: 0.2,...

Entity Parameters

Pronoun Parameters

W

Z

TGN

Pronoun

Page 10: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

10

Enriching the Mention Model

Pronoun

W

Z

TGN

W

Z

Non-Pronoun

Enriching Mention Model

M

Pronoun

Non-pronoun

Mention Type

Proper,

Pronoun,

Nominal

W

Z

TGN

Page 11: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

11

Enriching Mention Model

.....

W

Z

W

Z

..... .....

Enriching Mention Model

.....

M

W

Z

TGN

M

W

Z

TGN

..... .....

Page 12: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

12

Pronoun Model

MUC F1

The Weir Group , whose headquarters is in

the U.S is a large specialized corporation.

This power plant , which , will be situated in

Jiangsu, has a large generation capacity.

Page 13: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

13

Page 14: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

14

Page 15: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

15

Page 16: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

16

Salience Model

MUC F1

The Weir Group , whose headquarters is in

the U.S is a large specialized corporation.

This power plant , which , will be situated in

Jiangsu, has a large generation capacity.

Page 17: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

17

HDP Model

MUC F1

The Weir Group , whose headquarters is in

the U.S is a large specialized corporation.

This power plant , which , will be situated in

Jiangsu, has a large generation capacity.

Page 18: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

18

Global Entity Resolution

Bush he Rice

Rice Bush she

Experiments

� MUC6 English NWIRE (all mentions)

� 53.6 F1* [Cardie and Wagstaff 99] Unsupervised

� 70.3 F1 [Haghighi & Klein 07] Unsupervised

� 73.4 F1 [McCallum & Wellner 04] Supervised

� 81.3 F1 [Luo et al 04] Supervised+Oracle

• MUC score, not all systems are completely comparable

• Why not: some assume oracle gives boundaries, NER

types, etc.

Page 19: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

19

* Now system mentions!

These are “real numbers”

Page 20: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

20

Page 21: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

21

Page 22: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

22