Using Rhetorical Annotations for Generating Video Documentaries Stefano Bocconi, Frank Nack, Lynda Hardman CWI Amsterdam The Netherlands Contact: [email protected].

Using Rhetorical Annotations for Generating Video Documentaries

Stefano Bocconi, Frank Nack, Lynda HardmanCWI AmsterdamThe Netherlands

Contact: [email protected]

2

Talk Outline

The motivation and vision of the work Annotations Editing Process Conclusions

3

Video Documentaries on the Web

Traditional video authoring: there is only one final version, what is shown is the choice of the author/editor

Proposed video authoring: Annotate the video material semantics Present it automatically to the viewer in

an interesting way, selecting what the user asks to see

4

Video material

Interview with America: video footage with interviews and background material about the opinion of American people after 9-11www.interviewwithamerica.com

Annotations: 1 hour annotated, 15 interviews, 60 interview segments, 120 statements

5

What do you think of the war in Afghanistan?

6

Analysis of the Example

Claim

Concession

Claim contradict

supportClaim

I am not a fanof military actions

War has never solved anything

Two billions dollar bombs on tents

I cannot think of amore effective solution

weaken

7

The annotations

Rhetorical Rhetorical Statement (mostly verbal, but

visual also possible) Argumentation model: Toulmin model

Descriptive Question asked Interviewee (social) Filmic (e.g. location/time/framing/gaze)

8

Encode statements Statement formally annotated:

<subject> <modifier> <predicate> E.g. “war best solution”

A thesaurus containing: Terms (155) Relations between terms: similar (72),

opposite (108), generalization (10), specialization (10)

E.g. war opposite diplomacy

9

Connect statements Using the thesaurus, generate related

statements and query the repository E.g. from “war best solution” “diplomacy

best solution”, “war not solution” Create a graph of related statements

Nodes are the statements (video segments), edges are either support or contradict

10

Toulmin model

ClaimData

Qualifier

Warrant

Backing

Condition

Concession

57 Claims, 16 Data, 4 Concessions, 3 Warrants, 1 Condition

11

Analysis of the Example

Claim

Concession

Claim contradict

supportClaim

I am not a fanof military actions

War has never solved anything

Two billions dollar bombs on tents

I cannot think of amore effective solution

weaken

12

Current Work Partially tunable: examining the

Segment graph gives feedback on the quality of the annotations and the thesaurus

Possible user profiling or different points of view with different thesauri

S1

S2

S3 S5

S4

S7

S6

S8

S9

S10

= support

= contradict

13

Conclusions

Annotate: 3-part Statements Thesaurus Toulmin model

Create a statement graph Present an interview augmented with

supporting or contradicting material

14

Pointers & Acknowledgments

This presentation and Demo available at:http://www.cwi.nl/~media/demo/IWA/

This research was funded by the Dutch national ToKeN2000 I2RP and CHIME projects.

15

Questions?

Thanks for your attention