Top Banner
Beyond Active Noun Tagging Behjat Siddiquie [email protected] Abhinav Gupta [email protected]
72

Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Jul 09, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Beyond Active Noun Tagging

Behjat [email protected]

Abhinav [email protected]

Page 2: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

What this Talk is About

Problem: Active Learning for Scene Understanding Tasks

Page 3: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

What this Talk is About

Image Entropy

Region Entropy Image Entropy

+

road

grass

airplane

sky

Page 4: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

What this Talk is About

Introduce new ways of collecting knowledge which go beyond labeling regions

Page 5: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

What this Talk is About

Introduce new ways of collecting knowledge which go beyond labeling regions

Linguistic QuestionsUse high confidence detections as anchors to ask questions about the unknown objects in a scene

Page 6: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

What this Talk is About

Introduce new ways of collecting knowledge which go beyond labeling regions

Linguistic QuestionsUse high confidence detections as anchors to ask questions about the unknown objects in a scene

Page 7: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

What this Talk is About

Introduce new ways of collecting knowledge which go beyond labeling regions

Linguistic QuestionsUse high confidence detections as anchors to ask questions about the unknown objects in a scene

floor

?

Page 8: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

What this Talk is About

Introduce new ways of collecting knowledge which go beyond labeling regions

Contextual Questions Importance of relationships

Page 9: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

What this Talk is About

Introduce new ways of collecting knowledge which go beyond labeling regions

Contextual Questions Importance of relationships Learn general contextual relationships directly from the annotator

Page 10: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Introduction

Scene Understanding Learn appearance models Learn relationship models

Heavy Tailed Distribution The large majority of classes occur rarely Holds for relationships too

Randomly annotating training data is extremely inefficient

Russell et al.IJCV, 2008

Page 11: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Binary Classification Problems SVMs, Tong & Koller, 2001

Active Learning

Page 12: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Binary Classification Problems SVMs, Tong & Koller, 2001

Active Learning

Page 13: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Binary Classification Problems SVMs, Tong & Koller, 2001

Active Learning

Page 14: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Multi-Class

Multi-Class Classification Problems Jain & Kapoor, 2009

Binary Classification Problems SVMs, Tong & Koller, 2001

Caltech 101/256

Page 15: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Scene Understanding

Multi-Class Classification Problems Jain & Kapoor, 2009

Binary Classification Problems SVMs, Tong & Koller, 2001

Active Learning for Scene Understanding

Page 16: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Image Entropy

Uncertainty Based Approaches

Region Entropy

Page 17: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Image Entropy

Uncertainty Based Approaches

Region Entropy Image Entropy

+

road

grass

airplane

sky

Page 18: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Image Entropy

boat water tree

on

Image Dataset

Current Model

Page 19: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Image Entropy

boat water tree

on

Image Dataset

Current Model

Region Entropy

Boat

Page 20: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Image Entropy

boat water tree

on

Image Entropy

Image Dataset

Current Model

Region Entropy

Boat

Boat

Page 21: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Image Entropy

boat water tree

on

Image Entropy

Image Dataset

Current Model

Water

Region Entropy

Boat

Boat

Page 22: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Image Entropy

boat water tree

on

Image Entropy

Image Dataset

Current Model

Water

Boat

Boat

Region Entropy

Boat

Page 23: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning : Image Entropy

Entropy over all possible label assignments

road

grass

airplane

sky

Second order approximation Sum of the joint entropies of all pairs of regions

Page 24: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning Framework

Initially Labeled

airplane

grass

sky

sky

building

buildingcar

road

Unlabeled SetTraining Data

Classifier

Page 25: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Active Learning Framework

Actively Labeled

boat

ground

grass

airplane

sky above grass

sky bluer than grass

Select the best question

Training DataInitially Labeled

airplane

grass

sky

sky

building

buildingcar

road

Unlabeled Set

What is the relationship

between car and road?

What is the relationship

between cow and grass?What is above grass?

Obtain answer

Generate set of questions Classifier

Page 26: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Types of Questions

What is above the water?

What is the relationship between boat and water?

Region Labeling Questions

Contextual Questions

Linguistic Questions

Page 27: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Types of Questions

What is above the water?

What is the relationship between boat and water?

Region Labeling Questions

Page 28: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Region Labeling Questions

Appearance Model

carboat

Page 29: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Region Labeling Questions

Appearance Model

carboat

Page 30: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Region Labeling Questions

Appearance Model

carboat

boat

Appearance Model

carboat

Page 31: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Region Labeling Questions

Appearance Model

carboat

boat

Appearance Model

carboat

airplane

Initial Image Entropy Final expected Image Entropy given labeling

Importance of a Question

Page 32: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Types of Questions

What is above the water?

What is the relationship between boat and water?

Linguistic Questions

Page 33: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions

Appearance Model

waterboat

Contextual Model

sky above grass

sky bluer than grass

car above road

Page 34: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions

Appearance Model

waterboat

Contextual Model

sky above grass

sky bluer than grass

car above road

Page 35: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions

Appearance Model

waterboat

Contextual Model

What is above the water?

sky above grass

sky bluer than grass

car above road

Page 36: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions

Appearance Model

waterboat

Contextual Model

What is above the water?

1. Boat2. Tree

sky above grass

sky bluer than grass

car above road

Page 37: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions

Appearance Model

waterboat

Contextual Model

What is above the water?

1. Boat2. Tree

sky above grass

sky bluer than grass

car above road

Page 38: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions

Appearance Model

waterboat

Contextual Model

What is above the water?

1. Boat2. Tree

Appearance Model

boat

Contextual Model

boat above water

tree above water

water tree

sky above grass

sky bluer than grass

car above road

sky above grass

sky bluer than grass

car above road

Page 39: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions: Expected Entropy Reduction

What is below the sky?

Page 40: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions: Expected Entropy Reduction

What is below the sky?

Anchor Region

sky

Page 41: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Linguistic Questions: Expected Entropy Reduction

What is below the sky?

Relevant RegionsAnchor Region

belowsky

Entropy Reduction

Expected Image Entropy given a weak labeling of the relevant regions

Page 42: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Types of Questions

What is above the water?

What is the relationship between boat and water?

Contextual Questions

Page 43: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Contextual Questions

Appearance Model

carboat

Contextual Model

sky above grass

sky bluer than grass

car above road

Page 44: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Contextual Questions

Appearance Model

carboat

Contextual Model

What is the relationship between boat and water?

sky above grass

sky bluer than grass

car above road

Page 45: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Contextual Questions

Appearance Model

carboat

Contextual Model

What is the relationship between boat and water?

1. boat above water2. water bluer than boat

Appearance Model

carboat

Contextual Model

sky above grass

sky bluer than grass

car above road

boat above water

water bluer than boat

sky above grass

sky bluer than grass

car above road

Page 46: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Contextual Questions: Expected Entropy Reduction

grasssky abovelow

grasssky abovehigh

skyskyskyskysky

grassgrass

grass

grassgrass

Correct Relationship Prior Constrains the image labeling problem Results in a large entropy reduction

Sample object pairs based on their co-occurrence

Page 47: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Experiments

MSRC Dataset 532 images (276 training, 256 test) 21 categories and multi-label images

Ground Truth Segmentations

Page 48: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Page 49: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Combined

Page 50: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Combined

Region Labeling

Page 51: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Combined

Linguistic

Page 52: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Combined

Contextual

Page 53: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Page 54: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Page 55: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Page 56: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Ground Truth Segmentations

Region Entropy

Image Entropy

Page 57: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: Sample Questions on the MSRC Dataset

Our Approach (Image Entropy) [Jain & Kapoor, CVPR 2009] (Region Entropy)

Region Labeling Questions

Page 58: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: Sample Questions on the MSRC Dataset

Region Labeling Questions

grass

building

sky

Our Approach (Image Entropy) [Jain & Kapoor, CVPR 2009] (Region Entropy)

Page 59: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: Sample Questions on the MSRC Dataset

Region Labeling Questions

Building?

Car?

Grass?grass

building

sky sky

Our Approach (Image Entropy) [Jain & Kapoor, CVPR 2009] (Region Entropy)

Page 60: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: Sample Questions on the MSRC Dataset

Our Approach (Image Entropy) [Jain & Kapoor, CVPR 2009] (Region Entropy)

Region Labeling Questions

Page 61: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: Sample Questions on the MSRC Dataset

Linguistic Questions

1. building-tree 2. cow-grass 3. tree-ground 4. sky-building 5. sky-tree 6. grass-building 7. sky-grass 8. tree-grass 9. boat-water

What is abovethe grass?

What is abovethe ground?

What is more bluethan the ground?

Contextual Questions

Page 62: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Experiments

MSRC Dataset 532 images (276 training, 256 test) 21 categories and multi-label images

Automatic Segmentations

Page 63: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Automatic Segmentations

Combined

Region Labeling

Linguistic

Contextual

Page 64: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Automatic Segmentations

Region Entropy

Image Entropy

Page 65: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Automatic Segmentations

Page 66: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: MSRC Dataset – Automatic Segmentations

Page 67: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Experiments: Stanford Dataset

Stanford Dataset 715 images (415 training, 300 test) Annotated using Amazon Mechanical Turk 8 categories and multi-label images

Page 68: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: Stanford Dataset

Combined

Region Labeling

Linguistic

Contextual

Page 69: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: Stanford Dataset

Page 70: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Results: Stanford Dataset

Page 71: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Summary

Linguistic Questions

Contextual Questions

Image Entropy

+Image Entropy

Active learning method for learning contextual object recognition models

Page 72: Beyond Active Noun Tagging - VideoLectures.nettranslectures.videolectures.net/site/...bant_01.v1.pdf · PowerPoint Presentation Author: behjat Created Date: 6/23/2010 12:37:06 AM

Questions?

What is above the water?

What is the relationship between boat and water?

Image Entropy

+

Please visit our poster located at B4