CLiMB - Columbia University1 Project CLiMB Computational Linguistics for Metadata Building Using Computational Linguistic Techniques to Harvest Image Descriptors.

CLiMB - Columbia University 1

Project CLiMB

Computational Linguistics for

Metadata Building

Using Computational Linguistic Techniques

to Harvest Image Descriptors

Columbia UniversityFunded by the Andrew W. Mellon Foundation

2002-2004


Photograph courtesy of the Council of Industrial Design's Design Archive.


Increase access to digital images


CLiMB: Interdisciplinary Research at

Columbia University

• Libraries• Computer Science Department• Center for Research on Information Access

(CRIA)

Funded by the Andrew W. Mellon Foundation2002-2004


CLiMB Project Members

Judith Klavans, PI

Stephen Davis

Angela Giral

Patricia Renfro

Bob Wolven

Roberta Blitz

Rebecca Passonneau

Veronika Horvath

David Elson


Problems in Image Access

Traditional approach: labor intensiveexpensive

7CLiMB - Columbia University

Project CLiMB

Help image catalogers provide subject access?

Harvest image descriptors

from existing literature?


Can we harvest image descriptors?


CLiMB will identify and extract• proper nouns• terms and phrases

from text related to an image:

By September 14, 1908, the basis of the Greenes' final design had been worked out. It featured a radically informal, V-shaped plan (that maintained the original angled porch) and interior volumes of various heights, all under a constantly changing roofline that echoed the rise and fall of the mountains behind it. The chimneys and foundation would be constructed of the sandstone boulders that comprised the local geology, and the exterior of the house would be sheathed in stained split-redwood shakes.

— Edward R. Bosley. Greene & Greene. London: Phaidon, 2000. p.127.

CLiMB Technical Contribution


CLiMB Overall Goals

The essence of CLiMB: • Use scholars themselves as “catalogers” by

employing scholarly publications• Enhance existing descriptive metadata

The CLiMB project:• Research: Development of richer retrieval

through increased numbers of descriptors• Practice: Development of CLiMB Toolkit


• Digital images

• Associated text

• Target object identification (TOI)

• CLiMB Toolkit

• Evaluation

Metadata SqueezeBasic Elements


Greene & Greene Architectural Records and Papers Collection

Drawings and ArchivesAvery Architectural and Fine Arts LibraryColumbia University Libraries


NYDA.1960.001.00023

All Saints Episcopal Church (Pasadena, Calif.). Alterations1902-1903


Greene & Greene Catalog RecordAuthor: Greene & Greene.Title: [Mrs. Dudley P. Allen house, 1188 Hillcrest Avenue (Pasadena,

Calif.). Alterations.]Residence of Mrs. Dudley P. Allen, 1188 Hillcrest Ave., Pasadena,

Cal. [graphic] : Alteration / Greene & Greene, Architects. Published: [1917]

Physical Details: 4 sheets : various media ; 87.8 x 57.3 cm. (34 5/8 x 22 5/8 in.)Location: Columbia University, Avery Architectural Drawings

Other Authors: Greene, Charles Sumner, 1868-1957. Greene, Henry Mather, 1870-1954.

Subjects: HousesAlterationsArchitecture--Designs and plans--United States.Mrs. Dudley P. Allen house, 1188 Hillcrest Avenue (Pasadena,

Calif.)

Component Item: [1] Item no. NYDA.1960.001.03224. [AVERYimage]. Electric lighting -- floor plan, part plan of basement : Sheet no.

Component Item: [2] Item no. NYDA.1960.001.00073. [AVERYimage]. [Electric lighting] floor plan, part plan of basement.


• Bosley, Edward R. Greene & Greene. London : Phaidon, 2000.

• Current, William R. Greene & Greene: architects in the residential style. Fort Worth [Tex.] : Amon Carter Museum of Western Art, [1974]

• Makinson, Randell L. Greene & Greene: architecture as fine art. Salt Lake City : Peregrine Smith, c1977.

• Makinson, Randell L. Greene & Greene: the passion and the legacy. Salt Lake City : Gibbs and Smith, c1998.

• Smith, Bruce. Greene & Greene masterworks. San Francisco : Chronicle Books, c1998.

• Strand, Janann. A Greene & Greene guide [Pasadena, Calif. : G. Dahlstrom, 1974]

Greene & Greene Bibliography(associated texts)



• Digital images

• Associated text


• CLiMB Toolkit

• Evaluation



Target Object Identification (TOI)

• New methodologies and software = new concepts and terms

• “Authority” list

• Varies from collection to collection Greene & Greene – Project Names North Carolina Museum – Creator/Title


Author: Greene & Greene. Title: [Mrs. Dudley P. Allen house, 1188 Hillcrest Avenue (Pasadena, Calif.)]

Residence of Mrs. Dudley P. Allen, 1188 Hillcrest Ave., Pasadena, Cal. [graphic] : Alteration / Greene & Greene, Architects. Published: [1917] Physical Details: 4 sheets : various media ; 87.8 x 57.3 cm. (34 5/8 x 22 5/8 in.) or smaller. Location: Columbia University, Avery Architectural DrawingsOther Authors: Greene, Charles Sumner, 1868-1957.

Greene, Henry Mather, 1870-1954.Subjects:Houses

AlterationsArchitecture--Designs and plans--United States.Pasadena (Ca.) Mrs. Dudley P. Allen house, 1188 Hillcrest Avenue (Pasadena, Calif.)

Genre Or Form: Architectural drawings--American. Floor plans.

Component Item: [1] Item no. NYDA.1960.001.03224. [AVERYimage]. Electric lighting -- floor plan, part plan of basement : Sheet no.

Greene & Greene Catalog Record


57.21.1 Lodovico Carracci The Assumption of the Virgin

60.17.51 Domenico Zampieri, called Domenichino The Madonna of Loreto Appearing to St. John the Baptist, St. Eligius, and St. Anthony Abbot

52.9.168 Bernardo Strozzi St. Lawrence Distributing the Treasures of the Church

TOI list for NCMA


Deriving TOIs: Image Vendor Data



North Carolina Museum of Art

North Carolina Museum of Art: Handbook of the Collections.

Rebecca Martin Nagy, editor. Raleigh: The Museum of Art. 1998

http://store6.yimg.com/I/ncmaonline-store_1738_1476798

CLiMB - Columbia University

North Carolina Museum of Art




• Record Type = work• Type = painting• Title = Banquet Piece• Measurements. Dimensions = 79.7 x 94 cm• Material = oil on panel• Creator = Uyl, Jan Jansz. den• Date. Creation = ca. 1635• Location. Current Repository = Raleigh (NC,

USA) North Carolina Museum of Art• ID Number. Current Repository = 52.9.43• Style/Period = Dutch 17th century

VRA Core 3.0 Record


• Digital images

• Associated text


• CLiMB Toolkit

• Evaluation



CLiMB TOOLKIT: Process Flow

1. Load Text

2. Load TOI List

3. Analyze Text

5. Review

4. Select Subject Access Terms


CLiMB Toolkit

http://www1.cs.columbia.edu/~delson/CLiMB/gui/dev2

http://www1.cs.columbia.edu/~delson/CLiMB/gui/dev2


• Record Type = work• Type = painting• Title = Banquet Piece• Measurements. Dimensions = 79.7 x 94 cm• Material = oil on panel• Creator = Uyl, Jan Jansz. den• Date. Creation = ca. 1635• Location. Current Repository = Raleigh (NC, USA),

North Carolina Museum of Art• ID Number. Current Repository = 52.9.43• Style/Period = Dutch 17th century• CLiMB Subject = Dutch still life painting• CLiMB Subject = vanitas• CLiMB Subject = burned down candle• CLiMB Subject = glass• CLiMB Subject = pewter

VRA Core 3.0 Record with CLiMB Subject Terms


CLiMB Metadata and

Cataloging Schemas• MARC 21

Field for CLiMB metadata:653 - INDEX TERM--UNCONTROLLED (R)

• VRA Core Categories, Version 3.0Field for CLiMB metadata: SUBJECT

• Dublin Core Metadata Element Set, Version 1.1Field for CLiMB metadata: SUBJECT AND KEYWORDS


• Digital images

• Associated text


• CLiMB Toolkit

• Evaluation



Toolkit

CLiMB

CLiMB Toolkit Evaluation14 April 2004


CLiMB Toolkit Evaluation

• Evaluation with expert users Visual resources professionals Art librarians

• Overall satisfaction with interface design

• Overall satisfaction with functionality

• Identified areas for further development


Thank you!

Any further questions?

www.columbia.edu/cu/cria/climb









CLiMB - Columbia University1 Project CLiMB Computational Linguistics for Metadata Building Using Computational Linguistic Techniques to Harvest Image Descriptors.

Documents

climb columbia university10

climb columbia university5

climb columbia university8

climb project

essence of climb

alteration greene greene

digital images slide

technical contribution