Juergen Enge 1 media/art/librar media/art/library content, structure and use of digital media libraries Dipl. Inform. Jürgen Enge [email protected]
Juergen Enge 1
media/art/library
media/art/librarycontent, structure and use of digital media libraries
Dipl. Inform. Jürgen [email protected]
Juergen Enge 2
media/art/library
Arndt, Olaf; Moonen, RobCamera Silens (1994)
Where is the wisdom we have lost in knowledge? Where is the knowledge we have lost in information? T.S. Eliot, The Rock(1934)
Juergen Enge 5
media/art/library
Interactive Plant Growing (1993)Christa Sommerer
Laurent Mignonneau
Juergen Enge 7
media/art/library
Traditional Institutions for Archiving
• Libraries• books
• atlas, maps and cartographical drawings
• Museums• plaster mold collections
• collection of prints and drawings
• collection of photography
Juergen Enge 11
media/art/library
“The archive is no longer a matter of discrete objects (files, books, art works, etc.) stored and retrieved in specific places (libraries, museums, etc.). Now the archive is also a continuous stream of data, without geography or container, continuously transmitted and therefore without temporal restriction (always available in the here and now).”
(Geoffrey Batchen, "The Art of Archiving")
Juergen Enge 13
media/art/library
Digital Media Collections @ ZHdK (excerpt)
• Medien- und Informationszentrum MIZ
• Several thousand TV recordings
• Institute for Computer Music and Sound Technology
•IDEAMA archive
•Bourges festival archive
• ZHdK Collections for Teaching and Research
• Image archive
• Diploma archives
• Additional collections
Juergen Enge 15
media/art/library
Karlheinz Stockhausen, »Mikrophonie I«, 1966
Presentation of Mikrophonie 1 at WDR Cologne, June 1965; VLNR: Johannes Fritsch, Aloys Kontarsky, Bernhard Kontarsky, Alfred Alings
Juergen Enge 18
media/art/library
Work
Composer
Bio [fr]
Bio [de]
Bio [en]
Set 1Set n
Track 1 Track n
Desc [fr]
Desc [de]
Desc [en]
Juergen Enge 22
media/art/library
Biography
Work 1
Work n
Description
Medium 1 Medium n
Digital Master
Juergen Enge 27
media/art/library
Painting and DrawingsSculpturePhotographyDesign ObjectsAudio and Video etc.
Painting and DrawingsSculpturePhotographyDesign ObjectsAudio and Video etc.
Stream of data
ImagesTextAudio and VideoAnimation and 3D GraphicsSoftwareetc.
ImagesTextAudio and VideoAnimation and 3D GraphicsSoftwareetc.
Digital Master
Digital Master
Physical Object
Born Digital DataD
igitisation
Copy
ArchiveArchiveIngest
MetadataMetadata
Context
Technical Metadata
Juergen Enge 34
media/art/library
Player
TBC
A/D Converter
Video
Digital Tape Recorder
Computer + Film Editing ProgramA
udio
Audio Mixer
Tape
Digital File Storage System
Digitisation Process
Diagram: Patricia Falcao
Juergen Enge 35
media/art/library
Digital Preservation
• Long-term, error-free storage of digital information
• “long enough to be concerned with the impacts of changing technologies, including support for new media and data formats, or with a changing user community. Long Term may extend indefinitely” (Consultative Committee for Space Data Systems. OAIS, 2002)
• Preservation metadata
• Preservation metadata stores technical details on the format, structure and use of the digital content, the history of all actions performed on the resource including changes and decisions, the authenticity information such as technical features or custody history, and the responsibilities and rights information applicable to preservation actions (National Library of Australia. Preserving Acces to Digital Information)
Juergen Enge 37
media/art/library
Artistic Concept of Preservation
Pickled Film (1973/2005)Tony Conrad
Juergen Enge 39
media/art/library
Ingest Process• Transfer of digital master to long-term-storage
• Creation of transcoded derivates
• Connection of digital master and its derivates with metadata
• Insertion of metadata
• Technical metadata (automatic)
• Content based indexing (automatic)
• Preservation metadata
• Edited metadata (based on predefined conventions)
Juergen Enge 41
media/art/library
Async. Ingest Process
• ACID
• Atomicity
• Consistency
• Isolation
• Durability
Juergen Enge 42
media/art/library
ZHdK Video Transcoding Grid
2008-02-17: 122 Transcodings (Gesamtlänge: 78:52, Durchschnitt: 00:38, Speedup/CPU: 5.46, CPU time: 431:04)2008-02-16: 126 Transcodings (Gesamtlänge: 124:01, Durchschnitt: 00:59, Speedup/CPU: 5.39, CPU time: 668:21)2007-12-13: 233 Transcodings (Gesamtlänge: 148:52, Durchschnitt: 00:38, Speedup/CPU: 4.07, CPU time: 605:38)2007-12-09: 57 Transcodings (Gesamtlänge: 75:43, Durchschnitt: 01:19, Speedup/CPU: 3.81, CPU time: 288:49)2007-12-08: 191 Transcodings (Gesamtlänge: 104:07, Durchschnitt: 00:32, Speedup/CPU: 3.98, CPU time: 414:34)2007-12-07: 271 Transcodings (Gesamtlänge: 156:56, Durchschnitt: 00:34, Speedup/CPU: 4.03, CPU time: 632:37)2007-12-06: 227 Transcodings (Gesamtlänge: 203:39, Durchschnitt: 00:53, Speedup/CPU: 3.92, CPU time: 797:26)2007-12-05: 163 Transcodings (Gesamtlänge: 157:24, Durchschnitt: 00:57, Speedup/CPU: 3.94, CPU time: 619:28)2007-12-04: 168 Transcodings (Gesamtlänge: 213:55, Durchschnitt: 01:16, Speedup/CPU: 3.88, CPU time: 829:31)2007-12-03: 143 Transcodings (Gesamtlänge: 192:13, Durchschnitt: 01:20, Speedup/CPU: 3.82, CPU time: 733:55)2007-12-02: 139 Transcodings (Gesamtlänge: 177:34, Durchschnitt: 01:16, Speedup/CPU: 3.88, CPU time: 689:41)2007-12-01: 98 Transcodings (Gesamtlänge: 121:33, Durchschnitt: 01:14, Speedup/CPU: 3.97, CPU time: 482:28)2007-11-30: 157 Transcodings (Gesamtlänge: 192:48, Durchschnitt: 01:13, Speedup/CPU: 3.92, CPU time: 756:25)2007-11-29: 89 Transcodings (Gesamtlänge: 108:13, Durchschnitt: 01:12, Speedup/CPU: 3.87, CPU time: 419:00)2007-11-28: 118 Transcodings (Gesamtlänge: 158:24, Durchschnitt: 01:20, Speedup/CPU: 4.64, CPU time: 735:32)2007-11-27: 110 Transcodings (Gesamtlänge: 141:19, Durchschnitt: 01:17, Speedup/CPU: 4.71, CPU time: 665:25)2007-11-26: 71 Transcodings (Gesamtlänge: 85:02, Durchschnitt: 01:11, Speedup/CPU: 4.87, CPU time: 414:07)2007-11-25: 125 Transcodings (Gesamtlänge: 123:59, Durchschnitt: 00:59, Speedup/CPU: 4.92, CPU time: 610:20)2007-11-24: 104 Transcodings (Gesamtlänge: 123:31, Durchschnitt: 01:11, Speedup/CPU: 4.79, CPU time: 591:13)
Juergen Enge 47
media/art/library
Archival Systems @ ZHdK
• DILPS - Distributed Image Library Processing System (Open Source)
• Wiki Based Systems
• Audio Archives
• Specialised Systems
• Video Library
Juergen Enge 49
media/art/library
• Item centric• Structural
elements– Collection– Item– Resource– Media
• Variable metadata set
Collection
Item
Juergen Enge 51
media/art/library
Resource
Main MediumURN
PreviewURN
(Thumbnail)
PreviewURN
(QVGA)
PreviewURN
(VGA)
URN:
urn:zhdk:library/2789/00:00:05/masterurn:zhdk:library/2789/00:00:05/thumb…
Juergen Enge 53
media/art/library
Metadata
• Core metadata set (fixed)
• Extended metadata set (free, depends on object type)
• Versioning (no changes to metadata. Only new sets will be attached and old ones will reside on database)
• Metadata view depends on object type (label and fields)
Juergen Enge 54
media/art/library
• Special data type: Date– Every date is an interval– Datestrings are parsed with predefined regular
expressions• „Around 1950“• „17th century“• „Middle ages“• „2007-11-04“• „1973-1977“
– Searching means interval search on two intervals
Juergen Enge 55
media/art/library
URN / Storage• URN resolves to URL based on
– Location– Access protocol– urn:hgkz:design/8:2332/9014/thumb
• file:///data/dilps/design/lib01/d/c/120x90_9014.jpg (direct file system access)
• http://media3.hgkz.ch/dilps2/resource.php/design/lib01/d/c/120x90_9014.jpg?__SID__ (access via http protocol)
Juergen Enge 56
media/art/library
Authentication
• Domain based authentication model• Every domain uses its own authentication
subsystem• Authentication Entities
• User (z.B. zhdk/enge)• Group (z.B. zhdk/DDE_ITE.dozierende)• Location (z.B. 192.168.10.12)
Juergen Enge 57
media/art/library
AAI Integration
• The DILPS backend is able to accept users from Switch AAI domain
• Granularity of group information sufficient for many cases
• Web2.0 Interface doesn‘t allow seemless AAI login (due to redirect)
• Excellent possibility for cooperation projects with other institution based on shared media storage• Eventually additional need for group management tool
Juergen Enge 58
media/art/library
• Access Control Lists are available for all structural elements– Collection– Item– Resource– URN– Group
• Rights– Read– Write– Execute– Create– Permission– Revoke
Authorisation
Juergen Enge 64
media/art/library
Eigenwelt der Apparatewelt.The Net Edition (1992/2006)
Vasulka/Dunn/Weibel/Enge
Juergen Enge 66
media/art/library
Fallende Scheibe 3 (1986)Dieter Kiessling
Denis_Beaubois___Amnesia_.flv