Accelerating Media Business Developments Christian Timmerer, FilippoChiariglione, Marius Preda Klagenfurt University (UNI-KLU) Faculty of Technical Sciences (TEWI) Department of Information Technology (ITEC) Multimedia Communication (MMC) http://research.timmerer.com http://blog.timmerer.com mailto:[email protected]MPEG-M: MPEG Extensible Middleware Acknowledgments L. Chiariglione, M. Eberhard, I. Arsov, A. Difino http://mxm.wg11.sc29.org/ [email protected]http://wg11.sc29.org/mxmsvn/repos
22
Embed
Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware
The MXM presentation as presented during FIA Stockholm http://www.fi-stockholm.eu/
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Accelerating Media Business Developments
Christian Timmerer, FilippoChiariglione, Marius Preda
Klagenfurt University (UNI-KLU) Faculty of Technical Sciences (TEWI)
Department of Information Technology (ITEC) Multimedia Communication (MMC)
• … one does not need to have in-depth knowledge of specific MPEG technologies / standards?
• … one is able to start with application/business development as soon as some (reference) software becomes available?
• … one is able to exchange applications’ underlying (reference) software with optimized one at no cost?
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 2
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 3
Outline
• Vision
• Overview
• Architecture
• Application Programming Interface (API)
• Example Instantiations
– Fully Interoperable Streaming
– Including MPEG-4 3D Graphics in 3rd-Party Apps
– Sharing Protected Contents
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 4
The MXM Vision
• MPEG-21 Multimedia Framework
• From Framework to Platform respecting– Creator and rights holders rights to exploit their works– End user wish to fully enjoy the benefits of digital
media – Various value-chain player interest to provide
products and services
➪ DMP has specified Interoperable DRM Platform (IDP)2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 5
“every human is potentiallyan element of a networkinvolving billions of contentproviders, valueadders, packagers, serviceproviders, resellers, consumers ...”
Framework
Platform
. . .
The MXM Vision (cont’d)
• From Platform to Middleware enabling– APIs + protocols in a platform-independent way + …
(see the following slides)➪ MPEG Extensible Middleware (MXM)
What’s next?• From Middleware to Terminal enabling
– ITU-T: definition of IPTV infrastructure and components
– MPEG: development of enabling technologies for, e.g., IPTV
➪ Advanced IPTV Terminal (AIT)
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 6
Middleware
Terminal
. . .
Overview
• A set of APIs to access possibly all MPEG technologies
• Simple methods to call complex functionalities inside MXM engines
• “Thin” applications because the complexity is in the MXM engines
• Replacement of MXM engines with better performing ones at no cost
• Creation of a global market of MXM Engines, MXM Applications and MXM Devices
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 7
Overview (cont’d)
The MXM standard – ISO/IEC 23006 – is subdivided in four parts:• Part 1 - MXM Architecture and Technologies specifies the MXM
architecture and references the technologies that are part of an MXM implementation;
• Part 2 - MXM Application Programming Interfaces (APIs): specifies the MXM APIs;
• Part 3 - MXM Conformance and Reference Software: specifies conformance tests and the software implementation of the standard
• Part 4 – MXM Protocols: specifies a set of protocols enabling distributed applications to exchange information related to content items and parts thereof, including rights and protection information
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 8
MXM Application 1 MXM Application 2
MPEG21 File Engine
Digital ItemEngine
REL Engine
IPMPEngine
ContentMetadata
Engine
MediaFramework
Engine
Drivers, Accelerators, Controllers, etc.
OS
MXMEngine
APIs
OtherEngines
HW
SceneEngine
SecurityEngine
MXM Device
92009/11/23-24 Christian Timmerer, Klagenfurt University, Austria
3. Documenting the IN/OUT points in another …MPEG standard: 23006-2 MXM API
- only 37 pages , - around 500 methods
1. Creating wrapping libraries, called engines
2. Opening the engines at ESSENTIAL points only
2009/11/23-24 15Christian Timmerer, Klagenfurt University, Austria
List of MXM Engines
• ContentProtocolEngine
• ContentSearchEngine
• DIAEngine
• DIDEngine
• DISEngine
• DomainEngine
• EREngine
• IPMPEngine
• IPMPToolProtocolEngine
• LicenseProtocolEngine
• MediaFrameworkEngine
• MetadataEngine
• MPEG21FileEngine
• MVCOEngine
• OrchestratorEngine
• RELEngine
• RenderingEngine
• SecurityEngine
162009/11/23-24 Christian Timmerer, Klagenfurt University, Austria
MXM APIs of Each Engine have been Divided into…
• Creation e.g. – Encode a raw audio track– Create an MPEG-7 metadata description
• Access e.g. – Get data from a Digital Item– Decode a video
• Editing e.g. – Add an elementary stream to a multiplexed content
• Engine-specific e.g. – RELEngine: authorise(license, query)– LicenseProtocolEngine:
requestLicense(licenseID, serviceURL)
172009/11/23-24 Christian Timmerer, Klagenfurt University, Austria
Fully Interoperable Streaming ofMedia Resources in Heterogeneous Environments
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 18
Including MPEG-4 3D graphics in 3rd-Party Application
• Including mp3, jpeg, mp4 video in third party applications is nowadays a beginner job. – The complexity of such codecs is hidden behind a very simple communication
interface once the content is decoded: matrix of pixels for images and wave samples for audio.
• Transposing the same principle in Computer Graphics world is a challenge due to the variety of representation forms and also the complexity and heterogeneity of data to be transferred
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 19
By using the MXM 3DGraphicsEngine and its set of APIs, the complex integration work is simplified.
With only some lines of code, Ogre3D, a very well known 3D graphics rendering engine, is transformed into an MPEG-4 3D graphics player.
Sharing Protected Content
2009/11/23-24 Christian Timmerer, Klagenfurt University, Austria 20
http://www.smartrm.com
• Client:– MXM-based C++
client as Firefox plug-in
• Server:– MXM-based Java
server
• Protocols:– MXM Protocols over
SOAP and XMPP
Join the MXM Development Team!
• Why you should join
– Plenty of interesting work still has to be done
– Enough space for student projects, master thesis, PhD thesis, etc.
– You can choose between Java, C++ or start a new implementation in another language!
– It gives you visibility on a broad set of MPEG technologies
– Web site, blog, reflector, and soon more utilities
– Friendly and collaborative environment
212009/11/23-24 Christian Timmerer, Klagenfurt University, Austria
Thank you for your attention!
... questions, comments, etc. are welcome …
Ass.-Prof. Dipl.-Ing. Dr. Christian TimmererKlagenfurt University, Department of Information Technology (ITEC)