Top Banner
Multimedia Systems Overview of the Course Mahdi Amiri February 2012 Sharif University of Technology Course Presentation
21

Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Aug 05, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Multimedia Systems Overview of the Course

Mahdi Amiri

February 2012 Sharif University of Technology

Course Presentation

Page 2: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 1 Multimedia Systems, Overview

Course Syllabus

http://ce.sharif.edu/courses/90-91/2/ce342-1/ Website

Page 3: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 2 Multimedia Systems, Overview

Course Syllabus

Z-N. Li, M.S. Drew, Fundamentals of Multimedia, Pearson Prentice Hall Upper Saddle River, NJ, 2004.* * We will mostly use class handouts and lectures. Therefore, text books could be used as a reference.

Textbook

Page 4: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 3 Multimedia Systems, Overview

Course Syllabus

R. Steinmettz and K. Nahrstedt, Multimedia: Computing, Communications and Applications, Prentice Hall, 1995.

R. Steinmettz and K. Nahrstedt, Multimedia Fundamentals: Media Coding and Content Processing, Prentice Hall, 2002.

K. R. Rao, Z. S. Bojkovic and D. A. Milanovic, Multimedia Communication Systems

Other Reference Books

… and Wikipedia

Page 5: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 4 Multimedia Systems, Overview

Course Syllabus

Quiz: Sunday, Lowest quiz will be dropped

HW: Tuesday, Due: 2 Weeks, Req. MATLAB

Grading Policy

Page 6: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 5 Multimedia Systems, Overview

Course Syllabus

Examples: Traffic control using mobile phones, Multimedia systems in schools, Human computer interfacing, Telemedicine, TeleCollaboration, etc.

* We will review the examples in a session

Report structure Literature survey Pros. and Cons. of the existing methods Definition of new proposals

Critical Reading

Page 7: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 6 Multimedia Systems, Overview

Course Syllabus

TA(s) and session time See the course website.

Integral component of the course MATLAB

Problem Solving Classes

Page 8: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 7 Multimedia Systems, Overview

Course Outline

What is Multimedia? Components of Multimedia Multimedia Research Topics and Projects

Processing: e.g. content-based retrieval Networking: e.g. QoS End-Systems: e.g. User Interfaces Interaction: e.g. “ubiquity“ devices

Introduction to Multimedia

Page 9: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 8 Multimedia Systems, Overview

Course Outline

What is “signal”!? Discrete-time signals and systems Sampling theorem Quantization (Scalar Q., Vector Q.) Transform domain analysis FFT, STFT, Wavelet

Review of Signals and Systems

Page 10: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 9 Multimedia Systems, Overview

Course Outline

Audio representations Formats and standards

Frequency Masking vs. Temporal Masking Speech processing

Synthesis, recognition, … Audio Compression

DPCM, ADPCM, LPC, CELP

Audio

Page 11: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 10 Multimedia Systems, Overview

Course Outline

Data storage Data redundancy

Lossy and lossless compression Entropy encoder Predictive coding

Huffman Coding Lempel-Ziv-Welch Arithmatic Coding

Entropy Coding

Page 12: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 11 Multimedia Systems, Overview

Course Outline

Physics of Color Human Eye Additive and subtractive color mixing Color space Models

YUV, RGB, HSV, … Gamma correction

Image, Color Space

Page 13: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 12 Multimedia Systems, Overview

Course Outline

Color Depth Palette, Halftone Image Resolution Histogram, Contrast High-Dynamic-Range (HDR) Bracketing

Image, Acquisition and Representation

Page 14: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 13 Multimedia Systems, Overview

Course Outline

Image Noise Gaussian Smoothing Mean and Median Filter Sharpening Edge Detection Despeckle

Image, Enhancement

Page 15: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 14 Multimedia Systems, Overview

Course Outline

JPEG Encoder Diagram Decoder Diagram Color Space Transformation Subsampling in color space Discrete Cosine Transform (DCT) Quantization Matrix Compression Ratio Blocking Artifact

Image, Compression

Page 16: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 15 Multimedia Systems, Overview

Course Outline

Video Display Progressive, Interlaced

Analog Broadcast TV Systems NTSC, PAL Analog Color Video

Composite video, S-Video, Component video Digital Video (HDTV)

DVI, HDMI, DisplayPort

Video, Analog and Digital Video

Page 17: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 16 Multimedia Systems, Overview

Course Outline

Interframe and intraframe coding Motion Estimation and Motion Compensation

(MEMC) Picture Types

I-frames, B-frames, P-frames Video Codecs

MPEG1, MPEG2, MPEG4 , H.261, H.263, H.264, …

Video Coding

Page 18: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 17 Multimedia Systems, Overview

Course Outline

Standalone vs. Networked Live vs. Orchestrated Multimedia system building blocks Real-time multimedia system

architecture

Multimedia (Networking) Systems

Page 19: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 18 Multimedia Systems, Overview

Course Outline

Quality of Service (QoS) Error concealment Prioritized Encoding Overlay networks Packet-loss, Congestion Unicasting and Multicasting Streaming protocols

Multimedia Networking

Page 20: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 19 Multimedia Systems, Overview

Course Outline

DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia Home Platform (MHP) Multimedia Information Retrieval System 3D Technologies

Multimedia Applications

Page 21: Multimedia Systems - Semantic Scholar...Page 19 Multimedia Systems, Overview . Course Outline . DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia

Page 20 Multimedia Systems, Overview

Thank You

1. http://ce.sharif.edu/~m_amiri/ 2. http://www.dml.ir/

FIND OUT MORE AT...

Multimedia Systems Overview of the Course

Next Session: Introduction to Multimedia Systems