Multimedia Computing and Multimedia Computing and Communications Communications C. Edward C. Edward Chow Chow
Feb 01, 2016
Multimedia Computing and Multimedia Computing and CommunicationsCommunicationsMultimedia Computing and Multimedia Computing and CommunicationsCommunications
C. Edward C. Edward ChowChowC. Edward C. Edward ChowChow
mcc chow 2
Outline of the TalkOutline of the TalkOutline of the TalkOutline of the Talk
SyllabusSyllabus
Introduction to Multimedia ComputingIntroduction to Multimedia Computing
Introduction to Multimedia Introduction to Multimedia CommunicationsCommunications
Ideas for Semester ProjectsIdeas for Semester Projects
mcc chow 3
MediaMediaMediaMedia
mediummedium (METHOD) (METHOD)noun [C] plural noun [C] plural mediamedia or or mediumsmediumsa method or way of expressing somethinga method or way of expressing something
new medianew media plural nounplural nounproducts and services that provide information or products and services that provide information or entertainment using computers or the Internet, entertainment using computers or the Internet, and not by traditional methods such as television and not by traditional methods such as television and newspapers: .and newspapers: . Cambridge Advanced Learner's DictionaryCambridge Advanced Learner's Dictionary
mediummedium (METHOD) (METHOD)noun [C] plural noun [C] plural mediamedia or or mediumsmediumsa method or way of expressing somethinga method or way of expressing something
new medianew media plural nounplural nounproducts and services that provide information or products and services that provide information or entertainment using computers or the Internet, entertainment using computers or the Internet, and not by traditional methods such as television and not by traditional methods such as television and newspapers: .and newspapers: . Cambridge Advanced Learner's DictionaryCambridge Advanced Learner's Dictionary
mcc chow 4
MultimediaMultimediaMultimediaMultimediaadjective [before noun]adjective [before noun]using a combination of moving and still pictures, using a combination of moving and still pictures, sound, music and words, especially in computers or sound, music and words, especially in computers or entertainmententertainmentCambridge Advanced Learner's Cambridge Advanced Learner's DictionaryDictionary
““A shaky noun/adjective can be broadly defined as A shaky noun/adjective can be broadly defined as electronically augmented or generated object and electronically augmented or generated object and experience that appeared to the senses.” experience that appeared to the senses.” Steve Steve WeinsteinWeinstein
““Multi- is not necessary, media already plural, a Multi- is not necessary, media already plural, a combination of more than one medium.” combination of more than one medium.” Mrinal Mrinal MandalMandal
Smell, touch and other senses should be included, Smell, touch and other senses should be included, but they are harder to transmitted over Internet. but they are harder to transmitted over Internet.
Disney Animal Kingdom, Bug of life theater under Disney Animal Kingdom, Bug of life theater under the life of tree with media presentation including the life of tree with media presentation including touch and smelltouch and smell
adjective [before noun]adjective [before noun]using a combination of moving and still pictures, using a combination of moving and still pictures, sound, music and words, especially in computers or sound, music and words, especially in computers or entertainmententertainmentCambridge Advanced Learner's Cambridge Advanced Learner's DictionaryDictionary
““A shaky noun/adjective can be broadly defined as A shaky noun/adjective can be broadly defined as electronically augmented or generated object and electronically augmented or generated object and experience that appeared to the senses.” experience that appeared to the senses.” Steve Steve WeinsteinWeinstein
““Multi- is not necessary, media already plural, a Multi- is not necessary, media already plural, a combination of more than one medium.” combination of more than one medium.” Mrinal Mrinal MandalMandal
Smell, touch and other senses should be included, Smell, touch and other senses should be included, but they are harder to transmitted over Internet. but they are harder to transmitted over Internet.
Disney Animal Kingdom, Bug of life theater under Disney Animal Kingdom, Bug of life theater under the life of tree with media presentation including the life of tree with media presentation including touch and smelltouch and smell
mcc chow 5
Multimedia ApplicationsMultimedia ApplicationsMultimedia ApplicationsMultimedia Applications
Digital librariesDigital libraries
Distance LearningDistance LearningInteractive Voice Response (IVR) Interactive Voice Response (IVR) VoiceXMLVoiceXML
Interactive TVInteractive TV
Tele-medicineTele-medicine
GameGame
Sniper tracking? (Vanderbilt)Sniper tracking? (Vanderbilt)
……..
Digital librariesDigital libraries
Distance LearningDistance LearningInteractive Voice Response (IVR) Interactive Voice Response (IVR) VoiceXMLVoiceXML
Interactive TVInteractive TV
Tele-medicineTele-medicine
GameGame
Sniper tracking? (Vanderbilt)Sniper tracking? (Vanderbilt)
……..
mcc chow 6
Classification of MediaClassification of MediaClassification of MediaClassification of Media
Perception: five sensesPerception: five senses
Representation: such as various Representation: such as various formatformatPCM/MP3/WAV; GIF/JPEG/PNG; PCM/MP3/WAV; GIF/JPEG/PNG; MPEG/AVI/QuickTimeMPEG/AVI/QuickTime
Presentation: tools/devices for I/OPresentation: tools/devices for I/O
Storage: CD/DVD/Hard DriveStorage: CD/DVD/Hard Drive
Transmission: wireless/fiber/coaxial Transmission: wireless/fiber/coaxial cablecable
Discrete (time independent) vs.Discrete (time independent) vs.Continuous (time dependent)Continuous (time dependent)
Perception: five sensesPerception: five senses
Representation: such as various Representation: such as various formatformatPCM/MP3/WAV; GIF/JPEG/PNG; PCM/MP3/WAV; GIF/JPEG/PNG; MPEG/AVI/QuickTimeMPEG/AVI/QuickTime
Presentation: tools/devices for I/OPresentation: tools/devices for I/O
Storage: CD/DVD/Hard DriveStorage: CD/DVD/Hard Drive
Transmission: wireless/fiber/coaxial Transmission: wireless/fiber/coaxial cablecable
Discrete (time independent) vs.Discrete (time independent) vs.Continuous (time dependent)Continuous (time dependent)
mcc chow 7
Type of Type of Media/ApplicationsMedia/ApplicationsType of Type of Media/ApplicationsMedia/Applications
Adapted from Mirinal Mandal’s “Multimedia Signals and Adapted from Mirinal Mandal’s “Multimedia Signals and Systems”Systems”Adapted from Mirinal Mandal’s “Multimedia Signals and Adapted from Mirinal Mandal’s “Multimedia Signals and Systems”Systems”
mcc chow 8
DVD vs. CDDVD vs. CDDVD vs. CDDVD vs. CD
Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”
mcc chow 9
Display StandardsDisplay StandardsDisplay StandardsDisplay Standards
mcc chow 10
Multimedia WorkstationsMultimedia Workstationsat Home and Officeat Home and OfficeMultimedia WorkstationsMultimedia Workstationsat Home and Officeat Home and Office
Adapted from Mirinal Mandal’s “Multimedia Signals and Adapted from Mirinal Mandal’s “Multimedia Signals and Systems”Systems”
mcc chow 11
Networked Media CenterNetworked Media CenterPersonal ComputerPersonal ComputerNetworked Media CenterNetworked Media CenterPersonal ComputerPersonal Computer
Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”
mcc chow 12
Multimedia PCMultimedia PCNext GenerationNext GenerationMultimedia PCMultimedia PCNext GenerationNext Generation
Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”
mcc chow 13
Multimedia Multimedia CommunicationsCommunicationsMultimedia Multimedia CommunicationsCommunications
InternetPSTN
CableHeadEnd
ISP
ISP
DSLFiber
DSL
ISP
MPC
MCU
Office
Home
Wifi hot spot
Cable/Broadcast
Media
Cell PhonesTowers
Web/Streaming
server
MPC: Multimedia PCMCU: Multipoint Control UnitISP: Internet Service ProviderDSL: Digital Subscriber Loop
PSTN: Public Switched Telephone Network
mcc chow 14
Multimedia ExchangeMultimedia ExchangeMultimedia ExchangeMultimedia Exchange
P2P modelP2P model
Adapted from Steve Weinstein’s “Multimedia Adapted from Steve Weinstein’s “Multimedia Internet”Internet”
mcc chow 15
Milestones of MultimediaMilestones of MultimediaMilestones of MultimediaMilestones of Multimedia
Directx 9/10Directx 9/10
IE6 IE6 Podcasting
VOIP VOIP MPEG7/21MPEG7/21
RSS
IVR/VoiceXML/VoiceXML10GEthernet10GEthernetWLAN WLAN
802/11.abgn802/11.abgnWiManWiMan
801.15 PAN801.15 PANDVD double layer DVD double layer iPODiPOD
USB Flash Drive USB Flash Drive Xbox360Xbox360
02 04 06
mcc chow 16
Related CS and EE FieldsRelated CS and EE FieldsRelated CS and EE FieldsRelated CS and EE Fields
Computer Graphics/Virtual RealityComputer Graphics/Virtual Reality
Human Computer InterfaceHuman Computer Interface
Network/Protocol DesignNetwork/Protocol Design
OS/Real Time OS/Real Time Programming/SchedulingProgramming/Scheduling
Object Oriented ProgrammingObject Oriented Programming
Information Storage and RetrievalInformation Storage and Retrieval
Computer Architecture/IO SystemsComputer Architecture/IO Systems
Signal ProcessingSignal Processing
Computer Graphics/Virtual RealityComputer Graphics/Virtual Reality
Human Computer InterfaceHuman Computer Interface
Network/Protocol DesignNetwork/Protocol Design
OS/Real Time OS/Real Time Programming/SchedulingProgramming/Scheduling
Object Oriented ProgrammingObject Oriented Programming
Information Storage and RetrievalInformation Storage and Retrieval
Computer Architecture/IO SystemsComputer Architecture/IO Systems
Signal ProcessingSignal Processing
mcc chow 17
Semester ProjectsSemester ProjectsSemester ProjectsSemester Projects
Sniper Tracking System (wireless Sniper Tracking System (wireless sensor?/WLAN with microphone/high sensor?/WLAN with microphone/high resolution camera)resolution camera)
Decoding Human Body Movement Decoding Human Body Movement ProjectProject
Secure Podcasting SystemSecure Podcasting System
IVR over VOIP/telephone IVR over VOIP/telephone
Multimedia Conference System (Intel Multimedia Conference System (Intel HMP or open source/JMF)HMP or open source/JMF)
Interactive Networked Multimedia Interactive Networked Multimedia GameGame
Sniper Tracking System (wireless Sniper Tracking System (wireless sensor?/WLAN with microphone/high sensor?/WLAN with microphone/high resolution camera)resolution camera)
Decoding Human Body Movement Decoding Human Body Movement ProjectProject
Secure Podcasting SystemSecure Podcasting System
IVR over VOIP/telephone IVR over VOIP/telephone
Multimedia Conference System (Intel Multimedia Conference System (Intel HMP or open source/JMF)HMP or open source/JMF)
Interactive Networked Multimedia Interactive Networked Multimedia GameGame
mcc chow 18
UCCS Multimedia UCCS Multimedia Computing ResourcesComputing ResourcesUCCS Multimedia UCCS Multimedia Computing ResourcesComputing Resources
Multimedia Lab in El Pomar libraryMultimedia Lab in El Pomar library
Both Windows and Apple PCBoth Windows and Apple PC
Scanner, Digital TapeScanner, Digital Tape
Adobe/Macromedia software, Apple iMove..Adobe/Macromedia software, Apple iMove..
DVD Writer (Sign up/reserve your disk space for DVD Writer (Sign up/reserve your disk space for overnight video rendering)overnight video rendering)
Check out digital camera/camcorder/tripod from Check out digital camera/camcorder/tripod from Help Desk in El Pomar Help Desk in El Pomar
EN233 Lab (MathLab7.1)EN233 Lab (MathLab7.1)
EN149 Lab (VPC/VMware Virtual machines)EN149 Lab (VPC/VMware Virtual machines)
EN143 Lab MPC/Server that requires root privilegeEN143 Lab MPC/Server that requires root privilege
Bring your own headset/microphoneBring your own headset/microphone
Multimedia Lab in El Pomar libraryMultimedia Lab in El Pomar library
Both Windows and Apple PCBoth Windows and Apple PC
Scanner, Digital TapeScanner, Digital Tape
Adobe/Macromedia software, Apple iMove..Adobe/Macromedia software, Apple iMove..
DVD Writer (Sign up/reserve your disk space for DVD Writer (Sign up/reserve your disk space for overnight video rendering)overnight video rendering)
Check out digital camera/camcorder/tripod from Check out digital camera/camcorder/tripod from Help Desk in El Pomar Help Desk in El Pomar
EN233 Lab (MathLab7.1)EN233 Lab (MathLab7.1)
EN149 Lab (VPC/VMware Virtual machines)EN149 Lab (VPC/VMware Virtual machines)
EN143 Lab MPC/Server that requires root privilegeEN143 Lab MPC/Server that requires root privilege
Bring your own headset/microphoneBring your own headset/microphone
mcc chow 19
EL Pomar 238 Multimedia EL Pomar 238 Multimedia Development Lab Development Lab EL Pomar 238 Multimedia EL Pomar 238 Multimedia Development Lab Development Lab
9 Multmedia PC. 3.6GHz, 1.5GB. D: Drive for temporary 9 Multmedia PC. 3.6GHz, 1.5GB. D: Drive for temporary storage space. WinXP storage space. WinXP
HP Scanjet 4070 Photosmart scanner. HP Scanjet 4070 Photosmart scanner. JVC SR-VS30U DV/VHS Tape Recorder/Player JVC SR-VS30U DV/VHS Tape Recorder/Player Multimedia Software Packages: Multimedia Software Packages: Adobe: Audition 1.5, Premiere1.5, Encore CS, Illustrator CS, Adobe: Audition 1.5, Premiere1.5, Encore CS, Illustrator CS, PhotoShop CS, InDesign CS, Designer 7.0, Encore DVD 1.5, PhotoShop CS, InDesign CS, Designer 7.0, Encore DVD 1.5, GoLive CS, ImageReady CS, Acrobat 7.0 Professional, After GoLive CS, ImageReady CS, Acrobat 7.0 Professional, After Effects 6.5. Effects 6.5. Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Firework MX2004. Firework MX2004. S: mapped to S: mapped to \\excelsior\\excelsior Z: mapped to Z: mapped to \\enterprise\users\faculty\\enterprise\users\faculty
4 Apple Dual 2 GHz PowerPC G5 1GBDDR SDRAM MacOS 4 Apple Dual 2 GHz PowerPC G5 1GBDDR SDRAM MacOS Adobe: Illustrator CS, PhotoShop CS, InDesign CS, Designer Adobe: Illustrator CS, PhotoShop CS, InDesign CS, Designer 7.0, GoLive CS, Acrobat 6.0 Professional, After Effects 6.0 7.0, GoLive CS, Acrobat 6.0 Professional, After Effects 6.0 iTune(with podcast) iDVD, iMovie, iPhoto iTune(with podcast) iDVD, iMovie, iPhoto Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Firework MX2004. Firework MX2004.
9 Multmedia PC. 3.6GHz, 1.5GB. D: Drive for temporary 9 Multmedia PC. 3.6GHz, 1.5GB. D: Drive for temporary storage space. WinXP storage space. WinXP
HP Scanjet 4070 Photosmart scanner. HP Scanjet 4070 Photosmart scanner. JVC SR-VS30U DV/VHS Tape Recorder/Player JVC SR-VS30U DV/VHS Tape Recorder/Player Multimedia Software Packages: Multimedia Software Packages: Adobe: Audition 1.5, Premiere1.5, Encore CS, Illustrator CS, Adobe: Audition 1.5, Premiere1.5, Encore CS, Illustrator CS, PhotoShop CS, InDesign CS, Designer 7.0, Encore DVD 1.5, PhotoShop CS, InDesign CS, Designer 7.0, Encore DVD 1.5, GoLive CS, ImageReady CS, Acrobat 7.0 Professional, After GoLive CS, ImageReady CS, Acrobat 7.0 Professional, After Effects 6.5. Effects 6.5. Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Firework MX2004. Firework MX2004. S: mapped to S: mapped to \\excelsior\\excelsior Z: mapped to Z: mapped to \\enterprise\users\faculty\\enterprise\users\faculty
4 Apple Dual 2 GHz PowerPC G5 1GBDDR SDRAM MacOS 4 Apple Dual 2 GHz PowerPC G5 1GBDDR SDRAM MacOS Adobe: Illustrator CS, PhotoShop CS, InDesign CS, Designer Adobe: Illustrator CS, PhotoShop CS, InDesign CS, Designer 7.0, GoLive CS, Acrobat 6.0 Professional, After Effects 6.0 7.0, GoLive CS, Acrobat 6.0 Professional, After Effects 6.0 iTune(with podcast) iDVD, iMovie, iPhoto iTune(with podcast) iDVD, iMovie, iPhoto Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Firework MX2004. Firework MX2004.
mcc chow 20
EN233 LabEN233 LabEN233 LabEN233 Lab40 Pentium 4 PC 3.4Ghz, 1GB, sound card.40 Pentium 4 PC 3.4Ghz, 1GB, sound card.
Contain MATLAB 7.0.4 version which we will use for some of Contain MATLAB 7.0.4 version which we will use for some of our audio/video exercises.our audio/video exercises.Find in “my computer” the network drive that maps to your Find in “my computer” the network drive that maps to your ufp directory under \\excelsior\Students. Normally it is ufp directory under \\excelsior\Students. Normally it is mapped to z drive. Create a cs525 directory that network mapped to z drive. Create a cs525 directory that network drive and save your work in z:\cs525. This allows you to drive and save your work in z:\cs525. This allows you to login any computer to retrieve the files saved there.login any computer to retrieve the files saved there.If you can not find the ufp directory mapped as a network If you can not find the ufp directory mapped as a network drive in the local machine. You can use c:\temp for your drive in the local machine. You can use c:\temp for your work but transfer to ufp or CS Unix machines for storage.work but transfer to ufp or CS Unix machines for storage.Create a directory with your login in c:\temp directory andCreate a directory with your login in c:\temp directory andUse c:\temp\<login> it to save your work.Use c:\temp\<login> it to save your work.Note that the content in c:\temp will be clean up periodically Note that the content in c:\temp will be clean up periodically by the system admin’s scheduled task. It may not be there by the system admin’s scheduled task. It may not be there next moring.next moring.The front panel of the PC has green plug for audio playback.The front panel of the PC has green plug for audio playback.The back panel of the PC has red plug for audio recording The back panel of the PC has red plug for audio recording and green plug for audio playback.and green plug for audio playback.
40 Pentium 4 PC 3.4Ghz, 1GB, sound card.40 Pentium 4 PC 3.4Ghz, 1GB, sound card.Contain MATLAB 7.0.4 version which we will use for some of Contain MATLAB 7.0.4 version which we will use for some of our audio/video exercises.our audio/video exercises.Find in “my computer” the network drive that maps to your Find in “my computer” the network drive that maps to your ufp directory under \\excelsior\Students. Normally it is ufp directory under \\excelsior\Students. Normally it is mapped to z drive. Create a cs525 directory that network mapped to z drive. Create a cs525 directory that network drive and save your work in z:\cs525. This allows you to drive and save your work in z:\cs525. This allows you to login any computer to retrieve the files saved there.login any computer to retrieve the files saved there.If you can not find the ufp directory mapped as a network If you can not find the ufp directory mapped as a network drive in the local machine. You can use c:\temp for your drive in the local machine. You can use c:\temp for your work but transfer to ufp or CS Unix machines for storage.work but transfer to ufp or CS Unix machines for storage.Create a directory with your login in c:\temp directory andCreate a directory with your login in c:\temp directory andUse c:\temp\<login> it to save your work.Use c:\temp\<login> it to save your work.Note that the content in c:\temp will be clean up periodically Note that the content in c:\temp will be clean up periodically by the system admin’s scheduled task. It may not be there by the system admin’s scheduled task. It may not be there next moring.next moring.The front panel of the PC has green plug for audio playback.The front panel of the PC has green plug for audio playback.The back panel of the PC has red plug for audio recording The back panel of the PC has red plug for audio recording and green plug for audio playback.and green plug for audio playback.