Streaming Marian Adams.ppt

05/03/23 1

STREAMINGMarian E. Adams

05/03/23 2

STREAMINGCONCEPTS

Assist with understanding

05/03/23 3

What is Streaming?

Streaming is a method or technique for transferring data (sound, pictures, and/or text) such that this data can be processed as a steady continuous stream

05/03/23 4

Understanding Streaming

In more tech-related terms:Streaming is the transferring or movement of packets of data (voice, audio, and/or video) across the Web in a steady sequential “stream”, from a “streaming server” through a path on the network to the computers of one or more users

05/03/23 5

The Importance of Streaming

Streaming has become increasingly important with the growth of the Internet, particularly for:

Playing musicTransmitting pictures, films, and animationVideoconferencingGlobal communicationSaving companies & personnel time and moneyTraining and educational purposesSecurity control

05/03/23 6

What Types of Data Can be Streamed?

Sound – “Audio Streaming”Pictures – “Video Streaming”Text -- Words and sentencesMixtures – “Media Streaming”

The term “media” is used to refer to a mix of these various types of data“Rich media” means video plus audio

05/03/23 7

Types of Streaming

There are two basic types of streaming:

True streamingPseudo streaming

05/03/23 8

True StreamingMedia streams are downloaded from a server to a user’s computer and are listened to or viewed as they arriveUsing True Streaming, users can view or listen to media files On Demand in Real Time

“On Demand” means right away upon request“Real Time” means while an event is occurring

05/03/23 9

Pseudo StreamingPseudo Streaming, often called “Progressive Download”, is not True StreamingWhen using “Progressive Download”, users download a significant part of a media file to their computer before viewing itThis method allows users to save the file to their computer for later viewing

05/03/23 10

TRUE STREAMING“Streaming”, as used in this

presentation and general usage, means “True

Streaming”

05/03/23 11

User simplicityA www World Wide Web user merely clicks a link on a Web page & within seconds video or audio material streams into his computer and starts playingThe user expects to listen to or view a steady and blissfully continuous data streamThe user attributes pauses in his viewing to heavy Internet traffic or poor connectionsMost users are unaware of the complexity behind the scenes

05/03/23 12

User’s View of ProblemsKinds of problems users experience:

Quality problems: Fuzzy pictures or soundMomentary pauses, breaks in delivery, or delays, due to:

Heavy Internet trafficPoor connectionsLow grade equipment (used in file creation, file transmittal, or reception)Other reasons of which users are unaware

05/03/23 13

BASIC STREAMING-RELATED CONCEPTS

A few basic concepts are necessary to an

understanding of streaming

05/03/23 14

Digital vs AnalogComputers such as PCs (Personal Computers) are “digital” computersDigital computers operate on data in digital form, not analog formData in analog form must be converted to digital form in order for it to be processed on a digital computerDigital data must be converted back to analog form to be heard as “sound”

05/03/23 15

SoundSound is a sequence of naturally analog signals, in sine wave form, that can be converted to digital signals by an audio card in a computer, using a microchip called an analog-to-digital converter (ADC)Digital computers process the digital signalsWhen ready to be played, the processed digital signal files are converted back from digital to analog via a digital-to-analog audio card and sent to speakers as analog signals that generate varied sound

05/03/23 16

AudioAudio is sound within the acoustic range available to humansAn audio frequency (AF) is an electrical alternating current within the 20 to 20,000 cycles per second range used to produce acoustic sound in computersAF is measured in cycles per second (cps) called “hertz” after a German physicistThe range of human hearing is roughly from 0 to 20,000 cps (0 Hz to 20 kHz)

05/03/23 17

Band(frequency band)

A specified range of frequencies in the radio frequency (RF) spectrumEach band has a defined upper and lower limitBroadcast transmission is at high frequency rates, usually expressed in kilohertz (kHz) or megahertz (MHz)Band usage is assigned and regulated nationally and internationally

05/03/23 18

BandwidthBandwidth is the width of the frequency range that an electronic signal occupies on a particular transmission mediumAny digital or analog signal has a bandwidthDigital: bandwidth is expressed as bits [of data] per second (bps)Analog: bandwidth is expressed as cycles per second (cps or “hertz”)

05/03/23 19

Bandwidth (cont.)Analog: bandwidth is expressed in terms of the difference between the highest and lowest frequency signal components, where frequency is measured in cycles of change per second (hertz)Typical signal bandwidths: voice, 3 KHz; TV broadcast signal, 6 MHz - about 2000 times wider than voice bandwidth

05/03/23 20

Bandwidth BottleneckIn actual telecommunication, a path consists of a succession of links, each having its own bandwidthIf the bandwidth of one link is too low or too much data is trying to pass through it at once, that link will be slower than other linksThe slow link is said to have a “bandwidth bottleneck”If significant, users may experience a break or pause in the continuity of the incoming file

05/03/23 21

BroadbandBroadband is telecommunication in which a wide band of frequencies is available to transmit informationDigital Subscriber Line (DSL) and Cable TV are broadband servicesFrequencies less than broadband are often referred to as “narrowband”

05/03/23 22

Data Rate(Data Transfer Rate)

Data Rate is the amount of digital data that is moved from one place to another in a given time, usually in a second’s timeIn general, the greater the bandwidth of a given path the higher the data rateData rate is measured in bits per second (bps)

05/03/23 23

Compression andDecompression

Video and audio data files, especially video files, are very large and must be compressed in size to save space & time for transmissionCompressed files must be decompressed for processing, then re-compressed if further transmission is required

05/03/23 24

Compression ToolsA software program called a “codec” uses a formula or “algorithm” to determine how to compress or decompress data filesMany algorithms and codecs have been devised by manufacturers and industry organizations and are in use today

05/03/23 25

Lossy Compression ofRaw Media Files

“Raw media” files, a user’s captured or digitized audio and video files, normally are very large & need to be compressed for transport across various bandwidthsThe type of compression used for creating streaming media files is “lossy compression”Lossy compression techniques try to eliminate redundant or unnecessary informationMost video compression technologies, such as MPEG, use a lossy technique

05/03/23 26

Key Points onCompression

Key points on compressing media files for effective streaming:

1. To smoothly play an audio or video file it must be compressed below the target bandwidth capacity; for example:

The bandwidth capacity of most modem connections is about 56k/secA normal 300,000 k/sec video sec would need to be compressed down to a data rate of about 48 kbps, and an audio file from 1200 k/sec to about 24 kbps

2. Compressing media files for streaming always involves “lossy compression”

05/03/23 27

STANDARDIZATION

Standardization control and development

05/03/23 28

StandardizationOrganizations

Standardized control and development of algorithms for media files, codecs, and compression/decompression are developed on an international levelResponsible organizations include:

MPEGISOISMA

05/03/23 29

MPEG Moving Picture Experts

GroupA working group of ISO/TEC charged with developing standards for coded representation of digital audio & video Established 1988 by ISO, International Organization for StandardizationOpen to highly accredited expertsAverage meeting attendance is 300 experts representing over 20 countries

05/03/23 30

MPEG StandardsAn evolving set of standards developed by MPEG for video and audio compression and multimedia deliveryCurrent MPEG standards include:

MPEG-1MPEG-2MPEG-4MPEG-7MPEG-21

05/03/23 31

MPEG –1 and -2MPEG-1 was designed for coding progressive video at a transmission rate of about 1.5 million bits per second (1.5 Mbps)The most common implementation of MPEG-1 provides a video resolution of 352x240 at 30 frames per second (fps)MPEG-2 was designed for coding interlaced images at transmission rates above 4 MbpsMPEG-1 and –2 define techniques for compressing digital video by factors varying from 25:1 to 50:1

05/03/23 32

MPEG-4MPEG-4 is more complex and uses such methodology as fractal geometry, computer visualization, and artificial intelligence (AI)MPEG-4 is supported by RealNetworks and QuickTime; it is not supported by Windows Media Technologies

05/03/23 33

ISMAInternet Streaming Media

Alliance, Inc.ISMA is a non-profit organization to create specifications that define inter-operable implementation for streaming rich media over IP networksThe goal of ISMA is create end-to-end specs that enable cross-platform and multi-vendor implementationsThe first ISMA spec will be for streaming MPEG-4 over IP networks

05/03/23 34

THE STREAMING PROCESSUnderlying concepts provide a basis for understanding the

streaming process

05/03/23 35

Streaming ComponentsVarious streaming technologies existEach technology has three basic components:

Servers and media filesMedia players or plug-insEncoding and creation tools such as codecs

05/03/23 36

What is a “server”?A server is a computer program that provides services to other computer programs in the same or other computersThe computer that a server program runs in is also frequently referred to as a server (although this computer may contain a number of server and client programs)Streaming media files normally reside on a separate dedicated streaming server

05/03/23 37

What is a “plug-in”?“A plug-in is a hardware or software module that adds a specific feature or service to a larger system” WebopediaIn streaming: plug-in refers to a hardware or software module in the user computer which can play a particular type of streamed fileEither a player or a plug-in can play the filePlug-ins can be downloaded free on the Web

05/03/23 38

What is a ”codec”?A codec is any technology to compress and

decompress dataCodecs can be implemented in software or hardware or a combination of bothSome popular codecs for computer video include MPEG, Indeo, & CinepakCodec can also mean a coder/decoder device for converting binary digital signals to analog signals for transmission over a wire

05/03/23 39

Codec usagein streaming

Used in streaming to compress long video files in readiness for transmission over the network, and decompress them at their destinationAlso used in streaming to convert audio and media/audio files from analog to digital for digital computer processing, and from digital to analog for speakers

05/03/23 40

Streaming Process Overview

Source data is obtained from live presentations or prerecorded mediaSource data files are sent to a “streaming server”, compressed, encoded, and readied for streaming over the Internet to the userStreamed files received by user computers are decompressed and converted to digitalAudio files are converted to analog and played on speakers; video and mixed files are processed and output on the user’s computer screen or other designated output hardware

05/03/23 41

STREAMING TECHNOLOGIES

Four major technologies

05/03/23 42

Streaming TechnologiesMany companies provide streaming hardware and softwareTechnologies may incorporate MPEG or proprietary file handling standardsA new file extension is used for each separately developed & used standardFour major companies and technologies currently dominate the field

05/03/23 43

Major TechnologiesStreaming technologies of four leading major companies will be discussed:

Company Streaming technologyRealNetworks RealAudio, RealVideoApple Computer QuickTimeMacromedia FlashMicrosoft Windows Media

05/03/23 44

ProprietaryTechnologies

Each major streaming technology has its own proprietary server media file encoding formatThe various technologies do not generally support each other’s formatsStandardization organizations are attempting to create specs for cross-platform interoperability

05/03/23 45

RealNetworks, Inc.RealAudio, RealVideo,

other products

05/03/23 46

RealNetworks, Inc.started the media industry

In 1995 RealNetworks:Pioneered the Internet media industryForesaw the need for solutions for creation, delivery, & consumption of media over the Internet Invented and released its first version of RealPlayer and RealAudio

05/03/23 47

RealNetworksCurrent Major Media

ProductsMedia Creation: Helix Producer, Camtasia Studio, Presentation Maker, Media Publisher…Media Delivery: Helix Universal Server, Helix Universal Gateway …Media Players: RealOne Players for Unix, for Mac Osx, and for Windows …Other: Helix Platform, RealMedia Production Bundle, Streaming Media Starter Kit

05/03/23 48

RealNetworksSpecial Products

RealOne SuperPass – rich media subscription service – over 1 million subscribersSMIL – language to manage media clipsRealPix – Bandwidth calculatorUniversal codec supportSpecialty tools and plug-ins

05/03/23 49

RealNetworksRealOne Platform

RealOne Player integrates the features found in previous versions of RealPlayer and RealJukebox and adds Web browsingRealOne provides a three window environment to create media presentations:

The media playback windowThe related info windowThe media browser window

05/03/23 50

RealNetworksHelix Platform

Three components work together to stream the user’s media:

Helix Producer – creates streaming Real Media clips (such as RealAudio and Real Video); this process is called “encoding”Helix Universal Server – streams the Real Media clipsRealOne Player – plays the streamed Real Media clips for the user

05/03/23 51

RealNetworksStreaming Media CreationHelix Producer creates streaming media data packets by an “encoding” process

The source media is received as a file or live audio/videoA codec is used to compress the media source data into packetsThe data packets are streamed via the Internet or network to the userAt the user’s end, the codecs are used to piece back the media so the user can play it

05/03/23 52

RealNetworksSMIL

SMIL: Synchronized Multimedia Integration Language, recommended by the World Wide Web Consortium (W3C)A markup language for coordinating and specifying how and when clips playWorks for a media player in the same way HTML works for a Web browserFosters interoperability between media players

05/03/23 53

RealNetworksSMIL advantages

Stream clips located on different servers

SMIL files list a separate URL for each clipEliminates the need to merge clips into a single streaming fileCan lay out a presentation: for example, a RealVideo clip with subtitles written in RealTextCan time and control a presentation

05/03/23 54

RealNetworksTools and Plug-Ins

Various tools have been created to help authors create RealMedia for the Helix Platform

RealText Broadcast Application, RealOne Presentation Wizard, Camtasia, MIDI, …

RealNetworks technology has also been incorporated into many 3rd party vendor authoring tools

05/03/23 55

RealNetworksfile formats

RealNetworks content is created by software developed by RealNetworks using file extensions .ra or .rm or .ramThe content is compressed with proprietary RealVideo and RealAudio codecs, stored in a format developed by RealNetworks, and can be played using the RealOne playerRealNetworks file formats .ra and .rm and .ram are not supported by Microsoft’s Windows Media Player

05/03/23 56

QuickTimeA product of

Apple Computer

05/03/23 57

QuickTimeA new technology!

In 1999 Apple Computer introduced its QuickTime Streaming Server and created a real stir in the streaming media industryThis new Server featured an open sourced, standards-based RTP/RTSP* engine

*Real-Time Transport Protocol/Real-Time Streaming Protocol

05/03/23 58

QuickTimecontinues to grow

In its first year, QuickTime 5 was downloaded over 100 million times by both Windows and Mac customersQuickTime 6 reached 100 million downloads in less than 10 months

05/03/23 59

QuickTimemultimedia products

QuickTime Player – plays, interacts with or for viewing - video, audio, VR or graphic filesQuickTime Pro – for media authoringQuickTime Streaming Server – delivers media in real-time or on-demand over the Internet - no per-stream license fee Darwin Streaming Server – open sourceQuickTime Broadcaster – to produce a live broadcast event

05/03/23 60

QuickTimeStreaming Server 4

The current version, QuickTime Streaming Server 4, extends its support to new standards:

MPEG-43GPPMP3

05/03/23 61

QuickTime Streaming Server 4

Available versionsDesigned for Mac OS X ServerVersions are available for Linux, Solaris, and Windows NT/2000Also available as an open source server:

Called Darwin Streaming ServerCan be ported to other platforms by modifying some platform-specific source files

05/03/23 62

QuickTime 6.3Provides MPEG-4 video, audio, and file format supportAlso supports 3GPP (3rd Generation Partnership Project), the new standard for high-quality multimedia on wireless devices

05/03/23 63

Technology andRelationships

Apple Computer is a founding member of ISMA, an organization dedicated to accelerating the adoption of open standards for streaming rich media over the InternetThe QuickTime file format was chosen by the ISO MPEG committee as the basis for MPEG-4

05/03/23 64

QuickTimearchitecture

QuickTime architecture is track-basedEach element of a QuickTime movie is contained in a separate trackTo make a QuickTime movie, add tracks that point to the media to be usedA single movie may have many different track types, including video, audio, text, sprite, Flash, HREF, hinting, QuickTime VR, and chapter divisionsEach track may possess modifiable properties

05/03/23 65

QuickTimetrack types

Movie track – annotations, copyright info, & general info on the entire movieAudio track – CD-quality audio; other formatsText track – Text imported for titles etc.Sprite track – Small animatable imagesVideo track – Digitized video, 3D animation….Music track - MIDI music with QuickTime instruments3D track – QuickDraw 3DMF metafile objects

05/03/23 66

QuickTimetrack types (cont.)

Chapter track – Divides movie into randomly-addressable chaptersFlash track – for .swf Flash animationVR track – VR info for panorama moviesStreaming track – reference to a live stream, or movie on a streaming serverHint track – allows real-time deliveryHREF (URL links) & VR objects tracks

05/03/23 67

QuickTimeVR panoramas

QuickTime permits content authors to create immersive “cubic” VR movies spanning 360 degreesInteractive elements as well as other movies can also be embedded into QuickTime VR panoramas

05/03/23 68

QuickTimehint tracks

Not all media types can be streamedQuickTime VR movies and Flash tracks will not stream and must be delivered locally from a hard disk or LANMovies for streaming via QuickTime Streaming Server must be hinted (hinting not needed for VR & Flash)Hint tracks tell the server exactly how to package the media data for the network

05/03/23 69

Flashand Shockwave

Products ofMacromedia, Inc.

05/03/23 70

Macromedia MX product family

The MX product family combines client and server-based products and development tools for creating Internet applicationsThe MX suite includes two cornerstone products:

Flash – for graphicsShockwave – for animation

05/03/23 71

MacromediaStudio MX 2004

An integrated tool setIncludes these applications:

Dreamweaver MX 2004Flash MX 2004Fireworks MX 2004FreeHand MXColdFusion MX 6.1 Developer Edition (Windows only)

05/03/23 72

Macromedia Flash MXRich Media Support

Video Support:Import any standard video file supported by QuickTime or Windows Media Player:

MPEG, DV (Digital Video), MOV (QuickTime), and AVI

Manipulate, scale, rotate, skew, mask, and animate video objects, and make them interactive using scripting

05/03/23 73

Macromedia Flash MXRich Media Support

Dynamic loading of JPEGs and MP3 files at runtime

Decreases maintenance costsOptimizes file sizes

High-fidelity audio supportIncorporates audio with support for MP3, ADPCM, and new speech audio compression techniques

05/03/23 74

MacromediaStudio MX 2004

Common user interface across all toolsShared Start pages, site definitions, panel management, document tabs, coding metaphors, and the common Property inspectorAn advanced version also includes Flash MX Professional 2004

05/03/23 75

MacromediaFlash MX 2004

Features Macromedia Flash Player 7Enhanced compilerCreate charts and graphsAnimate text effectsIntegrate rich media content via import of PDF and Adobe Illustrator 10 filesUse Timeline Effects and Behaviors to simplify timeline & scripting tasks

05/03/23 76

MacromediaFlash MX Professional

2004All features of Flash MX 2004 plus:

Forms-based development environmentPowerful data bindingProfessional video capabilities to deliver high-quality videoUse slides to organize & sequence projectsProduce and test content for devices and mobile phones with device templates and emulators

05/03/23 77

Macromedia’sother products

Web publishing products:Dreamweaver – content builderFireworks – graphic designer

Interactive learning products

05/03/23 78

MacromediaFlash

Flash was known as FutureSplash until 1997, when Macromedia bought the company that developed itFlash is a bandwidth-friendly and browser-independent vector-graphic animation technologyAs long as different browsers are equipped with the necessary plug-ins, Flash animations will look the same

05/03/23 79

Flash usesvector graphics

Flash permits users to draw their own animations or import other vector-based imagesThe leading vector technology for designing high-impact, low-bandwidth Web sitesFlash lets designers and developers integrate video, text, audio, and graphics

05/03/23 80

Microsoft’s Windows Media Technologies

An increasingly dominant streaming technology

05/03/23 81

Current Windows Media versions

Current versions include:Windows Media 7Windows Media for Windows XPWindows Media 9 Series

05/03/23 82

Microsoft’s Data Rates

Microsoft’s technology offers:Streaming audio up to 96 KbpsStreaming video at up to 8 Mbps (for the NetShow Theater Server)

05/03/23 83

Media 9 Series FeaturesInstant-on / always-on streamingNew fast and easy playerSmart JukeboxComprehensive platform20% audio & video quality improvementFast Streaming

05/03/23 84

Media 9 Series platform components

Windows Media Player 9 SeriesWindows Media Encoder 9 SeriesWindows Media Audio and Video 9 SeriesWindows Media Services 9 SeriesWindows Media 9 Series SDK

05/03/23 85

Media Series 9Windows Media Series 9 components work together to provide special features to broadband users:

Fast StreamingInstant-on / Always-on playback

05/03/23 86

Fast StreamingEliminates buffering time to deliver instant-on playback experienceStreams content to the Player’s cache as fast as network allows, reducing the likelihood of interruption in play due to network issuesAutomatically restores live or on-demand Player/Server & Server/Server connections if disconnected during a broadcast

05/03/23 87

Fast Streaming requirements

You must run Windows Media Player 9 Series to get Fast StreamingYour connection speed must be higher than the data rate of the content you are playingThe media you are connecting to must be hosted on a server running Windows Media Services 9 Series, a part of the Windows Server 2003 operating system

05/03/23 88

STREAMINGAPPLICATIONS

A few streaming applications and usages are mentioned in this

section

05/03/23 89

Streaming ApplicationsCNN Headline News

In order to bring quality stories to air as fast as the news breaks, CNN Headline News implemented a leading edge streaming media ingest, archive, and browse system, LBRSThe CNN Low Resolution Browse System allows 300 editors, writers, and producers at 3 Atlanta-based CNN news networks to search & browse video, stored from up to 40 simultaneous satellite feeds, in real time at their desktops

05/03/23 90

Streaming Applicationsmovies on-demand

Digital piracy reached epic proportions in summer 2002 when an estimated 1 to 3 million people illegally downloaded or viewed Spider-Man and Star Wars: Attack of the Clones before the films were released to movie theatersVideo-on-demand services are being supported by top film distributors to help combat these practices

05/03/23 91

Streaming ApplicationsVideoconferencing

Videoconferencing is being utilized in many industries and waysCorporations use it to further group projects and research as well as to save employee time and travel expensesStaff training is increased at lowered expense through videoconferencing

05/03/23 92

Streaming ApplicationsOn-line Training

On-line training is one of the major uses for streaming in use todayCompanies as well as universities and private schools are increasingly using streaming techniquesTraining programs are being adopted by governmental and private agencies

05/03/23 93

Streaming Mediacorporate use

Corporate us of streaming media has doubled in the past several yearsSome companies cite concerns about quality and costCost remains the biggest obstacleStaffing is the most expensive aspectOther costs include hardware and software equipment, network bandwidth, and production

05/03/23 94

STREAMINGTHE FUTURE

Looks very bright!THE END