Software Integration for Applications with Audio Stream Intelligent Information Hiding and Multimedia Signal Processing, 2008. International Conference.

Software Integration for Applications with Audio Stream

Intelligent Information Hiding and Multimedia Signal Processing, 2008.International Conference on 15-17 Aug. 2008 ,pp1126-1129

Advisor : Lian-Jou TsaiStudent : Bing-Fen HuangPPT Production : 100%Data : 2011/12/21

Outline Abstract

Introduction

Software integration through wrapper

Wrapper for stream-based multimedia applications

An example

Conclusion

2

Abstract

We have successfully intercepting/redirecting the data :

Files

Characters

Audio data are a huge number of multimedia applications

today.

Try to build a wrapper module that redirects the audio data.

3

Introduction(1/2)

Commercial Off-The-Shelf (COTS)

For integrating MS-Windows COTS applications into

software systems :

I/O interception/redirection techniques

A programmable interfaces

Message queue and clipboard space techniques.

MS-Windows application GUIs

4

The approach can handle only input/output data in forms of

files and character strings.

The video/audio streams are not able to be dealt with.

In order to successfully integrate stream-based applications,

some issues must be considered :

Input and output data

Data stream synchronization

Introduction(2/2)

5

Software integration through wrapper(1/2)

The Windows applications are firstly encapsulated by a

wrapper program.

Hides the operation details

A programmable interface(COTS)

Responsible to convert the requests

Gets the output results

Windows applications can exchange data simply through the

Windows Clipboard mechanism.

6

Interception and redirection through a Wrapper

Software integration through wrapper(2/2)

7

multimedia applications (1/6)

ALSA (Advanced Linux Sound Architecture) is a popular

sound driver/subsystem in Linux 2.6.

In ALSA modules, the playback and capture functions are

already included in its PCM (Pulse Code Modulation)

component.

Wrapper for stream-based

8

multimedia applications (2/6)

Wrapper for stream-based

The system structure of ALSA for Linux

9

multimedia applications (3/6)

Wrapper for stream-based

Working of ALSA sound driver in Linux(Output)

10

multimedia applications (4/6)

Wrapper for stream-based

Working of ALSA sound driver in Linux(Input)

11

multimedia applications (5/6)

Wrapper for stream-based

Integration between two audio applications through Wrapper

12

multimedia applications (6/6)

Spinlock scheme

ALSA sound modules use the function:

interrupt_handle()

spinlock_irq()

spinunlock_irq()

Wrapper for stream-based

13

An example(1/4)

Voice Flight Status Information System (VFSIS)

Integration Skype and ShinxIII

It is composed of a database server and multiple clients distributed on the Internet.

14

An example(2/4)

The system structure of VFSIS

15

An example(3/4)The command word analysis and information inquiry

MySQL database

Airlines

Flight Code

Scheduled Arrival Time

Actual Arrival Time

Assigned Gate

Delay Status

VFSIS GUI

16

An example(4/4)

The server side VFSIS GUI

17

Conclusion(1/2)

The gluing of stream based software applications is a critical technique in

the software integration of multimedia software applications.

We have successfully achieved the goal of intercepting / redirecting the

audio stream data by adopting the wrapper technique.

VFSIS is used to demonstrate the feasibility of our proposed approach.

18

Future works

In addition to the issue of video data stream interception

The synchronization issue between image and voice of the video data stream is also a critical issue.

Conclusion(2/2)

19

Thank for your attention !