Web Services Registry for Quality Assurance 14 th Oct. 2008 Youngkon Lee.

Web Services Registry for Quality Assurance

14th Oct. 2008

Youngkon Lee

contents

Introduction

Implementation of WSQMS

Quality Data of WSQMS

Connect WSQMS with WS Registry

Update WS Registry

Quality Classification for WS Registry

Modification of WS Registry

Classification

Conclusions

eAC ITG WG 33

Question

Introduction

We implemented Korea e-Government Web service framework,

but ..

How to guarantee quality of Web services?

How to evaluate Web services?

How to store the quality of Web services?

How to search Web service on quality information?

Answer Implement Web Service Quality Management System (WSQMS)

Store quality data in WSQMS


Modify a part of WS Registry data structure

eAC ITG WG

Web service provider

44

Quality Test


Automatic test by agent

Reference to TAD(Test Assertion Document)

XML type report

Test of performance, conformability, message reliability, and

security

WSQMS

TAD (test assertion

document)

distribute test program

request quality test

auto executionrefer TAD

perform quality test

send quality test result

inspect quality test report

Quality test report(XML)TAD

• response time and throughput

• conformability

• message reliability

• security

Web service system

eAC ITG WG

Quality contents

Business Value

•Frequency of service use(month/day/hour)• frequency of service use per customer use(month/day/hour)• reputation

Service Level

• performance(response time, throughput)• reliability(usability, accessability, successability)

Interoperability

• conformability(WSDL, SOAP)• WS-I Basic Profile• e-Government WS Basic Profile

Business Processing• message reliability(WS-Reliability)• collaborativeness of WS (WSBPEL) 55

Quality Monitoring


Monitoring WS periodically

Measuring of business value, service level, business processing and

interoperability

Web service

Web service

Use service

message notification

refer TAD

TAD

• Interoperability

• conformability

• message reliability

• collaborability of WS

quality analysis

Web service

associate

provide quality report

request quality report

Agent

Agent

message notification

WSQMS

eAC ITG WG

Type InformationSupport

type

Web service

• number of request• number of success/failure• operating time• max/min response time

• Axis Plug-in• Servlet Filter• Proxy

WS containe

r

• usable memory• number of HTTP requests• number of HTTP failure• data amount of HTTP request/response• max/min number of HTTP threads• number of current operating HTTP threads

• Tomcat 5.x• Sun Application Server 8.x• IIS 5.x

OS

• CPU usage• real memory usable• virtual memory usable• Page In/Out/Fault• disk usage

• Solaris 8/9• HP-UX 11/11i• Windows 2000/XP/2003

66

Operation Monitoring


Real time monitoring WS, WS container, OS

Provide quality and operating report

Use WSDM spec and agent architecture

Web service system

Install agent

Request to subscribe operation information

WSQMS

Agent

Notify operation information

System manager

Register manager and service

Download agent

Reports

Provide the operation information

Real-time monitoring forWeb service resource

eAC ITG WG 77

Quality Factor

MeasurableFactor

EvaluationFactor

• Availability

• Accessability

• Successability

• Response time

• Throughput

Eval.Criteria

No Eval.Criteria

• Security

• Interoperability

• Biz Process

• Management

• Biz Value

• price

• service suitability

• use effect

• service brand

Single Criteria

ComplexCriteria

WSQDL for quality classification

Follows the criteria of WSQM for quality classification

Composed of 4 major quality factors


eAC ITG WG 88

WSQDL(Web Service Quality Description Language)


Composed of factor, subfactor, property, subproperty, function, and

performance

Concept of quality chain (connected factors)

Target Web services

Quality Factor

Biz process factor

Eval factor

Biz value factor

Measure factor

Property Sub property Function Performance

Sub factor

Sub factor Property Appraisal

Sub factor Property Function Performance

Metric

eAC ITG WG 99

Why?


User wants to search on quality data

Quality data is variable -> should be synchronized

WSQMS and WS Registry is complementary for each other

How?

Preserve functional independency

Sharing quality data

Implement API of SOAP-based

Automatic operation

eAC ITG WG 1010

Method 1: WS registry has a reference to WS quality data in WSQMS

How to share Quality Data?

Need no synchronization process for quality data between WS

registry and WSQMS

Restriction in use of quality data at WS registry

Method 2: WS registry has copy of WSQDL from WSQMS Need the synchronization process

Possible to search WS on WS quality data


eAC ITG WG 1111

Scenario of Method 1


WSQMS initiates WS quality activity

WS Registry provides WSDL

WSQMS provides quality information

Web service provider

register Web service

request new Web service info

provide WSDL of new Web service

Web service

test with agent

store quality data

Connection API

store reference of quality data

provide reference of quality info

WS RegistryWeb Service Quality Management System

Web serviceQuality info

eAC ITG WG 1212WS Provider

provide WSDL of new WS + request info of quality context

Web service

test with agent

ConnectionAPI

provide info of quality context

WS Registry

WS Registry manager

register quality context

register WS

Scenario of Method 2 WS Registry requests the data of quality context of a new WS

WSQMS provides WSQDL after testing

WS registry parses it and store the quality value as quality context

Web Service Quality Management System

store value of WS quality context

Web serviceQuality info

store quality data


eAC ITG WG 1313

Connection APIs

classification API name Function description

Search new WS

find_newBusinesses Search new biz entity

find_newServices Search new biz service

find_newBindings Search new binding

find_newtModels Search new tModel

Save WS quality data

save_refOfWSQDL

save_qualityContext

Write reference to quality data in tModelStore the quality context inform.

Modify&delete WS quality data

delete_qualityDataupdate_qualityData

Delete WSQDL tModel Modify WSQDL tModel

Synch WS inform

synch_WSDLSynch periodically WSDL between WSQMS and WS registry

Time inform of updating quality data

get_lastUpdateTimeQDget_lastUpdateTimeQC

Last update time of WSQDLLast update time for quality context

Messaging I/F

Security I/F

Registry Service Receiver

Quality Data Query Manager

Quality Data LC Manager

Quality Data Sender

Registry Service Requester

WSQMS

Messaging I/F

Security I/F

Registry Service Sender

Quality Data Requester

Quality Data LC Requester

Quality Data Receiver

Registry Service Request Receiver

Web Registry

For connection, quality data processing, WS registry service, and messaging

& security APIs are required.

Each module is composed of necessary functions, used by SOAP I/F.


eAC ITG WG 1414

Question

Update WS Registry

How to preserve the current implementation as possible as?

How to connect with WSQMS seamlessly?

How to organize the quality classification scheme?

Answer

Follow UDDI spec as possible as

Provide APIs for connection in SOAP style

Devise a new data structure such as categoryBag and quality

context

eAC ITG WG 1515

Method 1: modify overviewDoc

Add <wsqdlURL> tag in <overviewDoc>

Easy to understand, but difficult to process quality data flexibly

Update WS Registry

eAC ITG WG 1616

Method 2: add qualityBag

Add <qualityBag> tag in

tModel such as

<categoryBag>, storing

quality data reference

in tModel.

Possible independent

processing for quality

reference

Update WS Registry

eAC ITG WG 1717

Method 3: add qualityContext

Add <qualityBag> tag in

tModel such as method 2

for representing

<qualityContext>

Update WS Registry

eAC ITG WG 1818

Purpose


Enable user to search WS on quality data.

Enable high-level composite search on quality data.

For example: Search WS satisfying WS-I interoperability with 128

encryption key for DSIG, responding 0.01 sec.

Issues

How to compose the quality classification scheme?

How to update the value of quality classification item

up-to-date?

eAC ITG WG 1919

WSQDL

Metric Eval Biz Proc Biz Val

Interop Sec Manage

keySize encAlg

WSQMS UDDI tModel

<qualityBag> <tModelKey=“uddi:uddi.org:wsqm:quality:wsqdl-3344”/>

<qualityContext tModelKey=“uddi:uddi.org:wsqm:eval:security:keySize” value=“128”/>

<qualityContext tModelKey=“uddi:uddi.org:wsqm:eval:security:encAlg” value=“RSA”/>

</qualityBag>

Concept of quality context Path for representing quality factor according to WSQDL quality

chain

Represented as a set in <qualityBag>


eAC ITG WG 2020

WSDL 1

Quality context 1 value



WSDL 2




WSDL 3




Quality Context

WSquality

/eval/sec/keySize128: WS1, WS2

64: WS3

/eval/sec/encAlgRSA: WS1

DES: WS2, WS3

/eval/int/ratioWSI99: WS1

< 97: WS3

98: WS2

Quality classification

Quality classification Compose quality classification scheme with quality context Get a quality value on the quality context


eAC ITG WG 21

• After completion of these systems, WSQMS and WS registry, they could

contribute to enhance WS quality more rapidly.

WSQMS has been implemented.

trying to implement connection APIs

plan to modify national WS registry

• Classification scheme is critical for WS dissemination. It needs

continuous modification efforts.

• Further research for connection between national WS registries

Conclusions

eAC ITG WG 222222

Thank you

Youngkon Lee:

[email protected]

Web Services Registry for Quality Assurance 14 th Oct. 2008 Youngkon Lee.

Documents

quality of web services

quality information

quality assurance

quality test result

web service resource

web services registry

soap ws

ws container