contents
Introduction
Implementation of WSQMS
Quality Data of WSQMS
Connect WSQMS with WS Registry
Update WS Registry
Quality Classification for WS Registry
Modification of WS Registry
Classification
Conclusions
eAC ITG WG 33
Question
Introduction
We implemented Korea e-Government Web service framework,
but ..
How to guarantee quality of Web services?
How to evaluate Web services?
How to store the quality of Web services?
How to search Web service on quality information?
Answer Implement Web Service Quality Management System (WSQMS)
Store quality data in WSQMS
Connect WSQMS with WS Registry
Modify a part of WS Registry data structure
eAC ITG WG
Web service provider
44
Quality Test
Implementation of WSQMS
Automatic test by agent
Reference to TAD(Test Assertion Document)
XML type report
Test of performance, conformability, message reliability, and
security
WSQMS
TAD (test assertion
document)
distribute test program
request quality test
auto executionrefer TAD
perform quality test
send quality test result
inspect quality test report
Quality test report(XML)TAD
• response time and throughput
• conformability
• message reliability
• security
Web service system
eAC ITG WG
Quality contents
Business Value
•Frequency of service use(month/day/hour)• frequency of service use per customer use(month/day/hour)• reputation
Service Level
• performance(response time, throughput)• reliability(usability, accessability, successability)
Interoperability
• conformability(WSDL, SOAP)• WS-I Basic Profile• e-Government WS Basic Profile
Business Processing• message reliability(WS-Reliability)• collaborativeness of WS (WSBPEL) 55
Quality Monitoring
Implementation of WSQMS
Monitoring WS periodically
Measuring of business value, service level, business processing and
interoperability
Web service
Web service
Use service
message notification
refer TAD
TAD
• Interoperability
• conformability
• message reliability
• collaborability of WS
quality analysis
Web service
associate
provide quality report
request quality report
Agent
Agent
message notification
WSQMS
eAC ITG WG
Type InformationSupport
type
Web service
• number of request• number of success/failure• operating time• max/min response time
• Axis Plug-in• Servlet Filter• Proxy
WS containe
r
• usable memory• number of HTTP requests• number of HTTP failure• data amount of HTTP request/response• max/min number of HTTP threads• number of current operating HTTP threads
• Tomcat 5.x• Sun Application Server 8.x• IIS 5.x
OS
• CPU usage• real memory usable• virtual memory usable• Page In/Out/Fault• disk usage
• Solaris 8/9• HP-UX 11/11i• Windows 2000/XP/2003
66
Operation Monitoring
Implementation of WSQMS
Real time monitoring WS, WS container, OS
Provide quality and operating report
Use WSDM spec and agent architecture
Web service system
Install agent
Request to subscribe operation information
WSQMS
Agent
Notify operation information
System manager
Register manager and service
Download agent
Reports
Provide the operation information
Real-time monitoring forWeb service resource
eAC ITG WG 77
Quality Factor
MeasurableFactor
EvaluationFactor
• Availability
• Accessability
• Successability
• Response time
• Throughput
Eval.Criteria
No Eval.Criteria
• Security
• Interoperability
• Biz Process
• Management
• Biz Value
• price
• service suitability
• use effect
• service brand
Single Criteria
ComplexCriteria
WSQDL for quality classification
Follows the criteria of WSQM for quality classification
Composed of 4 major quality factors
Quality Data of WSQMS
eAC ITG WG 88
WSQDL(Web Service Quality Description Language)
Quality Data of WSQMS
Composed of factor, subfactor, property, subproperty, function, and
performance
Concept of quality chain (connected factors)
Target Web services
Quality Factor
Biz process factor
Eval factor
Biz value factor
Measure factor
Property Sub property Function Performance
Sub factor
Sub factor Property Appraisal
Sub factor Property Function Performance
Metric
eAC ITG WG 99
Why?
Connect WSQMS with WS Registry
User wants to search on quality data
Quality data is variable -> should be synchronized
WSQMS and WS Registry is complementary for each other
How?
Preserve functional independency
Sharing quality data
Implement API of SOAP-based
Automatic operation
eAC ITG WG 1010
Method 1: WS registry has a reference to WS quality data in WSQMS
How to share Quality Data?
Need no synchronization process for quality data between WS
registry and WSQMS
Restriction in use of quality data at WS registry
Method 2: WS registry has copy of WSQDL from WSQMS Need the synchronization process
Possible to search WS on WS quality data
Connect WSQMS with WS Registry
eAC ITG WG 1111
Scenario of Method 1
Connect WSQMS with WS Registry
WSQMS initiates WS quality activity
WS Registry provides WSDL
WSQMS provides quality information
Web service provider
register Web service
request new Web service info
provide WSDL of new Web service
Web service
test with agent
store quality data
Connection API
store reference of quality data
provide reference of quality info
WS RegistryWeb Service Quality Management System
Web serviceQuality info
eAC ITG WG 1212WS Provider
provide WSDL of new WS + request info of quality context
Web service
test with agent
ConnectionAPI
provide info of quality context
WS Registry
WS Registry manager
register quality context
register WS
Scenario of Method 2 WS Registry requests the data of quality context of a new WS
WSQMS provides WSQDL after testing
WS registry parses it and store the quality value as quality context
Web Service Quality Management System
store value of WS quality context
Web serviceQuality info
store quality data
Connect WSQMS with WS Registry
eAC ITG WG 1313
Connection APIs
classification API name Function description
Search new WS
find_newBusinesses Search new biz entity
find_newServices Search new biz service
find_newBindings Search new binding
find_newtModels Search new tModel
Save WS quality data
save_refOfWSQDL
save_qualityContext
Write reference to quality data in tModelStore the quality context inform.
Modify&delete WS quality data
delete_qualityDataupdate_qualityData
Delete WSQDL tModel Modify WSQDL tModel
Synch WS inform
synch_WSDLSynch periodically WSDL between WSQMS and WS registry
Time inform of updating quality data
get_lastUpdateTimeQDget_lastUpdateTimeQC
Last update time of WSQDLLast update time for quality context
Messaging I/F
Security I/F
Registry Service Receiver
Quality Data Query Manager
Quality Data LC Manager
Quality Data Sender
Registry Service Requester
WSQMS
Messaging I/F
Security I/F
Registry Service Sender
Quality Data Requester
Quality Data LC Requester
Quality Data Receiver
Registry Service Request Receiver
Web Registry
For connection, quality data processing, WS registry service, and messaging
& security APIs are required.
Each module is composed of necessary functions, used by SOAP I/F.
Connect WSQMS with WS Registry
eAC ITG WG 1414
Question
Update WS Registry
How to preserve the current implementation as possible as?
How to connect with WSQMS seamlessly?
How to organize the quality classification scheme?
Answer
Follow UDDI spec as possible as
Provide APIs for connection in SOAP style
Devise a new data structure such as categoryBag and quality
context
eAC ITG WG 1515
Method 1: modify overviewDoc
Add <wsqdlURL> tag in <overviewDoc>
Easy to understand, but difficult to process quality data flexibly
Update WS Registry
eAC ITG WG 1616
Method 2: add qualityBag
Add <qualityBag> tag in
tModel such as
<categoryBag>, storing
quality data reference
in tModel.
Possible independent
processing for quality
reference
Update WS Registry
eAC ITG WG 1717
Method 3: add qualityContext
Add <qualityBag> tag in
tModel such as method 2
for representing
<qualityContext>
Update WS Registry
eAC ITG WG 1818
Purpose
Quality Classification for WS Registry
Enable user to search WS on quality data.
Enable high-level composite search on quality data.
For example: Search WS satisfying WS-I interoperability with 128
encryption key for DSIG, responding 0.01 sec.
Issues
How to compose the quality classification scheme?
How to update the value of quality classification item
up-to-date?
eAC ITG WG 1919
WSQDL
Metric Eval Biz Proc Biz Val
Interop Sec Manage
keySize encAlg
WSQMS UDDI tModel
<qualityBag> <tModelKey=“uddi:uddi.org:wsqm:quality:wsqdl-3344”/>
<qualityContext tModelKey=“uddi:uddi.org:wsqm:eval:security:keySize” value=“128”/>
<qualityContext tModelKey=“uddi:uddi.org:wsqm:eval:security:encAlg” value=“RSA”/>
</qualityBag>
Concept of quality context Path for representing quality factor according to WSQDL quality
chain
Represented as a set in <qualityBag>
Quality Classification for WS Registry
eAC ITG WG 2020
WSDL 1
Quality context 1 value
Quality context 2 value
Quality context 3 value
WSDL 2
Quality context 1 value
Quality context 2 value
Quality context 3 value
WSDL 3
Quality context 1 value
Quality context 2 value
Quality context 3 value
Quality Context
WSquality
/eval/sec/keySize128: WS1, WS2
64: WS3
/eval/sec/encAlgRSA: WS1
DES: WS2, WS3
/eval/int/ratioWSI99: WS1
< 97: WS3
98: WS2
Quality classification
Quality classification Compose quality classification scheme with quality context Get a quality value on the quality context
Quality Classification for WS Registry
eAC ITG WG 21
• After completion of these systems, WSQMS and WS registry, they could
contribute to enhance WS quality more rapidly.
WSQMS has been implemented.
trying to implement connection APIs
plan to modify national WS registry
• Classification scheme is critical for WS dissemination. It needs
continuous modification efforts.
• Further research for connection between national WS registries
Conclusions