Definition of Metric Dependencies Definition of Metric Dependencies for Monitoring the Impact of for Monitoring the Impact of Quality of Services Quality of Services on Quality of Processes on Quality of Processes Christian Mayerl, Kai Moritz Hüner, Jens-Uwe Gaspar, Christof Momm, Sebastian Abeck Cooperation & Management, Institute of Telematics, Faculty of Computer Science, Universität Karlsruhe (TH) 76128 Karlsruhe, Germany {mayerl | huener | gaspar | momm | abeck}@cm-tm.uka.de
20
Embed
Christian Mayerl, Kai Moritz Hüner, Jens-Uwe Gaspar, Christof Momm, Sebastian Abeck
Definition of Metric Dependencies for Monitoring the Impact of Quality of Services on Quality of Processes. Christian Mayerl, Kai Moritz Hüner, Jens-Uwe Gaspar, Christof Momm, Sebastian Abeck - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Definition of Metric DependenciesDefinition of Metric Dependenciesfor Monitoring the Impact of Quality of Servicesfor Monitoring the Impact of Quality of Services
on Quality of Processeson Quality of Processes
Christian Mayerl, Kai Moritz Hüner, Jens-Uwe Gaspar, Christof Momm, Sebastian Abeck
Cooperation & Management, Institute of Telematics,Faculty of Computer Science, Universität Karlsruhe (TH)
221st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
INTRODUCTION – OverviewINTRODUCTION – Overview
Introduction
Related Work
Metric Dependency Model Elements for modeling metric dependencies Formalism for calculating metric dependencies
Example – Performance Metric Dependencies Dependency model of response time Application of response time metrics
Monitoring Architecture Components processing metric definitions Implementation experiences and evaluation
Conclusion and Outlook
321st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
INTRODUCTION – Scenario and QuestionsINTRODUCTION – Scenario and Questions
Which elements needed to define dependencies between metrics related to processes, invoked services and components implementing
services?
How to define metric dependencies to allow mapping of metric dependency definitions to an monitoring architecture?
ProcessLogic
Service
ApplicationLogic
Component FunctionStudentDBAccess.getCompleteSet
Service OperationStudentDBService.getCompleteSet
Business Process ActivityToRProcess.CollectStudentInformation
functionaldependency
functionaldependency
MetricComponent
MetricService
MetricProcess
related
related
related
metricdependency
metricdependency
421st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
RELATED WORK – OverviewRELATED WORK – Overview
Basics of quality definitions UML Profile for Modeling Quality of Service
basic terminology and structure, no calculable quality dependencies Quality of Web Services
raw and aggregated metrics, no dependencies between services and processes
Metric dependencies Business-driven IT Management (BDIM)
optimize SLOs from business perspective, not monitoring dependencies at runtime Dependencies between service and process metrics
e-business processes based on Web services, no management function to monitor Quality of Service (QoS) and to calculate the impact on Quality of Process (QoP)
Management architectures and applications Common Information Model (CIM) – Metrics Model
metrics related to functional units, no definition of calculable metric dependencies
521st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
RELATED WORK – Common Information Model (CIM) Metrics ModelRELATED WORK – Common Information Model (CIM) Metrics Model
CIM
_StartedU
oW
CIM_UnitOfWorkDefinition
ID : string {key}Context : stringTraceLevelTypeID : string
Modeling of runtime management information Metric dependencies associated with relation CIM_SubUoW between units of work
621st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
METRIC DEPENDENCY MODEL – Assumptions and RequirementsMETRIC DEPENDENCY MODEL – Assumptions and Requirements
Assumptions focus on one process activity and one invoked service operation process implemented with Business Process Execution Language (BPEL) services described with Web Service Description Language (WSDL) services implemented by component-based applications functional dependencies between services and processes are well-known
Requirements provider monitoring Quality of Services (QoS) should be able to estimate
impacts on Quality of Processes (QoP) formal model of metric dependencies needed to be calculated mapping on existing standard management information models
(e. g. Common Information Model, CIM)
721st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
Ap
pli
ca
tio
n L
ay
er
Se
rvic
e L
ay
er
Pro
ce
ss
La
ye
rMETRIC DEPENDENCY MODEL – Metrics and Metric DependenciesMETRIC DEPENDENCY MODEL – Metrics and Metric Dependencies
Metric Dependencies
Component
ComponentFunction
*
**
DependencyFunction
1
*
*
*
MetricCategory
MetricDimension
1..*
*
*
MetricCharacteristic
MetricDefinition
1
UnitOfWorkDefinition1..*
MetricValue
*
UnitOfWork*
*
*
Service
*
*1
Interface InterfaceOperation*
1
*
1..*
*
depends on
depends on
1
1
0..1
0..1
0..1
1
Process
Role
1..2
*PartnerLink
1
*
1InvokeActivity
StructuredActivity
*
BasicActivity1..*
1..*Activity
821st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
METRIC DEPENDENCY MODEL – Formalizing Metric DependenciesMETRIC DEPENDENCY MODEL – Formalizing Metric Dependencies
mQ
mE
e qQuality Value
Metric Value
E Q
Functional Entity
me mq
m m
m m
e E
q Q
:
:m m
m E Q
m e q
0 1 0, , , ,E E nd e e d e e
1 0
1 0
calc
calc 1,1 1, , 0
1,1 ,1 , , 0
:
: , , , ,
, , , , ,
k
k
n
m m m
k n k
n n k n km m m
f Q Q Q
f q q q q
q q Q q q Q q Q
0 0 calc 1 1 1 1 2 2 1, , , , , , , , ,k k n k nm e f m e m e m e m e m e m e
0 1 0, , , ,M M kd m m d m m
921st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
EXAMPLE – PERFORMANCE METRIC DEPENDENCIESEXAMPLE – PERFORMANCE METRIC DEPENDENCIESIntroduced Example ScenarioIntroduced Example Scenario
Process activity invokes a service operation
Service implemented by application component functions
ProcessLogic
Service
ApplicationLogic
Component FunctionStudentDBAccess.getCompleteSet
Service OperationStudentDBService.getCompleteSet
Business Process ActivityToRProcess.CollectStudentInformation
functionaldependency
functionaldependency
1021st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
EXAMPLE – PERFORMANCE METRIC DEPENDENCIESEXAMPLE – PERFORMANCE METRIC DEPENDENCIESMetric Dependency Pattern for PerformanceMetric Dependency Pattern for Performance
Metric dependency patterns based on existing approaches
Pattern applied to specific SOA by assigning concrete architectural elements to each metric
1121st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
EXAMPLE – PERFORMANCE METRIC DEPENDENCIESEXAMPLE – PERFORMANCE METRIC DEPENDENCIESModel for StudentDBService and ToRProcessModel for StudentDBService and ToRProcess
:Process
name = “ToRProcess”:InvokeActivity
name = “LookupStudent”:StructuredActivity
name = “main”
:Service
name = “StudentDBService”
:Interface
name = “IStudentDBService”
:InterfaceOperation
name = “isStudent”
:Component
name = “StudentDBAccess”
:ComponentFunction
name = “getCompleteSet”
:ComponentFunction
name = “isStudent”
:MetricCharacteristic
name = “ResponseTime”
:UnitOfWorkDefinition
name = “isStudentOp”
:MetricDimension
name = “WaitingTime”
:MetricDimension
name = “ProcessingTime”
:UnitOfWorkDefinition
name = “isStudentF”
:MetricCharacteristic
name = “DurationTime”
:MetricCategory
name = “Performance”: UnitOfWorkDefinition
name = “LookupStudent”
: UnitOfWorkDefinition
name = “useNetwork”
:MetricCharacteristic
name = “TransmissionTime”
:DependencyFunction
name = “CalcDurationTime”
:DependencyFunction
name = “CalcResponseTime”
1221st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
EXAMPLE – PERFORMANCE METRIC DEPENDENCIESEXAMPLE – PERFORMANCE METRIC DEPENDENCIESSimple Metric Dependency FunctionSimple Metric Dependency Function
10.000 requests for collecting and aggregating metric values
«device»:AlfiVM01
CourseUnitDBService.aar
ExaminationDBService.aar
OrganizationDBService.aar
StudentDBService.aar
«executionEnvironment»:Axis2webApp
«device»:AlfiVM02
ToRProcess.jar
«executionEnvironment»:OracleBPELengine
courseunitdata
examinationdb
…
«device»:MySQLServer
«device»:AlfiVM03
CIM_UnitOfWork.mof
QoS_ …
…
«executionEnvironment»:CIMMOM
«executionEnvironment»:Axis2webApp
«artifact»AgreementMonitorService.aar
«artifact»AgreementMonitor.jar
«artifact»MetricComparator.jar
«artifact»MetricAggregator.jar
«artifact»ReportGenerator.jar
«artifact»AgreementService.aar
«artifact»AgreementRepository.jar
«artifact»DimensionValueService.aar
«artifact»CIMOMwrapper.jar
«artifact»MetricDependencyMgmtService.aar
«artifact»CIMOMwrapper.jar
1621st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
IMPLEMENTATION EXPERIENCES – IMPLEMENTATION EXPERIENCES – Evaluation of MetricCollector and MetricAggregatorEvaluation of MetricCollector and MetricAggregator
Useful medians 141 milliseconds for MetricCollector 437 milliseconds for MetricAggregator
Metric Collector Metric Aggregator
100
200
300
400
500
600
mill
iseco
nds
1721st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
IMPLEMENTATION EXPERIENCES –IMPLEMENTATION EXPERIENCES –Evaluation of Metric Dependencies Evaluation of Metric Dependencies (Component, Service, Process)
0 200 400 600 800 1000
20
00
30
00
40
00
50
00
60
00
70
00
Mill
ise
kun
de
nm
illi
sec
on
ds
1821st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
1921st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
IMPLEMENTATION EXPERIENCES – IMPLEMENTATION EXPERIENCES – EVALUATIONEVALUATIONCorrelation of Correlation of Measurement DataMeasurement Data
2000 3000 4000 5000 6000 7000
1000
2000
3000
4000
5000
ToR-Service
Die
nst
e
2000 3000 4000 5000 6000 7000
1000
2000
3000
4000
5000
ToR-Service
Kom
ponente
n
1000 2000 3000 4000 5000
1000
2000
3000
4000
5000
Dienste
Kom
ponente
n
Ser
vice
Co
mp
on
ent
Co
mp
on
ent
Service
Process Process
2021st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
CONCLUSION AND OUTLOOKCONCLUSION AND OUTLOOK
Conclusion Modeling metric dependencies between elements of a SOA
Formalism to calculate metric dependencies Example – response time dependencies
Monitoring quality impacts at run time Development of a monitoring architecture Evaluation of monitoring metric dependencies
Outlook Definition of a UML profile to model metric dependencies
Support for development of manageable SOA elements Integrated development of SOA and manageability capabilities
Extensions of the management instrumentations Development of adequate management interfaces Provision of management information for calculating metric dependencies