Knowledge-based Workflow Knowledge-based Workflow System for Grid System for Grid Applications Applications K-Wf Grid consortium, K-Wf Grid consortium, Marian Babik Marian Babik Institute of Informatics, Institute of Informatics, Slovak Academy of Sciences Slovak Academy of Sciences
31
Embed
Knowledge-based Workflow System for Grid Applications K-Wf Grid consortium, Marian Babik Institute of Informatics, Slovak Academy of Sciences.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Knowledge-based Workflow Knowledge-based Workflow System for Grid ApplicationsSystem for Grid Applications
K-Wf Grid consortium,K-Wf Grid consortium,
Marian BabikMarian Babik
Institute of Informatics, Slovak Institute of Informatics, Slovak Academy of SciencesAcademy of Sciences
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
K-Wf Grid ObjectivesK-Wf Grid Objectives
Integrating services into coherent application Integrating services into coherent application scenariosscenarios
Enabling automatic construction and reuse of Enabling automatic construction and reuse of workflows with knowledge gathered during workflows with knowledge gathered during operationoperation
Involving monitoring and knowledge acquisition Involving monitoring and knowledge acquisition services in order to provide added value for end services in order to provide added value for end usersusers
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Knowledge-Workflow GridKnowledge-Workflow Grid
Requirements:Requirements: Composition based on high-level objectives (e.g. Composition based on high-level objectives (e.g.
flood forecasting for Bratislava tomorrow)flood forecasting for Bratislava tomorrow) Automated discovery, composition and invocation of Automated discovery, composition and invocation of
heterogeneous servicesheterogeneous services Technology for merging heterogeneous meta-data about Technology for merging heterogeneous meta-data about
services is neededservices is needed Complex service descriptionsComplex service descriptions
Automated selection between different service Automated selection between different service providers of the same serviceproviders of the same service
Quality of service and service provider meta-dataQuality of service and service provider meta-data Support for end-user interactions (manipulating Support for end-user interactions (manipulating
Easier, more intuitiveEasier, more intuitive Limited expressivenessLimited expressiveness
High-Level Petri Nets – GWorkflowDLHigh-Level Petri Nets – GWorkflowDL Implicit parallelism, possibility to analyze workflowsImplicit parallelism, possibility to analyze workflows
Abstract/Concrete WorkflowAbstract/Concrete Workflow Composition done by backward-chaining WS operationsComposition done by backward-chaining WS operations
x
y
r
r = WSOperation(x,y)
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Workflow (2)Workflow (2)
Web Service ClassesWeb Service Classes
Web Service OperationsWeb Service Operations
Abstract OperationAbstract Operation
Grid ResourcesGrid Resources
User RequestUser Request““I want this data””
““There is my data!””
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
KnowledgeKnowledge
Semantic Web technologySemantic Web technology Ontologies (OWL)Ontologies (OWL)
Services (OWL-S)Services (OWL-S) Semantic Web/Grid Service Semantic Web/Grid Service
descriptions (OWL-S)descriptions (OWL-S)
ServiceProfile
AtomicProcess
ServiceGrounding
Service
presents
describedBy
supports
hasProcess
hasProfile
hasGrounding
Semantic description of WSOperation
StateName
AnyService
CapitalCityPopulation
StateName
Capital Name
CapitalName StateCapitalService(StateName)
Population
CityName CityPopulService(Population)
CityPopulation
CapitalCityPopulation
CityName
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Knowledge (2)Knowledge (2)
Knowledge Repository (Grid Organizational Knowledge Repository (Grid Organizational Memory)Memory) Distributed knowledge repositoryDistributed knowledge repository Service indexService index RDQL, SPARQLRDQL, SPARQL User Interface through ProtégéUser Interface through Protégé
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
KAA – WS and Workflow AnalysisKAA – WS and Workflow Analysis::AchievementsAchievements
Workflow Analysis and Workflow Analysis and RecommendationRecommendation Workflow historyWorkflow history Matching workflows for a Matching workflows for a
given problemgiven problem Workflow recommendationWorkflow recommendation
Translation of WSDL to Translation of WSDL to OWL-S (wsrf2owl-s tool)OWL-S (wsrf2owl-s tool)
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Knowledge (3)Knowledge (3)
Collaboration among UsersCollaboration among Users Knowledge Sharing and RecommendationKnowledge Sharing and Recommendation User Problem SpecificationUser Problem Specification
Representation of Experience or KnowledgeRepresentation of Experience or Knowledge Text NotesText Notes
Current workCurrent work:: Experience (Knowledge) ManagementExperience (Knowledge) Management Knowledge, Semantic, OntologiesKnowledge, Semantic, Ontologies Text Processing & Semantic AnnotationText Processing & Semantic Annotation User InteractionUser Interaction Knowledge Relevance, Problem DetectionKnowledge Relevance, Problem Detection
Works with any Domain Works with any Domain OntologyOntology
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Monitoring and Analysis:Monitoring and Analysis:Performance Analysis and Visualization Performance Analysis and Visualization
Basic dependability analysisBasic dependability analysis New performance visualization New performance visualization
of workflowsof workflows Rule-based performance analysis Rule-based performance analysis
Overhead classification Overhead classification Specification of performance problemsSpecification of performance problems DeterminDetermininging the severity of performance metrics for workflow the severity of performance metrics for workflow
activities during runtimeactivities during runtime ApplyApplyinging rules to raise rules to raise an an alarm when condition performance alarm when condition performance
problem problem conditions are encounteredconditions are encountered..
Publications: Peter Brunner, Hong-Linh Truong, Performance Monitoring and Visualization of Scientific Grid Workflows
in ASKALON, April 2006. Submitted. Francesco Nerieri, Radu Prodan, Thomas Fahringer: Kalipy: a tool for online analysis of Grid workflows
through Event Correlation, May 2006. Submitted. Francesco Nerieri, Radu Prodan, Hong-Linh Truong: Performance Analysis of Grid Workflow Applications,
May 2006. Submitted.
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
GWorkflowDL, GWESGWorkflowDL, GWES http://www.gridworkflow.orghttp://www.gridworkflow.org Andreas Hoheisel, et.al.: A Grid Andreas Hoheisel, et.al.: A Grid
Workflow Language Using High-Workflow Language Using High-Level Petri Nets,Level Petri Nets,
based Grid Workflow based Grid Workflow Composition, In: Proc. of 6-th Intl. Composition, In: Proc. of 6-th Intl. Conf. on Parallel Processing and Conf. on Parallel Processing and Applied Mathematics PPAM'2005 Applied Mathematics PPAM'2005
Pieczykolan, J., Majewska, M., Pieczykolan, J., Majewska, M., Slota, R., Babik, M., Toth, A., Slota, R., Babik, M., Toth, A., Kitowski, J., Hluchy, L.: Grid Kitowski, J., Hluchy, L.: Grid Organizational Memory - Organizational Memory - Semantic Framework for Semantic Framework for Metadata Management in the Metadata Management in the Grid, CGW 2006Grid, CGW 2006
Monitoring and AnalysisMonitoring and Analysis Peter Brunner, Hong-Linh Truong, Peter Brunner, Hong-Linh Truong,
Performance Monitoring and Performance Monitoring and Visualization of Scientific Grid Visualization of Scientific Grid Workflows in ASKALON, April Workflows in ASKALON, April 20062006
WSRF2OWL-S ImplementationWSRF2OWL-S Implementation Marian Babik, Marian Babik,
Laclavik M., et.al. : Ontology Laclavik M., et.al. : Ontology based Text Annotation OnTeAbased Text Annotation OnTeA.. In: In: Proc. of 16-th European-Proc. of 16-th European-Japanese Conf. on Information Japanese Conf. on Information Modelling and Knowledge Bases, Modelling and Knowledge Bases, EJC'2006EJC'2006
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
WorkflowsWorkflows
Workflows based on the Petri netsWorkflows based on the Petri nets GWorkflowDLGWorkflowDL
http://www.gridworkflow.orghttp://www.gridworkflow.org Martin Alt, Sergei Gorlatch, Andreas Hoheisel and Hans-Werner Martin Alt, Sergei Gorlatch, Andreas Hoheisel and Hans-Werner
Pohl. A Grid Workflow Language Using High-Level Petri Nets. Pohl. A Grid Workflow Language Using High-Level Petri Nets. In Second Grid Resource Management Workshop, Poznan, In Second Grid Resource Management Workshop, Poznan, Poland, September 2005.Poland, September 2005.
Workflow composition done by backward-chaining OWL-S Workflow composition done by backward-chaining OWL-S IOPEsIOPEs Tomasz Gubala, Marian Bubak, Maciej Malawski, Katarzyna Tomasz Gubala, Marian Bubak, Maciej Malawski, Katarzyna
Rycerz. Semantic-based Grid Workflow Composition, In: Proc. Rycerz. Semantic-based Grid Workflow Composition, In: Proc. of 6-th Intl. Conf. on Parallel Processing and Applied of 6-th Intl. Conf. on Parallel Processing and Applied Mathematics PPAM'2005Mathematics PPAM'2005
AnnotationAnnotation Laclavik M., et.al. : Laclavik M., et.al. : Ontology based Text Annotation Ontology based Text Annotation OnTeAOnTeA.. In: In:
Proc. of 16-th European-Japanese Conf. on Information Proc. of 16-th European-Japanese Conf. on Information Modelling and Knowledge Bases, EJC'2006, Modelling and Knowledge Bases, EJC'2006,
Non-functional propertiesNon-functional properties Semi-structured information Semi-structured information
intended for human usersintended for human users ServiceNameServiceName ServiceDescriptionServiceDescription ServiceParameter e.g. quality ServiceParameter e.g. quality
of service, security, of service, security, geographical scopegeographical scope
Resource
ServiceProfile
ServiceProcess
ServiceGrounding
Serviceprovides
presents
describedBy
supports
hasProcess
hasProfile
AtomicProcess
CompositeProcess
hasGrounding
realizedBy
realizes
expands
expandedBy
OWL-S GroundingOWL-S Grounding abstract concepts of OWL-abstract concepts of OWL-
S Profile to concrete S Profile to concrete WSDL messages WSDL messages
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Semantic Web ServicesSemantic Web Services
Create ontology with domain concepts (watershed, Create ontology with domain concepts (watershed, geographical location, etc.)geographical location, etc.)
Map these concepts to the inputs, outputs, Map these concepts to the inputs, outputs, precondition and effects of Service Profile precondition and effects of Service Profile
During composition determine the “equivalence” of During composition determine the “equivalence” of conceptsconcepts
ServiceProfile
AtomicProcess
ServiceGrounding
Service
presents
describedBy
supports
hasProcess
hasProfile
hasGrounding
Semantic description of WSOperation
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
IssuesIssues
Service discovery issues:Service discovery issues: Resource properties can be dynamicResource properties can be dynamic Resource properties inheritanceResource properties inheritance Explicit inputs/outputs hiding Explicit inputs/outputs hiding
Service invocation issues:Service invocation issues: EPR of the WS-ResourceEPR of the WS-Resource Multiple providersMultiple providers
Service annotationService annotation based on extending WSDL (similar to WSDL-S)based on extending WSDL (similar to WSDL-S) Case-based reasoning (text notes)Case-based reasoning (text notes)
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Mapping concepts to IOPEsMapping concepts to IOPEs
WSRF2OWL-SWSRF2OWL-S OWL-S 1.1 supportOWL-S 1.1 support WSRF Services support (WSDL)WSRF Services support (WSDL) Configuration supports inputs/outputs/precondition/effectsConfiguration supports inputs/outputs/precondition/effects Sample configuration and corresponding OWL-S descriptions Sample configuration and corresponding OWL-S descriptions
for the Flood-Forecasting pilot applicationfor the Flood-Forecasting pilot application Automatic parsing of the WSDL and generation of the WSDL Automatic parsing of the WSDL and generation of the WSDL
part of the configurationpart of the configuration Generating configuration based on annotations (ongoing)Generating configuration based on annotations (ongoing) graphic user interface via GridSphere portletgraphic user interface via GridSphere portlet
Other implementationsOther implementations CMU’s WSDL2OWL-sCMU’s WSDL2OWL-s MINDSWAP’s WSDL2OWL-S (part of OWL-S API)MINDSWAP’s WSDL2OWL-S (part of OWL-S API)
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
ArchitectureArchitecture
OWL-S API WSDL APIs GT4 WS-CORE
WSRF2OWL-S Translator
GOMOWL-API
Extension Converters
OWL-S Extensions
Vocabulary
Configuration parser
WSRF2OWL-S Engine
Jena API
WSRF Resource Properties Parser
WSRF2OWL-S API
GridSphere portlet
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Knowledge RepositoryKnowledge Repository
Grid Organizational Memory (GOM)Grid Organizational Memory (GOM) Distributed knowledge repositoryDistributed knowledge repository Service repositoryService repository RDQL, SPARQLRDQL, SPARQL Integrated into ProtégéIntegrated into Protégé
Kryza, B., Pieczykolan, J., Majewska, M., Slota, R., Kryza, B., Pieczykolan, J., Majewska, M., Slota, R., Babik, M., Toth, A., Kitowski, J., Hluchy, L.: Grid Babik, M., Toth, A., Kitowski, J., Hluchy, L.: Grid Organizational Memory - Semantic Framework for Organizational Memory - Semantic Framework for Metadata Management in the Grid, to appear, In Metadata Management in the Grid, to appear, In Proceedings of the Cracow Grid Workshop 2006, Proceedings of the Cracow Grid Workshop 2006, Academic Computer Centre CYFRONET AGHAcademic Computer Centre CYFRONET AGH
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Enabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, GeneveEnabling Grid for E-SciencE (EGEE), 25-29. Sept. 2006, Geneve
Workflows (2)Workflows (2)
Abstract/Concrete workflowAbstract/Concrete workflow Description of workflow on non-executable levelDescription of workflow on non-executable level Binding to service providersBinding to service providers
Basic element of workflowBasic element of workflow WS operationWS operation
Composition done by backward-chaining WS Composition done by backward-chaining WS operationsoperations