Workflows Information Flows Prof. Silvia Olabarriaga Dr. Gabriele Pierantoni.

Workflows InformationFlows

Prof. Silvia OlabarriagaDr. Gabriele Pierantoni

Introduction & Motivation

Integration among DCIs, workflow engines, portals and communities defined software

Different user profiles: administrators developers users

Increasing complexity in managing the information flows that connect components and users

Work started during ER-FLOW and SCI-BUS A related paper presented in eScience 2014

Overview

WorkflowInfrastructure

Gateway

Domain Experts

Gateway Experts

WorkflowExperts

DCI

Installation, configuration,

monitoring, troubleshooting

Customized graphical User

Interfaces

Graphical User Interfaces, scripts, workflow design and debugging

Workflow design and debugging

API, development libraries and

frameworks, code debugging

Layers and Information Flows

DCI and External Services (DSI)

Workflow Infrastructure

Portal Infrastructure

API/Commands

API/Commands

GUI

GUI

API/Commands

GUI

Actions

Information

CommunityGateway

The Heliophysics experience

DCI and External Services (DSI)

API/Commands

GUI

Specialized Standalone GUIs for

Specific services

Grids (gLite)& Clusters

Workflow Infrastructure

API/Commands

GUI

Specialized Web Services Interfaces

Workflows and Meta-workflows

TAVERNA GUI to execute jobs

Portal Infrastructure

API/Commands

GUI

WS-PGRADE Easy Interface to rapidly

prototype GUIs

HELIOGate Specialized Interface

WorkflowsWS-Pgrade Metaworkflow

TAVERNA metaworkflow

TAVERNA Worfklows

Execution in WS-Pgrade enabled

portals

Coarse Interoperability

through the SHIWA Platform

Execution on the TAVERNA line command tool

Execution on the TAVERNA line command tool

Solutions and future directions

• Present Solutions: there are different technologies and we cannot re-invent the wheel, so we must use the tools at disposal:• Automatic test procedures triggered before execution to exclude some errors• Automatic test procedures triggered on errors to determine if the

infrastructure run well (does not solve all problems)

• Future Solutions, trying to develop systems at each layer where the various informations flows are tagged and dispatched automatically to the right component/user• Information is expensive: we cannot keep all of it forever.