SIMPDA 2011 - Business opportunities in applying Process Mining to operational and management enterprise processes

www.spagoworld.org

Business opportunities in applying Process Miningto operational and management enterprise processes

The point of view of a Systems Integrator

Antonio Majori, Stefano ScamuzzoResearch & Innovation Division

Engineering [email protected] [email protected]

www.spagoworld.org

� Introduction to Engineering Group

� Process mining goals & prospective

� Process mining & integration middleware

� Process mining & Intelligence

� Use Cases

� Conclusion

www.spagoworld.org

Engineering Group

The leading Italian independent privately-owned softwar e and Information Technologyservices company, in the top 10 European software and services provider list.A complete and integrated offering: software develop ment, systems integration, consultancy, outsourcing, proprietary and open sourc e products.

Brazil

Benelux

ItalyArgentina

Lebanon

40 BRANCHES IN ITALY, BENELUX, LATIN AMERICA AND TH E MENA AREA1,000 LARGE ACCOUNTS IN ALL MARKET SECTOR758.6 M€ REVENUE (2010)

www.spagoworld.org

Engineering Group and Innovation

Production environments aimed at continuous innovat ion, flexible approach, knowledge of vertical business models, cross-market technologica l expertise in best brand and

proprietary solutions, sustained by the training-re search-innovation virtuous circle.

6.500 IT SPECIALISTS

400 R&I SPECIALISTS

System Integration& Consultancy

Managedoperations

Solutions

Research

Ent

erpr

ise

Res

ourc

eP

lann

ing

Geo

grap

hic

Info

rmat

ion

Sys

tem

Ent

erpr

ise

Con

tent

Man

agem

ent

Bro

adba

nd M

edia

Ser

vice

s

Aut

omat

ion

and

Con

trol

s

Ope

n S

ourc

e an

d B

usin

ess

Inte

llige

nce

Innovation

Training

PA

an

d H

ealt

hca

re

Fin

ance

Ind

ust

ry

Uti

lity

Tel

co

www.spagoworld.org

Engineering Group and Industrial Open Source

The java enterprise framework for the development of web and multichannel

applications in SOA environments

The only entirely open source, innovative and flexible business

intelligence suite

The open source platform to measure, analyze and monitor the quality ofproduct, procersses and services

The open source platform for the governance of middleware services and

the development of SOA/BPM applications

www.spagoworld.org

eclipse Business ProcessManagement

extended Business ActivityMonitoring

SpagoBI, Spagic, Spago4Q and Spago are hosted by the forge of:

eBPM and eBAM are hosted by the forge of:

www.spagoworld.org

Goals and proposals

� To enrich open source platforms providing them with functionalities that

support a process-based approach

� To support As Is analysis activities

� To support the usage of mining techniques on existing information

� To provide simulation solutions in the context of process refactoring

� To manage the separation between Operational and Intelligence data ,

making easier the adoption of intelligence services in projects

www.spagoworld.org

SOA Universal Middleware / context

Low

High

High

Business-LedProjects

ProcessProjects

IT-LedProjects

EnterpriseProjects

Bu

sin

ess

spo

nso

rsh

ip

SOA Complexity

DriversDrivers

� Unified Information with SOA

� Designing your own information system, starting from strategic planning

� Unified Information with SOA

� Designing your own information system, starting from strategic planning

www.spagoworld.org

From information silos to Universal Middleware

Financial

Booking

CR

M

Manufacturing

……

..

Information systems are unable to properly manage interactions with the related information systems.

Information Silos

SOA Enterprise Service Bus

The Integration Bus facilitates relationships between systems, but …it’s still an organization made of separated units and we are lacking:� unified information� collaboration� definition of a strategic plan.

Unified logical application with user’s views on services organized

by rules, processes and compositions

Fin

anc.

CR

M

…

www.spagoworld.org

Architectural Framework

We need an architectural framework to support new projects in a collaborative components development model through a process-based design where services work in synergy on information that is unique, consistent and shared.

We need an architectural framework to support new projects in a collaborative components development model through a process-based design where services work in synergy on information that is unique, consistent and shared.

Requirements ?

New components ? Reuse ?

Where is the information ?

New Platform

Components deploy on infrastructural nodes

Monitoring & Management

� Unified Information

� Standard

� Methodologies

� Application services� Infrastructure services

� Connectors� Process diagrams

Due to time constraints, related to various organisation rules and opportunities, a new service is carried out in two phases: integrating existing systems; re-engineering processes and the business logic.

Due to time constraints, related to various organisation rules and opportunities, a new service is carried out in two phases: integrating existing systems; re-engineering processes and the business logic.

www.spagoworld.org

Platform & Process Mining

Inte

grat

.m

odul

esP

roce

ss&

Rul

es

Front-end modules

Back-end modules

Middleware Services manager

Unified Information

WS

/SO

AP

DB

MS

JMS

DO

C

….

External systems (application, DBMS, middleware, ..)

� Analysis – discoveryfrom legacy log of user activity, services and process

� Runtime – conformanceverify a new process model

� Refactoring – extensiontest the possible extensions to the processes.

Process Mining Universal Middleware

www.spagoworld.org

Planning & Process Mining

� As-Is Activity Analysis

� To-Be Activity Analysis

� Develop the first release

� Define/develop new extensions in order to substitute some external systems.

Process Mining techniques can be adopted throughout the whole project life cycle:

www.spagoworld.org

Governance & Project team organization

User InterfaceUser Interface Processes & RulesProcesses & Rules ComponentsComponents

Architect/DeveloperArchitect/Developer AnalystAnalyst Architect/DeveloperArchitect/Developer

Design User InterfaceDesign User Interface

Search widgeton catalog

Search widgeton catalog

Develop Ajax UIDevelop Ajax UI

Develop User Business Logic UI

Develop User Business Logic UI

Develop User Business Logic UI

Develop User Business Logic UI

Publishingon CatalogPublishingon Catalog

Proxy ConfigurationProxy Configuration

Application warApplication war

Rules(rules engine)

Rules(rules engine)

Design new componentsDesign new components

Search componentson catalog

Search componentson catalog

Develop componentsDevelop components

Complete BPMN(technical information)

Complete BPMN(technical information)

BPM Process(BPMN)

BPM Process(BPMN)

Publishingon CatalogPublishingon Catalog

PublicationconfigurationPublication

configuration

DiscoveryDiscoveryDiscovery

ExtensionExtensionExtension

ConformanceConformanceConformance

www.spagoworld.org

Spagic: open source SOA Universal Middleware

Business

Business Modelin

g

Modeling and M

anagement

and Management

Integration

Integration//Cooperation

Cooperation Middleware

Middleware

eFormeFormLifecycleLifecycle

BPMBPMmodelingmodeling

Business RulesBusiness Rulesmanagementmanagement

Process & Process & Service Service

managementmanagement

Business Business Activity Activity

monitoringmonitoring

Go

vern

ance

Go

vern

ance

SOA SOA Application Application

(Web(Web--Mobile)Mobile)

Integration Integration ESBESB

Cooperation Cooperation ConnectorsConnectors

BPM/ETL BPM/ETL EngineEngine

www.spagoworld.org

Spagic & Process Mining

www.spagoworld.org

Use case: tree years for the new ERP / As IS

� Unrelated application silos: each area contains multiple unrelated applications.� Non-homogeneous technologies (Java, Access, Cobol, ..).

� Organizational processes relying on individual relations (e.g. telephone

calls) where data exchange can not be controlled (e.g. MS-excel and manual entry).� Information is fragmented and often duplicated in different systems.

� Governance on systems and not on processes; therefore lack of SLA.

� Difficult professional growth of the corporate staff.

� Unrelated application silos: each area contains multiple unrelated applications.� Non-homogeneous technologies (Java, Access, Cobol, ..).

� Organizational processes relying on individual relations (e.g. telephone

calls) where data exchange can not be controlled (e.g. MS-excel and manual entry).� Information is fragmented and often duplicated in different systems.

� Governance on systems and not on processes; therefore lack of SLA.

� Difficult professional growth of the corporate staff.

Accounting Suppliers

HRDW

ResourcesBack-office(Legacy)

CRM

Portals

IDM(security)

CounterServices

www.spagoworld.org

Use case / To Be

MiddlewareMiddleware ServicesServices

ManagementMonitoring

BPM

Back office DashboardBack office Dashboard

Front End modules

Service Manager

Integration BUS

UserComponent

BusinessComponents

Interf. Interf. Interf.

Connect. Connect. Connect.

RULESEngine

ETL DOCUM. IDMIDM

FrontFront--officeoffice DashboardDashboard

Front End modules

Service Manager

Integration BUS

Interf. Interf. Interf.

Connect. Connect. Connect.

Ext

ern

alE

xter

nal

Sys

tem

sS

yste

ms

BusinessComponents

UserComponent

UserComponent

UserComponent

BusinessComponents

BusinessComponents

Registry

Ext

ern

alE

xter

nal

Sys

tem

sS

yste

ms

No more silos : two dashboards for all services supported by an integration bus(ESB) and defined by processes and rules. Governance on a single monitoring environment.

www.spagoworld.org

Use Case / Solution with Process Mining

� Organizational processes designed through the ARIS modeler

As IS pre analysis

To Be analysis

Detail Process(ARIS)

BPMgeneration

Extraction of Knowledge

ProM

SpagicBPM

Mining

ExecutionProcess log

Functional &TechnicalAnalysis

BusinessComponent

TransactionLog

Tuning & Refactory

www.spagoworld.org

Business Intelligence / context

Traditional BI is overNew data sources

The growing importance of time and space

The need to discover information in data

www.spagoworld.org

Business Intelligence / emerging requests

Real Time Business Intelligence

Business Activity Monitoring

Business Performance Management

www.spagoworld.org

Business Intelligence / real time

Process Mining emerges as a crucial techniqueto discover hidden information

… is not analyzing all your operational data …

… is not loading all your operational data intothe Data Warehouse aside historical ones …

IT’S ABOUT DETECTING RELEVANT EVENTS

ComplexEventProcessing

www.spagoworld.org

Business Intelligence / open source

www.spagoworld.org

Business Intelligence / PM in SpagoBI

Extract unknown or hidden information from process data in some structured form, such as events and logs

Detecting inconsistencies between process models and process instances

Gathering hidden information that suggests the creationof new process models

www.spagoworld.org

Business Intelligence / an example

On-line reservation systems for healthcare systems, through the single point of contact, named CUP

The goal is to monitor the quality of health information systems for citizens

www.spagoworld.org

Business Intelligence / how RT and BAM work

Complex

Event Processing

Engine

• Integrated with BPM– Start/stop of processes

• Interacting with monitored objects

Data Source

Events

Database

Real TimeConsole Other SpagoBI

Engines

REAL TIME

HISTORICAL ANALYSIS

www.spagoworld.org

Business Intelligence / an example

www.spagoworld.org

Conclusion

OperationalEnvironmentOperationalEnvironment

IntelligenceEnvironmentIntelligence

Environment

Process Mining

Process Mining

Design

Process Mining can be the bridge between operational and intelligence environments in enterprise projects where the design activity crosses all domains and departments: analysis and refactoring

www.spagoworld.org

Questions and Answers