Information Builders Enterprise Information Management ... · Information Builders Enterprise Information Management Solution ... Facilitates the implementation of mastering templates

Transforming data into business value

1

Information Builders Enterprise Information Management Solution

Fateh NAILIEnterprise Solutions Manager

June 20th, 2017

Agenda

Introduction

Information Builders Solutions

Data Integration

Data Quality

Master Data Management

Roadmap

Summary

Introduction

Enterprise Information Management

We do Enterprise Information Management!

Information Builders helps align, link and leverage people, processes and technology around information assets across the enterprise.

What do we do?

A complete platform

Integration

Write-Back

Data Discovery Reporting Dashboards

High-PerformanceData Store

Data Quality Data Governance

Master DataManagement

Batch ETL

Integrity

Intelligence

Location Analytics

In-DocumentAnalytics

Casting and Archiving

SearchPredictive Analytics

Sentiment and Word Analytics

Performance Management

SocialHot

BadFeedback

Real-Time ESB Hadoop-Based

Natural Language/Narrative BI

ApplicationsLegacy Systems Relational/Cubes Big Data Columnar/In Memory Unstructured Social Media Web Services Trading PartnersIoT

BI Portal Embedded InfoApps™ Mobile

How do we do it?

An optimal implementation approach

Data

Governance

Share

CommunicateAnalyse

PropagateData Distribution

BuildMatch

MergeData Mastering

ImproveStandardise

EnrichData Quality

KnowExplore

ProfileData Analysis

GetConnect

OrchestrateData Integration

Manage

Control

Data Integration

iWay Data Integration SolutionIntroduction

Unique and powerful Integration Platform Real time and Batch Processing Compose, Orchestrate and Automate

complex integration processes Drag and drop interface for pre-built

components Expose processes as reusable

Services (Web Service, REST …) 300+ Pre-Built Integration Adapters

Bi-directional Data, Application, Industry, etc Use any messaging infrastructure

iWay Data Integration Solution

Backbone for all data processingData Quality, Master Data Management, Data Governance, WebFOCUS can all be stacked on top of this real-time data engine for complete data access.

Native XML and JSON processing Automatically transform A2A and B2B messages (IoT)

Complete end-to-end securityauthentication, authorization, encryption

Full API supportGenerate and consume API/REST

Cloud and on-premise

Key Features

iWay Service Manager

iWayRepositories

iWay Web Console

IWay BAM

IWay Sentinel

iWay Service

Designer

IWay Service

Transformer

iWay Application

Explorer

ApplicationServer

BPMApplication

BI Application

Web ServiceApplication

SWIFT Adapter

MySAPAdapter

OracleAdapter

….

iWay Process Flows

Event DrivenReal Time Processing

Web Service

iWay Adapter Framework

CICSAdapter

Mainframe Data, Applications and

Transactions

Applications,ERP, CRM, …

Files, Excel CSV, XML

SWIFT, HIPAA, EDI Formats

Databases, Data Warehouse,

Design Time

Operational Time Run Time

iWay Integration ToolsiWay Operational Tools

Routing Transform Security XA

iWay Data Integration SolutionTools and components

Activity Monitoring

Enhance iWay Data Integration Solutionby monitoring complete components

Provide improved activity visibility Provide detailed message Auditing Provide Alerting Allow user definition metrics

Dashboards, Reports Message Resubmission

Manual Reprocess! Persist monitored activities and events

in database

iWay Data Integration Solution

Data Quality

DQ Rules DQ MonitoringDQ Profiling

Omni-Gen DQ EditionIntroduction

Standalone solution designed to optimize the integrity of informationthroughout the enterprise

Packaged with comprehensive,fully customizable business rulesand a portfolio of libraries

Collaboration

Well defined implementation approach

Data Quality ProfilingAnalyze the quality of the data

Data profiling shows the presence oferrors with Metrics Information

Profiling Features include Patterns/Masking Custom Business Rules Extremes Quantities Frequency Analysis Foreign Key Analysis Localization Charting Grouping/Aggregate Drilldown/Interactive Displays

Most organizations say data quality issues are detected when reported by employees, customers or prospects. Fewer than 50% of companies conduct proactive data audits to discover data quality issues.

Data Quality RulesImplement Data Quality rules

Data Cleansing and Standardization

Data Enrichment

Data Scoring

Internal/external reference data

Matching / Merging Probabilistic and Deterministic Levenshtein distance Golden record

Id column for NamesAlter Format

Remove titlesStrip Titles

Parse NamesGuess Name Surname

Prepare out valuesColumn Assigner

Remove columnsAlter Format

𝒚=𝒇 𝒙

“John”“Smith”

Advanced Profiling

‘Custom’ analysis of data

Defined by user and relevant to data context

Multiple fields can be considered, e.g. Address lines

Complex computation may be required

Output is Binary (true/false) – Data Quality Indicators

Data Quality MonitoringAnalyze data overtime

Operational Dashboard for Data Stewardsand Data Supervisors to investigateand correct data

Provide an ability to do data!

Cleansing, Matching, Merging, Unlinking…

Improved reporting, filtering and searches

Track data quality issues in real time

End-to-end audit trail of all data changes

Workflow interface

Data Quality RemediationManual correction

Extending Data Quality

Avoid dissemination at root (Upstream vs Downstream correction)

Extend the reach of your Data Quality Initiative

Create a firewall protecting your systems from bad data

Data Quality Firewall

Master Data Management

Why Master data Management?

Many silos of data often out-of-sync

Poor data quality affecting BI and reporting

Integration complexity

Point-to-point integration is costly (interfaces, “language”)

Inevitable manual process

Error-prone and inconsistency

No way to audit

No way to rollback changes

Different people involved(Updates “interpreted” by systems experts)

Time and resource consuming

The road to Master Data Management

What are the benefits?The road to Master Data Management

Consistent and comprehensives information across the enterprise:Know your customer, Single view of citizen …

Support data governance and compliance requirements between cross-functional teams

Consolidate and rationalize information from different systems across the enterprise to improve transactional and analytical processes

Enforces data modeling, quality, policies, governance, hierarchical and standardize data across the enterprise

Data of the highest quality to feed into their operational and analytical systems

Omni-Gen MDM EditionProduct View

Omni-Gen

Profiling Integration

Integration Edition

Cleansing

Data Quality Edition

Mastering

Master Data Management Edition

Omni-Gen MDM Edition

Top-down approach centered on business problems

Collaboration between the business and IT

Simplifies data integration and mapping of source systems

Pre-packaged mapping documents

Automates key steps in the MDM process

From data integration to Data Quality processing

Facilitates the implementation of mastering templates and rules

Advanced business user interfaces

Master view, source and instance records for full resolution and 360 °view

Introduction

Omni-Gen MDM EditionOmni Designer

Model driven and multi-domain frameworkto generate the various componentas part of an MDM system

Auto mapping

DQS Plugins

Workflow customization editor

Omni-Gen MDM Edition360 Viewer

360⁰ view of Data Subjects.

Centralised view of all attributes belongingto a mastered record.

View all instance informationand full history.

LifecycleOmni-Gen MDM Edition

Cloud-based systems

Legacy assets

ERP applications

Business partners

Cloud-based systems

Downstream applications

Data warehouses

Business partners

Roadmap

Release 7.0 SP7- Q1 2017

•Service Pack Release

•Customer Issue resolutions

•FTP Updates

•AVRO Enhancements

•MQ/JMS Dynamic Queues

•Oauth Updates

Release 8.0 – Q2 2017

•New L&F Intuitive Design Environment

•Support for themes and visual customization

•New process flow palette & new objects

•Action/Verb approach for process configuration

•Added support for RAML

•Native JSON support and new services

•DB and Queuing Services Upgrades

•Python/JS support as part of process flow

•Support for Tradacoms EDI standard

Release 8.0 SP1 - Q4 2017

•View of the payload across process objects

•Basic and Advance user configuration options

•RAML/Swagger based channels

•API Management Support

•Inherited runtime configurations

•Console monitoring improvements

•SWIFT 2017 support

•HIPAA Updates

iWay Integration - Roadmap 2017

iWay Integration Platform 8.0

Simplicity, Usability & Accessibility at all levels

Automated Deployment and Optimized Maintenance

All-in-one Application Projects supporting Team Work

API Management & Micro-services platform

Product direction

iWay Integration Platform 8.0Summary of New Features – Design Time

Re-architected iWay Integration Tools provides a new Look and Feel for expedited development and enhanced user experience

New Object Palette and new objects such as Console Log & Document provide quick access.More objects introduced with each update simplifying access.

Omni-Gen DQ Edition

31

DQ Workbench - Profiling

Omni-Gen DQ Edition

32

DQ Workbench – Data Grid

iWay Big Data Integrator

33

100% Run “in” Hadoop architecture

Simplifiedinterface

Native Hadoopscript generation

Process mgmt. & governance Simplified easy-to-use interface

to integrate in Hadoop

Marshals Hadoop resources and standards

Takes advantage of performance and resource negotiation

Includes sophisticated process management and governance

Sqo

op

, Flum

e…A

vro, JSO

N…

Traditional applications and data stores

iWay Big Data Integrator

Simplified, modern, native Hadoop integration

Big Data Hadoop

Any distribution, Any data

1. Data Ingestion – Enterprise Data Hub2. ETL / ELT3. Predictive Analytics - RStat

4. Business Intelligence - WebFocus5. Low-cost storage of large data volumes

Summary

Data Governance It’s a process and it’s iterative

Enable the process via technology

Start with Data Integration and grow into MDM

Understand that requirements will change over time

Know that Information Builders can help you

Summary

Thank you

36

Fateh NailiEnterprise Solutions Manager EMEAInformation Builders [email protected]