IMS08 the momentum driving the ims future

*

The momentum driving the IMS future

Kyle Charlet

Distinguished Engineer

IMS Architect: cloud, mobile, analytics

© 2015 IBM

Corporation

© 2015 IBM

Corporation

IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of other IBM trademarks is available on the web at http://www.ibm.com/legal/copytrade.shtml Other company, product, or service names may be trademarks or service marks of others. THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE. IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, NOR SHALL HAVE THE EFFECT OF, CREATING ANY WARRANTIES OR REPRESENTATIONS FROM IBM (OR ITS SUPPLIERS OR LICENSORS), OR ALTERING THE TERMS AND CONDITIONS OF ANY AGREEMENT OR LICENSE GOVERNING THE USE OF IBM PRODUCTS OR SOFTWARE. © Copyright International Business Machines Corporation 2015. All rights reserved.

Trademarks, copyrights, disclaimers

© 2015 IBM

Corporation

IMS product investment

Continue to deliver the IMS value proposition

– Minimize cost per transaction

– Superior reliability, availability

and serviceability (RAS)

Core capabilities – Reduce path length, contention,

I/O…

– Reduce unplanned outages

– New pricing models

Big Data & Analytics – Accelerate time to insight

Cloud/Mobile – Rapidly enable/control cloud &

mobile access to IMS resources

Leverage and extend the

value of your IMS

investment

Expand and empower the

IMS talent population

Open interfaces & Java

Modern tooling for

administrators, developers

and DBAs

Strategic Intent Investment

© 2015 IBM

Corporation

Analytics

© 2015 IBM

Corporation

IMS and Analytics

Solution

Cognos 10.2 BI

IBM InfoSphere

BigInsights

IBM DB2

Analytics

Accelerator

IBM Watson

Explorer

Use case

BI, dashboarding,

reporting of IMS data

Merge HDFS data with

trusted OLTP

IT analytics (log data)

Bring analytics to the

data

Visualize entire big

data landscape

© 2015 IBM

Corporation

Solution

SPSS

Operational

Decision Manager

Use case

Predictive analytics

Decision management

Fraud detection

IMS and Analytics

© 2015 IBM

Corporation

The hybrid computing

platform on zEnterprise

System z

analytics

workload

DB2 Analytics Accelerator and DB2 for z/OS

A self-managing, hybrid workload-optimized database management system that runs each query workload in the most efficient way, so that each query is executed in its optimal

environment for greatest performance and cost efficiency

Supports transaction

processing and analytics

workloads concurrently,

efficiently and cost-

effectively

Delivers industry leading

performance for mixed

workloads

Metadata

Data

IBM zEnterprise and DB2 Analytics Accelerator

© 2015 IBM

Corporation

Make better decisions faster

Better understand your customers

Trust your data

Large volume reporting of combined IMS and

DB2 assets

Leverage full breadth of transactional data for

analytics

Ensure consistency of data relationships

between IMS and DB2

IDAA use cases with IMS data

Get Started Today!

Technical Whitepaper and “how-

to” guide available here

© 2015 IBM

Corporation

© 2015 IBM

Corporation

IDAA futures

Incremental update broadens the available use cases

for IMS and IDAA acceleration

Today change data capture can be used to perform

incremental update from IMS to DB2 – And onwards to IDAA

• Data is duplicated in DB2

– Challenge: can this approach keep up with OLTP speeds?

– Accelerator only tables (potential future functionality in IDAA) can proxy DB2

updates to IDAA

• Concern still exists over OLTP speeds using this approach

Investigating change data capture directly from IMS to

IDAA – No data is duplicated in DB2

© 2015 IBM

Corporation

DB2 for z/OS

Accelerator

Only Tables

IBM DB2 Analytics

Accelerator

Accelerator

Tables

DB2 Base Tables

DB2 Logs DB2 Image

Copies

DB2 Load

Files

IBM DB2 Analytics

Accelerator Loader

for z/OS

Use Cases • Loads DB2 data to IDAA

• DB2 Image Copies, DB2 Logs, and DB2 Load Files

• Customer responsible for building DB2 Load Files

• Consolidate DB2 data from many systems to a single IDAA (or DB2)

• Load a related set of DB2 data to IDAA with no affect to production data

• Easily load DB2 Image Copy data across systems

• Historical loading of DB2 data for month-end, year-end analysis

Existing: IBM DB2 Analytics Accelerator Loader for z/OS

© 2015 IBM

Corporation

DB2 for z/OS

DB2 Logs DB2 Image

Copies

DB2 Load

Files VSAM

Other

non-

relational

IMS DB

Accelerator

Only Tables

IBM DB2 Analytics

Accelerator

Accelerator

Tables

DB2 for

z/OS

DB2 Base

Tables

IBM DB2 Analytics Accelerator Loader for z/OS Enterprise Edition

(Superset of existing Accelerator Loader function)

Intended: IBM DB2 Analytics Accelerator Loader for z/OS

Enterprise Edition

(Future)

DRDA and

Federated

• Load DB2 data and Non-DB2 data directly to IDAA

• Easy consolidation of enterprise data on secure z platform

• Exploit Accelerator to join DB2 non-DB2 data

• New analytic workload on DB2 for z/OS

• Trending, Fraud detection, Capacity Planning, etc.

• Analytics of SMF data, DB2/IMS performance data, etc.

Use Cases

© 2015 IBM

Corporation

Cognos 10.2 BI with IMS Data

Certified against IMS 12 using IMS Open Database technology

Universal JDBC driver

Real-time analytics

Get Started Today!

developerWorks article available

here

© 2015 IBM

Corporation

Much of the world’s operational data resides on z/OS

Unstructured data sources are growing fast

There is a need to merge this data with trusted OLTP data from System z data sources

IMS provides the connectors and the DB capability to allow BigInsights v2.1.2.0 to easily and efficiently access the IMS data source

Enhancing IMS analytics on z with Big Data

© 2015 IBM

Corporation

IBM InfoSphere BigInsights on System z

IBM InfoSphere System z Connector for Hadoop

Leverage the power of

Hadoop on the

mainframe

Drag-and-drop extracts

from mainframe sources

Protect sensitive data

Faster application

delivery

Seamless

interoperability

All "z" deployment for maximum security

© 2015 IBM

Corporation

IBM InfoSphere Data Replication Family

Non-intrusive Changed Data

Capture and Delivery – Log-based capture minimizes impact

on source application environment

– Dramatically reduces volume of data …

only the changes not the entire source

– Continuous or Periodic delivery with

configurable switch of HDFS target

– One model for z/OS and distributed

data (DB2 on all platforms, IMS, Oracle, …)

– No need to take sources "off line"

– Fully recoverable

– Native HDFS Apply

NOT for system/application logs and other sequential sources

…

These are always full file transfers!

Expand z/OS data integration with changed data ONLY feeds

System z

CP(s)

z/OS

IFL IFL IFL …

z/VM

SM

F

Linux for System z

BigInsights

Hbase,

Hive

MapReduce

DB2

VSAM

IMS

Logs

Data

log

s

InfoSphere Data

Replication

Deliver only the Changes

© 2015 IBM

Corporation

Watson Explorer - visualization and discovery across all data sources: “Integration at the glass”

Create unified view of ALL information for real-time monitoring

Identify areas of information risk & ensure data

compliance

Analyze customer information & data to unlock true

customer value

Increase productivity & leverage past work

increasing speed to market

Improve customer service & reduce

call times

Watson

Explorer Providing unified, real-time access and fusion of big

data unlocks greater insight and ROI

Securely connect to and leverage data stored in DB2 for

z/OS & IMS

Help prioritize your System z big data

integration and analytics projects

© 2015 IBM

Corporation

Catalog

© 2015 IBM

Corporation

Dynamic IMS datastore powered by IMS catalog (intended direction)

• Foundational component that offers dynamic capabilities for

IMS database

• New IMS operational database in moments

• Focus on the “horizontal DBA”

• Standard DDL interface for schema change

• Operational scalability for cloud solution deployments

PSBLIB

Catalog IMS Explorer DDL

ACBLIB

DBDLIB

PSB

source

DBD

source

IMS

Optional – no longer used by IMS

© 2015 IBM

Corporation

Dynamic IMS datastore powered by IMS catalog (intended direction)

• Foundational component that offers dynamic capabilities for

IMS database

• New IMS operational database in moments

• Focus on the “horizontal DBA”

• Standard DDL interface for schema change

• Operational scalability for cloud solution deployments

PSBLIB

Catalog IMS Explorer DDL

ACBLIB

DBDLIB

PSB

source

DBD

source

IMS

Optional – no longer used by IMS

© 2015 IBM

Corporation

© 2015 IBM

Corporation

IMS and DDL – moving towards a dynamic database

Simplifies the process of adding a new Database resource – Without DDL:

1. Define your database characteristics (DBD) 2. Compile/link database definitions (DBDGEN) 3. Define your program specifications (PSB) 4. Compile/link your program specifications (PSBGEN) 5. Perform ACBGEN 6. Allocate database data sets 7. Define DBRC definitions 8. Define IMS database for dynamic allocation (MDA) 9. Bring online all IMS application-related definitions (OLC) 10.Start IMS Databases 11.Load and initialize IMS databases 12.DBRC processing (DBRC IC)

– With DDL:

1. Define your database characteristics (DDL) 2. Submit your DDL

© 2015 IBM

Corporation

© 2015 IBM

Corporation

Standard DDL syntax

IMS will support the standard DDL syntax for CREATE, ALTER and DROP of Databases

and Tables

– Goal: To be able to consume DDL generated without IMS affinity

© 2015 IBM

Corporation

© 2015 IBM

Corporation

What about IMS specific parameters in DDL?

The DDL standard does not contain all of the options that

existing in the GEN macros as it is not IMS specific – e.g., DB Access Types: PHIDAM, HIDAM, PHDAM, etc.

IMS will provide defaults through a template that is stored in

the IMS catalog

The template will be developed based on IMS

recommended defaults but will be modifiable by the

customer – The recommended defaults can be seen in the syntax train tracks

© 2015 IBM

Corporation

Identity Propagation

© 2015 IBM

Corporation

As-is

System z

z/OS

WebSphere Application

Server

IMS

RACF user-ID

Audit Record Audit

SMF

User enters login

credentials:

CN=Mary,OU=SVL.O=IBM

Audit records do not

show who the end user

is; accountability has

been lost.

LDAP Server

RACF

ldaps://us.svl.ibm.com

RACF user-ID selected

© 2015 IBM

Corporation

With z/OS V1.11, RACF introduced a set of constructs

and services which allow:

–The mapping of distributed user identities and

domains into RACF z/OS user IDs • Mapping based on user identity and domain name

• Supports both one-to-one mapping and many-to-one

–The recording of the distributed user’s identity in RACF log records

z/OS Identity Propagation

© 2015 IBM

Corporation

WebSphere Application

Server

IMS

RACF user-ID

DN & Domain

Audit Record Audit

SMF

User’s

Identity

• DN & Domain

DN & Domain

‘propagated’ into z/OS

security context.

User’s Identity • RACF user-ID

• DN & Domain

RACF

running

remotely or

on System z

z/OS

Potential to-be

z/OS Run-time

security context System z

New data area

(ICRX) to hold

distributed identity

information

© 2015 IBM

Corporation

Dependent region

scalability

© 2015 IBM

Corporation

© 2015 IBM

Corporation

Evolution of IMS programming model

IMS intends to transition from a serial schedule model to one that supports parallel schedule for Java workload

For Java this means we can move from a single threaded model to one that can potentially support up to 255 concurrent threads

Value – Dramatic reduction in the number of JVMs to manage (e.g.; 8000 down to 31) – Significant reduction in resources needed to run Java at an enterprise level in IMS – No longer facing region occupancy issues – Foundation for the transition to a multi-tenant environment

Control region

Dependent region

JVM

App

Control region

Dependent region

JVM

Thread/App

© 2015 IBM

Corporation

WebSphere Liberty

© 2015 IBM

Corporation

WebSphere Liberty

Liberty is a lightweight, composable profile of WebSphere

Application Server

...this is Liberty (WAS) ...so is this ...or even this!

If this is WAS...

© 2015 IBM

Corporation

© 2015 IBM

Corporation

Target Market – IMS TM and DB customers

Challenge Addressed – IMS does not offer integrated web and EJB programming, including

REST

Solution Statement – Introduce a reduced footprint, fully integrated web container in IMS – Enterprise (EJB) container to follow

Business Value – Off the shelf web server capabilities (JPSs and servlets) – Fast, local access to IMS transactions and data from the container – Liberty enhancements could be picked up automatically by IMS

• Potential to reuse even more WebSphere technology within IMS

Embedded WebSphere Liberty profile

© 2015 IBM

Corporation

Explorer for Development

© 2015 IBM

Corporation

© 2015 IBM

Corporation

IMS Explorer for Development

The IMS Explorer for Development is a tool to help with

database visualization and querying

© 2015 IBM

Corporation

© 2015 IBM

Corporation

IMS Explorer for Development – DDL creation

The IMS Explorer for Development will be enhanced

with the following DDL editing/generation features – A full text DDL editor, that allows users to manually create their own

DDL scripts

– A graphical interface for creating/altering DDL resources • The generated DDL will be the extended IMS DDL syntax

© 2015 IBM

Corporation

© 2015 IBM

Corporation

IMS Explorer for Development - DDL validation

The IMS Explorer for Development will provide additional validation prior

to submitting a DDL script

Speeds up database change development as syntax errors are detected

sooner

Warns the user if the DDL script has changes that requires user

intervention – For example: Unload/reload operations

Warns the user if the DDL script is long running vs short running – Long running: Creating a new database resource

– Short running: Adding application metadata to an existing table

Provides a way to view the IMS DDL audit trail to lookup database

change history

© 2015 IBM

Corporation

IMS catalog navigation view

Get a list of all the PSBs/DBDs in

the system.

© 2015 IBM

Corporation

Built-in queries

Several built-in queries have been

added to assist with resource and

relationship discovery – “What are all the PSBs that reference this

DBD?”

© 2015 IBM

Corporation

Built-in queries continued

“What are all the DBDs referenced

by this PSB?”

© 2015 IBM

Corporation

Graphically view resources directly from the IMS catalog

© 2015 IBM

Corporation

IBM Management Console for IMS and DB2 z

© 2015 IBM

Corporation

IBM Management Console for IMS and DB2 z

© 2015 IBM

Corporation

© 2015 IBM

Corporation