Monitoring Management Overview

© 2010 IBM Corporation

Monitoring Management Overview

Sebastián [email protected]

IBM Software Group


IBM Software Group | Tivoli Software

2

Agenda

1 Overview

2 SmartCloud Monitoring and Application Performance Manager

3 IBM Tivoli OMNIbus and Network Manger

4 IBM Tivoli Business Service Manager



3

The basic model for Assurance is based on three levels with two views: real-time view of the control center and Historical views for planning and evaluation

Po

rta

l

Ser

vice

Le

vel

View long term (planning)

short-term view(Operation)

Performance Management

Representation of the importance of IT to the business or the

impact on customers

IT - infrastructure (systems - networks - Storage)IT - infrastructure (systems - networks - Storage)

Fault Management

Transaction Management

Security Management

Rep

orts

Acc

ount

ing

Central event display, processing, correlation, enrichment

MoreBusiness processes


Dat

a W

are

ho

use

Re

po

rtin

g

PurchasePurchase ProductionProduction DistributionDistribution



4

IBM solution for each areaT

ivo

li I

nte

gra

ted

Po

rta

l

Ser

vice

Le

vel

Tivoli Netcool Performance

Manager

Tivoli Business Service Manager

IBM SmartCloud Monitoring

Tivoli Security Information and

Event Management

Rep

orts

Acc

ount

ing

Tivoli Netcool OMNIbusNetcool Impact

Tiv

oli

Da

ta W

areh

ou

se

/ Dat

am

art

Tiv

oli

Co

mm

on

Re

po

rtin

g

Tivoli Service Qualtity

Manager

IBM SmartCloud Application Performace

Manager


MoreBusiness processesPurchasePurchase ProductionProduction DistributionDistribution






5

The modular design is also suitable for integration with third-party systems for the construction of an efficient manager of managers

Tiv

oli

In

teg

rate

d P

ort

al

Ser

vice

Le

vel

MRTG Cacti

Ganglia

Tivoli Business Service Manager

Nagios

Tivoli Security Information and

Event Management

Rep

orts

Acc

ount

ing

Tivoli Netcool OMNIbusNetcool Impact

Tiv

oli

Da

ta W

areh

ou

se

/ Dat

am

art

Tiv

oli

Co

mm

on

Re

po

rtin

g

Tivoli Service Qualtity

Manager

IBM SmartCloud Application Performace

Manager



PurchasePurchase ProductionProduction DistributionDistribution






6

Agenda

1 Overview






VMware

Servers/platforms (NGP, zEnterprise, x86, IBM Power, Sun, system z, Cisco UCS, PureScale, etc)

SmartCloud Monitoring(ITM, ITMfVE)

Capacity PlanningCapacity Assessment

Forecasting

TDW

WindowsLinux

Transactions

MiddlewareDatabases

Storage (NetApp, IBM, EMC, etc)

Network (Cisco, IBM, HP, Juniper, Brocade, etc

Integrated monitoring

Integrated Services Management

Health Dashboards

IBM Power VM

KVM

XenServerz/VM

XenDesktop

XenApp

AIX

Solaris/Zones

HP-UX

Applications

Part of broader IBM Services Management

Hyper-V

TPC NetworksTADDMIBM Director

Assures that health of cloud environment meets customer needs (reduces MTTR, lower operations cost, etc)

Helps to consolidate and reduce IT footprint (reduces TCO, optimizes resource usage, etc)

OMNIbus

IBM SmartCloud Monitoring Logical View



Key capabilities to optimize & maintain a private cloud

Health dashboards to provide an instant, consolidated glimpse into cloud health

Topology views of the key interrelated components of the cloud

Reports on the health trends of cloud components and workloads, powered by Cognos

What-If capacity planning scenarios

Policy-Based optimization to put workloads where they’ll perform best, not just where they’ll fit

Performance Analytics for right-sizing of virtual machines

Integration with industry-leading Tivoli service management portfolio



Cloud Admin

Drilldown to see details of physical and virtual resources in the cloud

Launch to see overall cloud health

Overall health of cloud

infrastructure and workloads,

capacity info

Detailed information about cloud components and VM workloads

Launch to see overall cloud

health

Drill down to see details of physical and virtual resources in the cloud

Capacity Planner

IT Operator, App Owner

Cloud Health

Dashboard

Cloud Health Operational

Details

Cloud Solution Admin

ConsolesEnterprise Views

Admin ViewsSimple view of

health of servers, services and

components that make up the cloud

infrastructure

IBM SmartCloud Monitoring Operational View



Understand the end-user experience

Follow changing workloads

Mobile devices & smart endpoints

Private, public & hybrid clouds

Highly virtualized applications, storage & networks

Discovery

Visibility into application resources

End User Experience

Transaction performance monitoring to ensure SLA compliance

Transaction Tracking

Rapid problem isolation through

transaction path analysis

Diagnostics

Domain-specific operations tools

for diagnosis and repair

Predictive Analytics

Proactive Management to

reduce outages & improve business

performance

shared data & common services

See steps across the cloud

Visibility, control and automation to intelligently manage critical applications in cloud and hybrid environments.

Application Performance Management provides…



IBM SmartCloud Application Performance ManagementA single solution that intelligently manages Performance, Availability, and Capacity for complex application infrastructures in cloud and hybrid environment.

Comprehensive solution that offers the right visibility, control and automation for critical applications

Modular design to get started quickly and add capabilities as they are needed.

Analytics to improve capacity utilization and optimize performance

Common reporting tool, based on Cognos, makes reporting simple and easy to customize

Delivers breadth of domain coverage in combination with a single trusted source of information for more accurate and faster problem diagnostics

Dis

cove

ry

En

d-U

ser

Exp

eri

en

ce

Tra

ns

act

ion

Tra

cin

gCloud | Virtualized | Traditional IT | Hybrid

Dia

gn

os

tic

s

An

aly

tics

Comprehensive Solution

Modular Design

Analytics

Common ReportingTool

Breadth of Coverage

www.ibm.com/Tivoli/APM

IBM SmartCloud Application Performance

Management



Dramatically simplify visibility into application environment

Take the guesswork out of end user experience management with smart drill downs.

Easy to understand dashboards track availability, performance, and capacity.

Role-specific screens for both Operators and Application Development teams.

Built on best practices, yet easily customizable with a wide variety of widgets.

Runs on smart devices.



13

Monitoring – only one monitoring engine to operate for all use cases

Application Monitoring

RDBMS Monitoring

J2EE Monitoring

SAP, Siebel, Sharepoint, Exchange,

Lotus, Maximo, …DB2, Informix, Oracle, MS SQL, Sybase,…

Websphere,Weblogic, Apache,

JBoss, …



14

Monitoring – only one monitoring engine to operate for all use casesEnergy

SOA Monitoring

Transaction/SLA Monitoring

IBM, Eaton, Siemens, APC, …

IBM, SAP, Oracle, Microsoft, …

Response times:Robotic, Client

Capture, Reverse, …



15

Agenda

1 Overview






16

IBM Tivoli Netcool Omnibus is the central event management engine for Tivoli. It can be used as an event system for the control room, as well as the engine in the Network and BSM solutions integrated

One of the most powerful engines event related event throughput and event processing marketUnique in-memory database

Scalable and resilient architecture

Event excellent care (deduplication, correlation, automation)

Easy to set up and event processing via triggers and automationsComprehensive prepared correlation

Leading Event Engine regarding integrationMulti-tenant facility

Desk Visualisation and integration with common alerting tools

Access to IT process tools

Historical data storage for analysis



17

Impact Netcool OMNIbus enables enrichment of events with information from third data sources at run time

Already in the control information can be enriched to events with important additional information

– Which Service– Within service time– in Maintenance– …

Tivoli Netcool Impact

Informationsdatabase



18

The architecture of Netcool Impact shows the flexibility in terms of integration - both the event page, and on the part of the data sources to be enriched

NetcoolOmnibus

structureddata

Web Services,JMS Policy Engine RDBMS

Asset / Config Management

Web Services, JMS, LDAP, …

Tivoli Netcool Impact

GUI Server

Integrated AJAX Style

Event Reader

Event Listener

Data Source Adapter

TECITM

RDBMS

Daten-banken

Omnibus, DB2, Oracle, MS SQL, MySQL,

Informix, Sybase, ODBC, JDBC, Postgres

Maximo,CCMDB,Cramer,

,,,



19

Tivoli Integrated Portal properties ...

Free choice and positioning of widgets - Web Experience 2.0

Integration iWidgets

Mashup structure - information is displayed in the context of selection

Multi-User fähig

Launch-in-context

LDAP Integration

Wizard-based creation



20

One of the largest libraries in the market integration

Probes (~ 200):

ATM Forum MIB RFC 1695 for ATM switchesATM Forum PNNI (Single Pier) MIBATM Forum ILMI MIBATM Forum LANE Client MIBFrame Relay MIB RFC 1315FDDI MIB RFC 1512

ADC Metrica NPRAirspan SitespanAlcatel 1000 E10/OCB-283Alcatel 5620 LogfileAlcatel 5620 NM CORBAAlcatel 5620 SAMAlcatel AWSAlcatel DSC Dex per Class 5 Voice SwitchAlcatel MT20Alcatel NMC 1300Alcatel OMC-R (3GPP)Alcatel OMC-R (Q3 Interface)Alcatel OMC-R (Terminal Server Connection)Alcatel OMC-SAlcatel OS-OSAlcatel S12Alcatel SMC 1360

Aprisma SpectrumArcom Environmental Monitoring SystemAscom CLOGAscom PANMANAscom TimePlex TimeView/2000Avaya Definity G3 per switchBMC PatrolCA Unicenter TNGCastlerock SNMPC ComverseDantel PointMasterDAWCOMDEC VAX Operator Communication FacilityECI Lightsoft CORBAECI/eNMECI/Telematics

Email ProbeEnterprise SNMP EMS ProbeEricsson 3GPP (OSS-RC/RANOS/CNOS)Ericsson ACP 1000Ericsson AXE 10 per Class 5 Voice SwitchEricsson BNSIEricsson MD110Ericsson RANOS (3GPP)Ericsson XmateExec ProbeFibermux LightWatchFIFOFLEXR ProbeFreshwater SitescopeFujitsu FENSFujitsu ICS ProbeFujitsu NetsmartGeneric Logfile ProbeGeneric trapd/syslog capture per deviceGlenayre VMS Probe

Hewlett Packard IT/Operations CenterHewlett Packard OpenView NNMHewlett Packard Vantage Point Operations Cisco WAN ManagerCMS400 ProbeCompaq TandemInformixIon Networks Sentinel 2000KBU FivemereKodiak EMSLucent 5ESS - Class 5 Voice SwitchLucent Agile ATMLucent ECPLucent ITM-NM/OMSLucent ITM-SCLucent JMTE (CORBA)Lucent NaviscoreLucent NFMLucent OMC (CORBA)Lucent OTAF/SDHLRLucent Wavestar SNMS

Vendor Alliances (~25):

Alcatel

Motorola

Siemens

Ericsson

Tellabs

Marconi

Lucent

Nokia

Huawei

Fujitsu

Ciena

Cisco

Juniper

Checkpoint

Cramer

Metasolv

SAP

Xtera

Voyence

Bridge MIB RFC 1493 MIB-II RFC 1213/2096 RMON MIBsOSPF MIBBGP MIBifStack MIBVRRP MIB

31 different Cisco MIBs (including MPLS VPNs)21 Nortel MIBs6 different Extreme Networks MIBs (inc VLANs)Juniper MPLS VPN support

Experience Library SNMP support (>175 MIBs), including:

Gateways (~ 30):Bi-Directional Flat FileIBM DB2 IBM Informix

MS SQLOracleRemediy HP service Desk

ObjectServer v7 UnidirectionalOracle 10.1.0.2 EE & SEEtc.

TSRMSiebel SNMP Socket



21

The extension to coach for Networked Fault Management: Tivoli Network Manager IP - network topology based root cause analysis

Integration with TIP and use of TCR

Historical Data Collection– E.G. Reports on bandwidth usage

Network Inventory Reports

Adaptation to acute standards– IPv6 Support

Improved support of advanced networking technologies such as MPLS

– path Analysis

Network Configuration Management

Network

Discovery Agents

Polling Agents

NM IP Database(NCIM)

Tivoli Common Reporting

Root Cause

Analyse

Event Engine

(OMNIbus)

Tivoli Integrated Portal

Probes

GW

GW



22

Agenda

1 Overview






23

Tivoli Business Service Manager Business ValuesUnderstand, monitor and explore the state of business operations

Business Impact

Share IT and business metrics and models with

teams to resolve situations. Utilize discovery data to build and maintain service models.

Understand trends through reports and analysis of

historical service status and metrics

Present information affecting business service performance

Determine impact of outages and provide notification of situations that require

response. Calculate and propagate status from event and metric data sources.

Business Dashboards

Data Integration and Collaboration

Reports and Analysis



“See and Respond” Service Visibility Helps Business Leaders Manage & Improve Operations

Identify health, events, make smart choices Understand up-to-

minute business performance by monitoring KPIs

Detect, respond rapidly to business Impact situations

Solve the primary

Business Impacts first

Continuously improve key

business services

Customize dashboards



Measuring & Improving Delivery Against Objectives: Key Performance Indicators:

– E.g. Transactions, Revenue, MTTR, Call Volume

SLA Indicators: – E.g. Customer Experience, Service Uptime, Transaction Rate, Infrastructure

Risk & Compliance Indicators: – E.g. Cobit, ISO, SOX, Basel II

Usage & Financial Indicators: – E.g. Service usage by LOB, Power by Service, IT cost per service

Business Service Management, shows the impact of the event on a specific service, and calculated in parallel with the KPIs / service levels in the background

Business Service Dashboard

SLA Indicators

Key Performance Indicators

Risk & Compliance

Usage & Financial

Inventory / Asset

Service Desk

Monitoring / CMDB

Applications / Databases



26

Business Service Management



27

Questions ?



28



29

Service Behavior

Event based (OMNIbus)

dependency rules

in percent(20 % Childs)

Numeric

3 types of Real-time SLAs

Instance Duration-based

Incident Count-based

Cumulative Duration-based

TBSM Rules

SummeAktuell

1 min 3 min 5 min

SLA Metrics

Availability

Downtime (MTTR)

Penalties ($$$)



30

Comparisons of services among themselves and comparisons with historical data collected

Historischer Vergleich

Comparison of two services


Monitoring with IBM Tivoli



32

Agenda

1 Overview

2 Installation

3 Administration / Operation

4 Monitoring

5 Alert Handling

6 Reporting

7 Interfaces / APIs



33

IBM Tivoli Composite Application Management

A single infrastructure for monitoring

From Windows to Mainframe – ok

from Middleware to ERP applications – agent based or agentless

Benefits of a central monitoring:

Low OPEX of the ITCAM solution

– Single backup concept

– Single authorization concept

– Single high-availability concept

– Single firewall authorization

– Few interfaces, common consistent reporting

Faster mean time to recover service (MTRS) due to all information displayed in a single view

– Visual correlation – historical and actual data

– Excellent analytics

– Simple automation



34

ITCAM architecture scales from SMB environments to enterprise size environments

Central management server responsible for control of the monitoring infrastructure

– Communication, Security, Interfaces

– Allows to scale through Hub-Spoke architecture (remote TEMS)

Separate portal server for graphical Multi-User interface in near-real-time

– Browser or Console based

Warehouse for historical data collection seamless available in portal

– Including relational database

Specific Agents for operating systems, middleware and applications or proxy‘s for agentless monitoring

Tivoli Enterprise Portal Server

Tivoli Enterprise Monitoring Server

Tivoli Enterprise Monitoring Agents

Tivoli Data Warehouse

Agent Proxy

Windows – Linux – i5/OS – AIX – HP/UX – Solaris - zOS



35

Rollout: IBM Tivoli Composite ApplicationManagement provides the best of both worlds –Agent based or agentless

Agentless technology is about cost of ownership

– Lower overhead cost on the server

– Lower cost of agent maintenance

– Faster speed of implementation

– Less intrusive technology

– Minimal impact to testing

– Polling based technology

Agent technology is about mission-critical

– Lower overhead cost on the network

– Higher resiliency and availability

– Better data availability, granularity and uniqueness

– Automated and independent take actions

– Real-time responsiveness to an incident

– Suited for new technologies without standards

– Suited for mission-critical environments

Agentless

Sometimes you need to watch from the

“outside”

Sometimes you need someone “on the ground” Agent Driven



36

Rollout of Agent-based environments through integrated deployment mechanism – includes serviceability

ITCAM is one-touch management – once the agent is installed and connects to its server any updates and add-on can be deployed

For initial agent deployment a solution for the bases agent deployment is included which can be run from graphical user interface or via command line

Agent deployment can be performed highly parallel

– Grouping available

Deployment status (success, failed, in progress, pending) can be verified



37

Alternate mechanism for deployment are also available and common

Classic Install

– User driven through UI oder command line

Packaged Install

– For use with software classic software distributiontools using response files (e.g. Bigfix)

– Direct preparation for distribution with Tivoli Provisiong Manager

Third Party Self Service

– Create Image that can be shipped with another productor individually released



38

Tivoli Enterprise Portal – the user interface of ITCAM

The portal shipped with ITCAM is very flexible in the display of monitoring information

– Multi-User interface with individual views

– Large choice of views – lists, pie charts, graphs, tables –anything can be exported to Excel

Linked workspaces enable drill down to isolate problems quickly

– May include links to external information like websites – the portal includes a Mozilla like full functional web browser

Start value (trigger) and actual value

Remediation actions – can also be issued

automatically

Context sensitive help e.g. wiki or link

to knowledge db



39

Visualization in the Tivoli Enterprise Portal

Individual for each user (can be restricted)

Real-time and historical date in one view –based on selected timeframe the portal will gather the data from the agent or from the historical data in the data warehouse – seamless

ZoomingWithin a certain area the values can hardly be distinguished – just take the mouse and zoom into that area and it will render in a better scale

Monitoring SnapshotsWhat happened Sunday night before the system crashed? Select the timeframe and ITCAM will gather the available data from the data warehouse for post-analytics



40

Virtualisation VMWare, AIX, Solaris


UNIX/Linux/Win

IP Services (DNS, DHCP, …)

AIX, Solaris, Redhat,Suse, Microsoft,i5OS,

…

> 30 Protokolle alle

Container, wPars, LPARS, CEC, HMC, …



41

Mainframe

MVS, CICS, IMS, DB2, …


Cluster Monitoring

MQ Monitoring

Micosoft, HACMP, TSA, …

MQ Series, Mesage Broker, …



42


Application Monitoring

RDBMS Monitoring

J2EE Monitoring

SAP, Siebel, Sharepoint, Exchange,

Lotus, Maximo, …DB2, Informix, Oracle, MS SQL, Sybase,…

Websphere,Weblogic, Apache,

JBoss, …



43

Monitoring – only one monitoring engine to operate for all use casesEnergy

SOA Monitoring

Transaction/SLA Monitoring

IBM, Eaton, Siemens, APC, …

IBM, SAP, Oracle, Microsoft, …

Response times:Robotic, Client

Capture, Reverse, …



44

Extensibility – Agent Builder

Self-written applications, existing monitoring scripts, etc. can be integrated in ITM with the built-in Agent Builder

The self developed agents behave like regular commercial agents and leverage the

– Integrated deployment

– May run subagents or remote scripts

– Use same communication paths –especially in a firewall environment

– Can have their own individual workspaces in the portal

API File ODBCSNMP/WBEM

HTTP Socket

My Agent

Script JMX

Targets

TEMS

ACF

Agent Builder



45

Basic functionality for alerting are Situations

Calendar condition

Attribute condition

<key>

Situation formula being overridden

(reference formula)

Highlighted items represent

overridden values

<threshold>

Empty condition represents

<default> override

Selected distribution for

override (MS or MSL)



46

Situations can be fixed or aligned with typical patterns – the patterns can be proposed by ITCAM based on historical data

Preset situations based on fixed values come with the monitors (best-practices) and can be changed using the situation editor

Thresholds can also be aligned to certain time windows during the day in order to avoid false alarms e.g. during the night when high CPU batch jobs are run

– Can be flexible

– Can be obtained through “learning mode” by running the system certain amount of time and obtain a threshold proposal form ITCAM which can be changed

Fixed Threshold Dynamic Thresholds using Baselines



47

Can be extended to a full functional Business Service Management solution with real-time Service Level Management and End-to-End availability and performance views

IBM Tivoli Netcool OMNIbus

IBM Tivoli Business Service Manager



48

Historical data are collected in the integrated Tivoli Data Warehouse (TDW) for active capacity management

Easy setup through user interface selecting value to be collected and automated maintenance of the date (summarizing and pruning)

Automated Trend calculation in the background using performance analyzer component for proactive alerting of possible bottlenecks

Dashboard views of predictive analytics that can create alerts (System Health)

All data available any time throughthe portal – just select timeframe

Direct export of data in portalviews to Excel (right click)



49

Core functionality of the report engine: automated reports

Parameters: Schedule

Preview:



50

Examples:

Bar Charts

Graphs

Lists

Heat Maps

Overlays



51

Die ITCAM Reports can be used for capacity an SLA management



52

TCR - Forecast Report Layout – OS Disk Utilization - Example

Historical Data

Calculated Trend

Current Forecast

xxx

Projected Forecast











Monitoring Management Overview

Documents