Professional Services Performance Testing Center of Excellence Application Performance Management Solution Information Technology Services Click to Advance.

Professional Services

Performance Testing Center of Excellence

Application Performance Management Solution

Information Technology Services Click to Advance Presentation

Mute sound if necessary (sound icon)

Today’s Challenges

Business lines rarely share information on tool research, usage, testing practices, and cost containment.

Software Development Life Cycle models frequently compromise testing initiatives to meet deliverable deadlines.

Performance Testing Practices vary in most projects.

Knowledge Transfer – performance testing information leaves with consultants.

Performance Tools are expensive, and very complex to integrate.

No global approach to Performance Testing tools, techniques, or costs.

Expensive consultants are frequently hired for Performance Testing

Many projects cannot afford to make long term commitments to Performance testing.

Decentralized approach to building and testing software.

2

Industry Trends

Application owners often ask the following:

Does my application scale to meet business goals?

75% of ERP systems fail to do so (Gartner)

Does my application scale to meet business goals?

70% of performance problems can be resolved by configuration changes (survey of 3,000 HP/Mercury engagements)

Can I resolve application bottlenecks?

40% of app bottlenecks are first noticed by a customer or executive (Mercury Survey)

$2B + spent in app server overcapacity from 2001 to 2003 (Gartner)

Have I overspent on infrastructure?

3

One Platform Solution

T3 works to empower Business, Quality Assurance, and Development teams to deliver better software by centralizing all aspects of testing and performance management.

Become Performance center of excellence

Centralize performance testing and monitoring tools

Global Performance testing execution capability

Focus on quick “cost savings” wins!

Reduce dependency on expensive consultancy

QUICK START- Bring automation in quickly that addresses an immediate need.

Reduce infrastructure support for testing

Take a ‘value’ approach and network it

Forge alliances & partnerships

Leverage vendor Purchasing Power

“Bringing the pieces together”

4

Performance Approach

Phase-driven approach to Performance Optimization

Phase 1:Plan

Fully Plan the projectOrganize the Team

Determine the business goalsDefine the business processInventory HW, SW and networkIdentify key participantsMobilize test teamCreate test planAgree execution schedule

Phase 2:Baseline

Quantify the SystemPerformance

Create test casesDeploy monitoring agentsRun initial test planDocument the baseline profileCompare baseline with target

Phase 3:Optimize

Iteratively Isolate andReduce Bottlenecks

Emulate production loadMonitor system performanceIdentify problem areasAnalyze root causeDetermine resolutionApply modification

Assess the PerformanceImprovements and Report

Phase 4:Report

Document improved throughput Increased capacity reduced error rate greater stability better user response time

Compare with baseline and targetProduce findings/recommendationsRetain data for future comparison

5

Why HP/Mercury

1.1. Proven LeadershipProven Leadership

2.2. Market VisionariesMarket Visionaries

3.3. Strategic AllianceStrategic Alliance

Worldwide Performance Testing Market Share Source Newport Group, Inc © 2004

Empirix4%

Compuware4%

Other9%

Segue2%

Rational9%

RadView1%

HP/Mercury71%

6

Automated Performance Testing

Web Server App. Server DatabaseInternet/WAN

Controller User Simulation

PERFORMANCE MONITORS

Replaces real users with thousands of virtual users

Generates consistent, measurable, and repeatable load, managed from a single point of control

Efficiently isolates performance bottlenecks across all tiers/layers with automated reporting and analyses

7

Types of Performance Testing

1.1. Stress TestingStress Testing

2.2. Capacity PlanningCapacity Planning

3.3. Throughput ImprovementThroughput Improvement

4.4. Server ConsolidationServer Consolidation

5.5. Baseline AssessmentBaseline Assessment

6.6. New Version Impact AnalysisNew Version Impact Analysis

7.7. Ensure Business PerformanceEnsure Business Performance

8

Application Monitoring

ApplicationServer

WebServers

DatabaseServer

Router Router

LoadBalancerFirewall

ISPISPISP

98% of sites experience critical performance problems– Typical applications encounter problems at 15% of design

capacity

Problems occur both inside & outside firewall– 25% - network and bandwidth related– 23% - application server related– 20% - load balancers, web server or proxy server issues

Source: Mercury Interactive hosted services

Application Management monitors the entire infrastructure from the users perspective!

9

A Day In the Life… Daily Challenges

07:17AM Ticket opened

07:05AM Problem detected - data center serving e-Bank customers is down

07:31AM Bridge-line opened - 8 people

11:48AM 4 more people paged, DBA joins line

04:05PM Root cause identified: mis-configured connection pooling caused DB crash at peak traffic. At least 800 customers affected, business impact unknown

04:20PM IT representative sent to client impact assessment meeting

08:03AM Check UNIX issue, escalate to hardware vendor

08:06AM Business urgency discussed, not well understood

10:51AM Hardware is ok, Informix DB appears down

10:20AM Security clearance delays hardware vendor from entering data center

10

Diagnose Root Cause

Define SLAsBusinessConsole

CustomerImpact SLM Event

ViewerTier 2Top View

BUSINESS AVAILABILITY CENTER

Tier 1 Tier 3

RESOLUTION CENTER

11

Application Management Dashboard

Define SLAsBusinessConsole

CustomerImpact SLM Event

ViewerTier 1 Tier 2 Tier 3Top View

BUSINESS AVAILABILITY CENTER RESOLUTION CENTER

12

Appendix

Supplemental Information

13

Introducing LoadRunner

Our Center of Excellence approach uses Mercury Interactive LoadRunner product to deliver an integrated solution

for business technology optimization.

Network bandwidth

Routers

Switches

Hosting equipment

Load balancers

Application servers

Databases

Middleware

Back office

Firewalls

IDS systems

DDoS systems

Gateways

Web servers

Cache servers

LAN / WAN

Client Systems

Legacy system

.NET services

Sun ONE services

SecurityInfrastructureApplication

LoadRunner

System

Monitor

AutomatedScripts

DataRepository

It provides an end-to-end tool set for performance tuning a user simulation module to create business transaction load a system monitoring module to display infrastructure behavior and application

errors a set of automated scripts that identifies modifications a data repository for future comparisons

14

Powering the CoE

Application Delivery Foundation

Application MonitoringBusiness Availability Center • Resolution Center

Application Delivery Console

Virtual Users

ProtocolsMonitors

PERFORMANCE CoE

Global ManagementMulti-project ManagementResource Management

DiagnosticsTuningLoadRunner CapacityPlanning

15

LoadRunner Coverage

Recommendation ResolutionProblem Identification

MonitoringUser Simulation

Infrastructure(e.g. Linux, Solaris, Windows)

Vendor Product(e.g. Oracle, Websphere)

Performance Tuning Steps

Tu

na

ble

Co

mp

on

en

ts

LoadRunner Capabilities in Optimization Exercise

In-house Apps• method level for J2EE apps

• program level for other types

* J2EE source code line-level identification available using OptiBench add-on.

16

LoadRunner Overview

Web Server App. Server DatabaseInternet/ Intranet

USER SIMULATION PROTOCOLS

Clients

PERFORMANCE MONITORS

•SAP•Oracle•Siebel•PeopleSoft

ERP/CRM

• HTTP(S)• XML• Citrix ICA• SOAP• WAP

Web

• EJBs• CORBA• COM• RMI• MQSeries

• 3270• 5250• VT100

• Oracle• MS

SQLServer• DB2• ODBC

Middleware LegacyDatabases

Operating Systems Network Web

ServersApp Servers Java Databases

• Windows• Unix• Linux

• SNMP• WAN

Emulation

• MS IIS• iPlanet• Apache

• EJB• JDBC• JSP• Sitraka

JMonitor

• Oracle• MSSQL

Server• DB2

• BEA WebLogic• IBM WebSphere• ATG Dynamo• iPlanet App Server

17

LoadRunner Deployment

Application Tier

Applications

ApplicationServers

Infrastructure Tier

Firewall

Web Servers

Load Balancer

Firewall

Database Tier

DatabaseServers

Storage

Distributed System

App & SystemMonitoring

Measure Performance → Identify Constraints → Apply Modification

~~~~~~

Stress Simulation

Telecomm Fabric

Infrastructure

Consumption

CPU 28 CPUs

Memory

2,560MB

Disk I/O 70%

Network

80%

System

Capacity

User count 100

Tranx rate 100/min

User

Experience

Response time

10 sec

Error rate 10 %

Automated & Manual Tuning

Apply Tuning Process

Gather Metrics

Step 1

1. Define business process

2. Capture user behavior

3. Create simulation profile

4. Apply controlled load

Step 2

Step 4

Sample Recommendations

WebLogic - misconfigured Java VM heap size

Database - missing indexes, full table scan

...

Step 3

EnvironmentunderUser Load

Typical Statistics

18

Metrics

DatabasesOracle

• Total file opens • Enqueue deadlocks• Enqueue waits• Opened cursors current• SQL*Net roundtrips to/from client • Plus 164 other counters

Sybase• Disk Reads • Memory • Disk Writes• Disk Waits• Locks count • % Hits • % Processor Time (process) %• Plus 49 other counters

Microsoft SQL Server• SQL Re-Compilations/Sec • I/O - Outstanding Reads • Lock Wait Time (ms) • Total Latch Wait Time (ms)• SQL Re-Compilations/Sec • Plus 38 other counters

DB2• Local_con_exec• Total_sorts• Plus 174 other counters

App. ServersIBM WebSphere

• ThreadCreates • ActiveThreads • ConnectionPoolSize • SessionsActive• Plus 82 other counters

BEA WebLogic• HeapSizeCurrent • ActiveConnectionsCurrentCount • WaitingForConnectionCurrentCount • Plus 118 other counters

Iplanet Application Server• nasKesEngAutoStart • nasEngSYBPreparedQueryTotal • nasEngThreadWait • Plus 118 other counters

Microsoft Active Server Pages• Requests Executing • Requests Queued • Request Bytes Out Total• Requests/Sec • Transactions Aborted • Transactions Pending

Oracle 9iAS HTTP ServerAllaire ColdFusionSilverStreamAribaATG DynamoMicrosoft COM+ MonitorBroadVision

Web ServersApache

• #Busy Servers • #Idle Servers • CPU Usage• Hits/Sec • KBytes Sent/Sec

MS IIS• Connection

Attempts/Sec • Files Received/Sec • Logon Attempts/Sec • Total Files Transferred • Plus 50 other counters

Iplanet (Netscape)• Bad requests/Sec • Bytes Sent/Sec• Hits/Sec • Plus 11 other counters

Other Softwareand Hardware

Streaming Media MonitorsCheckpoint Firewall Server ERP Performance MonitorsMiddleware MonitorsJava Performance MonitorsCitrix MetaFrame MonitorsNetwork Delay

Cu

stom

ized

Co

un

ters C

ap

ab

ility

Cu

stom

ized

Co

un

ters C

ap

ab

ility

19

The Tuning Process

Apache Web Server 1.x/2.x

BEA Weblogic 6.x/7.x

IBM HTTP Server

IBM Websphere Advanced 4.x

IBM Websphere Single Server 4.x

iPlanet Enterprise Server 6 & higher

Microsoft IIS 4/5

Microsoft Active Server Pages 2/3

Oracle Database

Oracle 9iAS

PeopleSoft 8.x

SAP Enterprise Portals 5

Siebel 7.x

SQL Server 7.5/2000

Windows: NT, 2000 and XP

UNIX: Solaris, HP, AIX and Linux

LoadRunner’s tuning agent can be deployed to automatically recommend optimum settings for a wide range of industry-standard applications.

IT specialists will manually optimize additional hardware and software based on LoadRunner performance metrics.

20

Benefits of Tuning

• Optimizes application and infrastructure performance

• Isolates and resolves performance bottlenecks

• Establishes optimized configuration settings for production

21

Benefits of LoadRunner Diagnostics

• Pinpoints application bottlenecks, e.g., J2EE to method/SQL level

• Reduces time to resolution for application issues

• Integrated with Mercury LoadRunner— combines end user response time with diagnostics

22

23

Visit Us Online

Global VirtualTesting Capabilities

For additional information contact:[email protected]

Click Here or copy/pastewww.t3consortium.com