Welcome to the Oracle Enterprise Manager ThilWb ...€¦ · Welcome to the Oracle Enterprise Manager ThilWb tSiTechnical Webcast Series Please ensure that you are connected to the

Welcome to the Oracle Enterprise Manager T h i l W b t S iTechnical Webcast Series

Please ensure that you are connected to the audio portion of this event which is available by dialing:

Dial-in US/Canada : ( 888 ) 794 - 4691Dial-In Int'l/Local Toll : ( 706 ) 679 - 9955Dial-In Int l/Local Toll : ( 706 ) 679 - 9955Password : cloud

For local toll free numbers for other countries please visit the following page, http://www oracle com/technetwork/oem/grid control/intercall audio dialin 182843 htmlhttp://www.oracle.com/technetwork/oem/grid-control/intercall-audio-dialin-182843.html

The meeting will begin in a few minutes.

1

Enterprise Manager Cloud Control 12c

Enterprise Manager Cloud Control 12cp gTechnical Webcast Series:

Application Quality Management with Oracle Enterprise Manager - A pp Q y g p gComprehensive Approach to Preserving Quality During Change

Armando WirshingPrincipal EM Sales Consultant

Total Cloud Control

Complete Lifecycle Integrated Cloud Business-Driven Management Stack Management Application Management

Self-Service IT | Simple and Automated | Business D iDriven

Application Quality Management

Application Quality Management

Application Quality Managementgg

• User Experience• Quality Challenges• Quality Challenges• Application Testing Tools• Script-less Load Testing

T t E i t• Test Environment Consistency

• Test Data Management• Summary

AQM

Quality ManagementManagement Challenges

User Experience

User Experience

User ExperienceManagement

Real User Experience Insight ArchitectureC ll t d D tCollected Data:

•Client-ip, Server-ip, Gateway-ip•Requested URL (Page,Object)•Cookie/Session-id•Referrer e

Tim

e

PageRequest

•Referrer•GET & POST requests• User agents (phone type)

Internet

Firewall

work

Res

ponse

me

• Response?•Server error, web site error,

Hit OK

EthernetSwitch

Web Servers

RUEI Net

w

r Res

ponse

Tim• Content of page (i.e order

details, functional errors)App Servers

•Delivered?Ser

ver

RAC

Delivered?•Aborted?•Network timeout?

User Experience Management

User ExperienceManagement

AQM – Quality Challenges Overview

Quality ManagementManagement Challenges

Quality Challenges Overview

The Challenges of Qualitye C a e ges o Qua ty

• >40% of all software applications are released with critical defects.

• 80 percent of development costs are consumed identifying and correcting defects.

• An error found after product release costs up• An error found after product release costs up to 100 times more to fix.

• Testing typically accounts for 30 to 50% of a g y ysoftware project budget

• Non-reproducible or Ad-hoc testing is of little or no useor no use.

Application Development Process

In the typical application development process Testing is anIn the typical application development process, Testing is an isolated stage at the very end of the cycle.

DefineRequirements

Design &Architect

Develop Code Test Deploy to

Production Sustain

Test Process

In reality, the Test process is more complex and involves multiple stages of its own.

DefineRequirements

Design &Architect

Develop Code Test Deploy to

Production Sustain

Define TestProcess

Run Functional

Tests

Run LoadTests

Run Unit

Tests

Test Process

Define Design & Develop Test Deploy to Sustain

From a practical standpoint, there are even more stages that Testers need to worry about

Requirements Architect Code Test Production Sustain

Define TestProcess

Run Unit Tests

Build AppStaging

Environment

DeployTest Tools /

Systems

RunFunctional

Tests

RunLoadTests

Apply Patches &

Re-Testy Re Test

A d thi t kAnd this can take up as much time as the testing

itself …

How do you o do youwant it done? RiskRisk

Cheap? Process Fast?

orRight? CostCost TimeTime

& Tools

Right? CostCost TimeTime

Oracle Application Quality ManagementApplication Quality Management

G t l O l i I t t d Q litGartner places Oracle in Integrated Quality Management Suites Magic Quadrant

Gartner says:Strong tools for gathering information from production to create accurate load test scripts and dataStrong test dataload test scripts and dataStrong test data management solution, with the ability to extract and mask data from test systemsAccelerators to support the application suitesSupportsto support the application suitesSupports multiple client technologies and databases

Oracle Testing Solutions

Testing Application Changes

Oracle Functional

Testing

Oracle Load Testing

Oracle Test Manager

Testing Infrastructure Changes

SQL Performance

Analyzer

Application Replay

Database Replay

New

Test Data and Lab Management

Data Discovery and Modeling

Data Sub setting Data Masking

NewNew

Management

ProductionSynthetic Test DataProduction Workload

Synthetic Workload

Test Data Management

AQM – Testing Tools

Quality ManagementManagement Challenges

Testing Tools

Oracle Application Testing SuiteA powerful, integrated testing solution for ensuring application quality, performance and reliability

Oracle Functional Testing

Automated functional & regression testing

Oracle Test ManagerTest process management,

requirements and defect tracking

Oracle Load Testing

Automated load & performance testingpe o a ce test g

Oracle Functional Testing:Automated Functional & Regression TestingAutomated Functional & Regression Testing

• Automates functional & regression testing for Web SOAregression testing for Web, SOA and packaged applications

• OpenScript integrated scripting platform for functional and load testing

• Intuitive visual scripting interface simplifies test processP f l J IDE id• Powerful Java IDE provides superior scripting extensibility

• Custom accelerators for EBS, Siebel ADF & Web Services forSiebel, ADF & Web Services for efficient, optimized testing

Oracle Load Testing:L d d P f T ti d T iLoad and Performance Testing and Tuning

• Realistic load & performance testing for Web, SOA and gpackaged applications

• Scale to thousands of concurrent users to simulate peak production loads

• Delivers better accuracy by performing functional content validation under load

• Intuitive Web console promotesIntuitive Web console promotes collaborative testing

• Integrated server monitors help identify & resolve performance bottlenecksbottlenecks

• Custom accelerators for EBS, Siebel, ADF & Web Services for efficient, optimized testing

Oracle Test Manager: T t P M tTest Process Management

• Manage test process from a centralized Web console

• Comprehensive traceability from test requirements, to test cases, to issues

• Document both manual &Document both manual & automated test cases and execute from your test plan

• Create reports to provide visibility into the test processy p

• Fully customizable to fit your test methodology

• Scalable enterprise architecture yet easy to deployarchitecture, yet easy to deploy & manage

Script Import from p pUser Experience

• Export real user session transaction data from RUEIRUEI

• Import it into OpenScript to generate a load test script

Key Features in Application Testing SuiteApplication Testing Suite

• Database Testing module• Database Testing module– Load testing for Oracle Database– Integrated with Real Application Testing to

generate test scripts

• Adobe Flex support for functional & load testing– Enhanced testing for Rich Internet Apps

• New & updated Test Starter Kits for E-Business Suite 11i and R12 and Siebel Enterprise– Sample functional and load test scripts

• Integration with Enterprise Manager for Database Diagnostics

25

– Analyze DB performance under load

AQM – Scriptless Load Testing

Quality ManagementManagement Challenges

Scriptless Load Testing

Proper Approach to Quality p pp yManagement

Application ReplayMiddleware

Application Testing Suite

ReplayReal

ApplicationDBMS

Storage Application Testing

StorageO/S

• Test infrastructure changes separately from application changes• Test one change at a time• Specialized tools can result in much higher quality and efficient testingp g q y g• Proper test systems and test data mandatory for good testing results

Overall Quality MgmtReal User Experience Insight (RUEI)* User Experience MonitoringOverall Quality Mgmt

Appen

t

plication

Application Testing Suite (ATS)* Regression / Functional Testing* Load Testing

agem

eIApplication Replay (AR)

*Man

anfrastruc

* Script-less MW Load Testing*powered by Real User Experience Insight (RUEI)

ality

ctureReal Application Testing (RAT)

* SQL Performance Analyzer – Automated DB Regression Testing

* DB Replay - Script-less DB Load Testing

Qu

Diagnostics, Tuning & SPA Comprehensive DB Performance ManagementComprehensive DB Performance Management

Tuning Pack

DiagnosticPack PackPack

STEP 2:Fix Issues

STEP 1:Find Issues

SQL Performance Analyzer

STEP 3:Validate Fix

Real Application Testing with SQL Performance Analyzer (SPA)

• Test impact of change on SQL query performance• Capture SQL workload in production including statistics & bind variables

SQL Performance Analyzer (SPA)

Capture SQL workload in production including statistics & bind variables• Re-execute SQL queries in test environment• Tune regressed SQL and seed SQL plans for production

ClientClient

…Client

R t SQL Q i

Production Test

……Capture SQL

Middle Tier

Oracle DB

Re-execute SQL Queries

Use SQL Tuning Advisor to tune

Storage

regression

Example SPA Report STS Compare

2

133

Infrastructure Testing Oracle Real Application Testing

TestProductionReduce costs and

Infrastructure Testing

Reduce costs and risks of database and infrastructure changes

Test with real production workloads

Storage Storage

Fully automated workflow

CaptureCapture ProcessProcess ReplayReplay Analysis &Analysis &

Storage Storageworkflow

CaptureCapture ProcessProcess ReplayReplay ReportingReporting

Application ReplayTestProductio

n ReplayUsersCapture application workload (http/nca user requests) in Replay

DriversUsers(http/nca user requests) in

productionLeverages RUEI to capture all user interactions performance datainteractions, performance data Zero performance overhead

Replay full workload in test

CaptureCapture ReplayReplayAnalyze &Analyze &

Maintains all production characteristicsAutomatic correlation based on Application Testing Suite CaptureCapture ReplayReplay

ReportReportApplication Testing Suite

Analyze & ReportReplay divergence: access, content etccontent, etc.Pages load times, page views, think time

Capture Optionsp pCapture modes – synchronous and

hasynchronousSynchronous capture

Tracks relationships between user requests p qand db calls Results in most accurate replay with least divergencedivergence Involves enabling database level capture as wellSupported for applications running on OracleSupported for applications running on Oracle WLS 11g PS3 and DB 11.2.0.2 or higher versions

Asynchronous captureOnly user requests captured by RUEI

AQM – Testing Environment Consistency

Quality ManagementManagement Challenges

Testing Environment Consistency

Application testing environmentsThe Devil is in the details...

Complex applications rely on complex infrastructure.

Complex infrastructure consists of hardware andconsists of hardware and software.

Millions of software configurations across lifecycle environmentsenvironments.

Is this your Environment Configuration Management?Management?

COnfiguration management

Manage The Application Life Cycle Reduce Migration And Deployment Efforts

ApplicationStack View

Lifecycle EnvironmentsView Environments

Find The Needle In The Hay StackReduce Time To Remediate Issues

•Finds meaningfulFinds meaningful differences

•Directly Provision changesg

Find what has changedknow the past state of the environment

Version History for Environment Configurations

AQM – Test Data Management

Quality ManagementManagement Challenges

Test Data Management

Test Data ManagementSolutions

Test System Setup Test System Setup

Data Data Sensitive DataSensitive Data DataDataDiscovery & Modeling

Discovery & Modeling

Sensitive Data Identification

Sensitive Data Identification Data MaskingData Masking Data

SubsettingData

Subsetting

Data Discovery and Modeling

Application Data Model (ADM)Scans application schemas to model relationships between tables and columns Extract data relationships from Oracle Applications meta-dataStore referential relationships stored in repository Enables test data operations such as data subsetting, maskingg

Sensitive Data DiscoveryPattern based database scanningPattern-based database scanningImport from pre-built mask templatesPre-built Data Masking templates for Oracle applications

Data Subsettingg

b t b f ti P t d i d i b t tibset before executionParameter-driven dynamic subset generatio

Export /

Define New Application Data Model

Create Data

Subset Definition

Extract Data

Subset

Import

In-Place Delete

P d ti T tProduction Test

Data MaskingProduction Test

LAST_NAME SSN SALARY

HODGES 111—23-1111 60,000

JOHNSON 222-34-1345 40,000

LAST_NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

Deploy secure test system by masking sensitive dataSensitive data never leaves the database

• Extensible template library and policies for automation• Sophisticated masking: Condition-based, compound, deterministic

• Integrated masking and cloningg g g• Leverage masking templates for common data types

Reference linksReference links• Application Testing Suite -• Application Testing Suite -

http://www.oracle.com/technetwork/oem/app-test/index.html

• Application Quality Management -http://www oracle com/technetwork/oem/app qualityhttp://www.oracle.com/technetwork/oem/app-quality-mgmt/application-quality-management-092933.html

• Configuration Management -http://www.oracle.com/technetwork/oem/config-mgmt/index htmlmgmt/index.html