End to End Integration Testing of SAP Solutions_ Automated Testing Using ECATT

End to End Integration Testing of SAP Solutions

Automated Testing using eCATT

Application Lifecycle ManagementActive Global Support (AGS)SAP AG

SAP 2008 / Page 2

Test Capabilities

E2E Integration Testing of SAP Solutions

Business Blueprint

Test PlanningTest System Setup

Test Execution Apply Changesto Production

Change ImpactAnalysis

SAP Solution Update

New SAP Solution

Solution ManagerTest Workbench Test planning

Solution ManagerBusiness Blueprint

Solution ManagerTest Workbench Manual testing

Solution ManagereCATT

Solution ManagerBusiness Process Change Analyzer *

Application-logic Tests

Test Partner

QTP

eCATT

UI based Tests

Setup of businessprocess catalog

Business requirements

Identification of processes affectedby code / customizingchanges

Admin of automated tests

SAP TDMS

Setup of leantest systems

QTP

Test Scope IdentificationType of Change

Automated Tests

* Availability with SAP Solution Manager 7.0 EhP1

SAP 2008 / Page 3

The Extended Computer Aided Test Tool (eCATT)

The Extended Computer Aided Test Tool (eCATT) Successor of the Computer Aided Test Tool (CATT) Functional Test Tool for SAP Applications Shipped with SAP NetWeaver (Web AS 6.20 and higher) Integrated with the SAP Solution Manager & Test Workbench

It provides Testing of complex Business Process Scenarios Advanced Functionality to test Backend Business Logic Access to all Layers of the SAP System Architecture (Frontend, Service Testing, Application

Server, Database) Mechanisms for Test Data Storage that allow extended Reuse of Test Data Mechanisms for System Access that allow Reuse of Test Resources in multiple Systems and

System Landscapes Integration of external Tools (Certification Process) for extending reach to non-SAP

Applications, e.g. Browser, Desktop Applications

SAP 2008 / Page 4

E2E Integration Testing of SAP Solutions eCATT Test Automation

Testing of complex business process scenarios like Order-to-Cash and Procure-to-Pay Advanced functionality to test backend business logic (function modules, SOA services, test

result verification at SAP table / database level, result comparison with previous runs, ) Central definition via SAP Test Workbench combined with execution in distributed systems Central repository for test data

Strengths

Sales Order Billing &Payment ReceiptsReturn &

Complaint HandlingDelivery &Shipment

Business Processes

eCATT Test Automation eCATTScript 1

eCATTScript 2

eCATTScript 3

eCATTScript 4

Test Data Container

SAP System Landscape

Landscape 1 (Dev)

Landscape 2 (Test)

ParameterParameter Parameter

CRM Test 2CRM Test 2 R/3 Test 2R/3 Test 2 ERP Test 2ERP Test 2

CRM Dev 1CRM Dev 1 R/3 Dev 1R/3 Dev 1 ERP Dev 1ERP Dev 1

Import

included in 1 Test Configuration

Test Automation of SAP Business Processes via eCATT

SAP 2008 / Page 5

eCATT Test Automation Automated Tests for non-SAPGUI using HP QTP

Test Design

Test Execution

Launch eCATT and call HP QTP Record non-SAPGUI application via HP QTP + save script within eCATT

Work Center Test Management User executes assigned Tester Worklist

Test Worklist: Executionof eCATT Test Configuration

eCATT executes HP QTP script

QTP scripts executesnon-SAPGUI application

eCATT & QTP Test logs

Test Workbench: Test result reporting Manual tests Automated eCATT / HP QTP tests

SAP 2008 / Page 6

eCATT Test ConfigurationComposite Processes and Applications

SAP HCM

Packaged Solutions and Deployment View

Functional and Process Component View

Product Data Management

Lead Processing

Sales Order Processing

Opportunity Processing

Personel Administration

Payroll Processing

Demand Planning

Service Parts Planning

SAP ERP

SAP CRM

SAP SCM

Composites Higher flexibility and faster

application lifecycle lowers potential for automated testing (Effort Benefit Ratio)

Different UI technologies(Web Dynpro, Adobe Forms, ) to be supported by test tools

Application Landscape Decoupled UI from back-end allows

decoupling of test activities High potential for automated

regression testing of Web-Services without UI

Web-Services

Calls

E2E Integration Testing of SAP Solutions Test aspects of SOA based Composite Applications

SAP 2008 / Page 7

eCATT Test configuration

Backend System

*Details on: https://wiki.sdn.sap.com/wiki/display/ESpackages/Order+to+Cash

Step 2 Step 3 Step 4 Step 5 Step 9

Webservice Calls

Test Scripts

Test Data Containers

Test Parameter Import Export Import Export Import Export Import Export Import Export

Check

Import Export

Test Variants

Customer Product

WebServices Find

Customer

ViewCustomer

Details

FindCustomer

spec. Products

Read/Update Customer

spec. Products

CreateSales Order

Customer Name Customer Name Product Name Product Name QuantityQuantity Expected priceExpected price

E2E Integration Testing of SAP Solutions Testing a Service enabled Business Process using SAP eCATT

SAP 2008 / Page 8

SAP Solution Manager Launch of automated tests via Work center Test Management

Status Reporting

Work Center: Role-specific entry point for all test related activities

Test Coordinator

Quality Expert

Tester

VP of QA

SAP 2008 / Page 9

eCATT Test Coverage Technology & Tiers

Backend DatabaseTable operations

DataTable

Cust.Table

SAP GUI SAP CRM Web-UI, SAP Portal,

?Web Dynpro

ABAP Objects

BC Sets

SOA

eCATTBackendApplication Server

Frontend

Dynpro based UI

Function Library & BAPIs

SAP 2008 / Page 10

eCATT SpecialtieseCATT Specialties Business Logic TestsBusiness Logic Tests Mass TestingMass Testing

Test Data Management via flexible test data container

Set of specific customizing entries to check effects on business processes. Auto-reset after test execution.

Store & Compare allows result comparisons between multiple test executions

Message handling allows configurable activities after warnings / errors, especially for negative tests

Integration of 3rd party tools HP QTP Compuware TestPartner

Functional and regression tests of complex Business Process Scenarios like Order to Cash

Configurable and automated Test Script selection by SAP Release and Support Pack level to check SP dependencies

Business Logic tests without User-Interface

SOA web-services Function Modules and BAPIs

Verification of test results at SAP table level directly after document postings

Suitable to handle very high volumes of automated tests

Handling of distributed system landscapes

Central repository for eCATTtest cases and SAP system assignments

Test Configurations allow execution in complex system landscapes

Fast switching between system landscapes (Dev Test)

Archiving of test logs eCATT script distribution

via SAP transport system

High throughput via scheduled overnight mass tests for non-UI based tests

E2E Integration Testing of SAP Solutions Feature Highlights of SAP Solution Manager eCATT

SAP 2008 / Page 11

eCATT Some Highlights (1)

eCATT SpecialtieseCATT Specialties

Test Data Management via highly flexible Test Data Containers Versioning: Automated Test Script and Test Data Selection according to Application

Component, Release and Support Package in the System Under Test and/or according to Business Functions in the System Under Test

Message Handling allows configurable Activities after Messages, also for negative Tests eCATT allows to set specific Customizing Entries to check Effects on Business Processes.

An Auto-reset will be done after Test Execution.

Integration of 3rd Party Tools HP Quicktest Professional Compuware TestPartner

SAP 2008 / Page 12

eCATT Some Highlights (2)

Business Logic TestsBusiness Logic Tests

Functional and Regression Tests of complex Business Process Scenarios Tests on UI Level

SAP GUI for Windows SAP GUI for Java

Business Logic tests without User-Interface Planned: Web Dynpro ABAP Web Dynpro Java eSOA Web Services Business Objects Function Modules/ BAPIs ABAP Objects and plain ABAP

Verification of Test Results on SAP Database Level

SAP 2008 / Page 13

eCATT Some Highlights (3)

Mass TestingMass Testing

eCATT is suitable to handle very high Volumes of automated Tests Handling of distributed System Landscapes

Central Repository for eCATT Test Cases and SAP System Assignments Test Configurations allow Execution in complex System Landscapes Easy and fast Switching between System Landscapes by just one simple change before execution

Archiving of Test Logs Distribution of eCATT Objects via SAP Transport System High Throughput via scheduled overnight Mass Tests

End to End Integration Testing of SAP SolutionsAutomated Testing using eCATTE2E Integration Testing of SAP SolutionsThe Extended Computer Aided Test Tool (eCATT)E2E Integration Testing of SAP SolutionseCATT Test AutomationeCATT Test AutomationAutomated Tests for non-SAPGUI using HP QTPE2E Integration Testing of SAP SolutionsTest aspects of SOA based Composite ApplicationsE2E Integration Testing of SAP SolutionsTesting a Service enabled Business Process using SAP eCATTSAP Solution ManagerLaunch of automated tests via Work center Test ManagementeCATT Test Coverage Technology & TiersSlide Number 10eCATT Some Highlights (1)eCATT Some Highlights (2)eCATT Some Highlights (3)