© 2009 Wipro Ltd - Confidential Test Automation in Oracle E-Business Suite Projects Step-Auto Conference December 08, 2011.

© 2009 Wipro Ltd - Confidential

Test Automation in Oracle E-Business

Suite Projects

Step-Auto ConferenceDecember 08, 2011

© 2009 Wipro Ltd - Confidential2 © 2009 Wipro Ltd - Confidential2

Presentation Context• Key Imperatives of Test Automation• Test Automation Considerations• Criteria for Selecting Test Automation Candidates• Test Automation Tools• Test Automation Approach• Test Automation Framework• Benefits of Test Automation • Test Automation ROI – A Holistic View• Accelerators / Ready to Use Solutions

Case Study

Introduction

Agenda


Introduction

Oracle E-Business Suite Test Automation - Objective

Oracle E-Business Suite Testing challenges are manifold with the growing complexity of E-Business Suite (EBS) implementations, reduction in IT budgets, increased emphasis on better test coverage, reduction in risk to application quality, test efficiency and accelerated test cycles. The objective of test automation is to alleviate some of the above testing challenges

Oracle E-Business Suite is a strong ERP system in the market today with rich functionalities amply covering Supply Chain Management, Financials, Manufacturing, Human Resource Management, Customer Relationship Management, etc.

Organizations across the world choose an ERP solutions such as Oracle E-Business Suite to implement their core business operations due to various reasons.

Consolidate various legacy applications into a single ERP system. This provides an opportunity for greater interactions across business areas in the organization, eliminates redundancies, and provides an enterprise wide view.

Implement evolved and proven best practices delivered through ERP systems

Optimize resources and reduce cost of application maintenance


Key Imperatives of Test Automation

The need for multiple rounds of regression testing during phased releases/rollouts.

Pressure for a quick go-to market from business team Sufficient test coverage to ensure a smooth release Optimize testing efforts and reduce cost

Oracle E-Business Suite application implementations usually have a long roadmap and require steady maintenance across its life cycle. Once implemented the application undergoes upgrades, patch installs, application enhancements, rollouts to new business units/regions and other major/minor releases involving defect fixes & change requests.

A robust and reliable regression test suite (consisting manual and automated test scripts) is usually maintained for large Oracle E-Business Suite implementations to efficiently handle regression testing requirements during releases.


Test Automation Considerations

TEST AUTOMATION TOOLS & FRAMEWORKS• BEST PRACTICES IN EBS TEST AUTOMATION• COMMON FRAMEWORK & PROCESSES• SCRIPTING GUIDELINES• TEST AUTOMATION DESIGN • TOOLS SUPPORT FOR ORACLE EBS

ALIGN TO PROGRAM ROADMAP• REGRESSION INFLECTION POINT• ORACLE EBS APPLICATION STABILITY• ORACLE EBS RELEASE SHEDULES

OPTIMIZE AUTOMATION COVERAGE• ORACLE EBS RELEASE PRIOROTIES• ORACLE EBS STABLE FUNCTIONALITIES• PAST DEFECTS• DEFECT PROPOGATION• CORE BUSINESS PROCESSES IMPLEMENTED

USING ORACLE EBS

ROI BASED APPROACH• OPTIMIZE TESTING EFFORT & COST• REDUCE TEST CYCLE TIME • REDUCE REQURIEMENTS FOR ORACLE E-

BUSINESS SUITE SUBJECT MATTER EXPERTS DURING TESTING

WHY WHAT

HOWWHEN

The decision for an Oracle E-Business Suite regression test automation is usually taken based on a test automation feasibility analysis.


Test Automation Considerations (Contd..)

• Regression Testing efforts significantly increase as the Oracle EBS application become more and more complex after new functionalities/ customizations are introduced during releases.

• It is recommended that we identify an inflection point in order to efficiently address regression testing efforts.

• Test automation is a key enabler for the testing team to address this challenge.

• The master test strategy should estimate/establish the timeline for this inflection point.


Criteria for selecting candidates for test automation

• Repeatability of a test case: The test case is part of the regression test suite executed during every Oracle EBS release

• Functional Stability: Previous defect history will indicate whether a functionality implemented using Oracle EBS is stable or not.

• Bulky tests: High setup efforts required. For example , a lot of pre-requisite data needs to be populated to perform test

• Batch execution: Group of tests to be executed sequentially to ensure core functionalities. For example: A group of transactions executed during smoke test.

• Error prone functionalities: Testing is done iteratively using multiple data sets to validate a specific Oracle EBS functionality.

As a general rule, automate test cases where there is an opportunity for a high ROI.


Test Automation Tools

Popular test tools which support Oracle E-Business Suite test automation include HP Quick Test Pro, Oracle Functional Test, IBM Rational Functional Tester, Microfocus tools etc.

SL Feature Remarks

1 Ease of Use

• Tool is easy to use

• Doesn’t require a high learning curve

• Use of easy and popular scripting language

• Enable re-use of code

2 Tool Compatibility

• Provide the required support test automation on Web & Oracle forms based applications.

• Tools provide accelerators to support to perform Oracle EBS test automation

3 Tool Scalability

• Allow manual scripting to enhance automated scripts when required.

• Availability of function libraries to support scripting for various requirements

4 Tool Licensing

• Low cost for tool licenses and annual support

• Evaluate license cost models (Perpetual, term licenses, etc)

5Market Space & Resource Availability

• Popular and proven tool

• Easy availability of resources

6Test Tool Maintenance

• Low maintenance effort

• Maintaining multiple tools will add to the annual maintenance support cost

7 Tool Support • Better support implies quick issue resolution

• Online forms and user groups

8Integration with Other tools

• Strong integration with test management tool, defect tracking tool, etc

Test Tools - Evaluation CriteriaTest Tools - Market Overview


Test Automation Approach

• The best automation solution for any Oracle E-Business Suite test automation should balance the cost/risk of defects to business operations against the overall costs and duration of extensive testing.

• The goals are to maximize the value from the testing done, and to minimize the testing effort and duration to an acceptable level of risk.


Test Automation Framework

• The delivery of a robust automation solution is dependent on the ability to achieve high productivity and scalability with a predictable performance.

• The design of the automation framework is critical to the success of any automation project.

• The recommended test automation framework for Oracle EBS automation would be a Hybrid framework where Strengths of a traditional data driven/keyword driven and functional decomposition models are combined and weaknesses mitigated.

Oracle EBS Test Automation Framework – A Sample Representation


Benefits of Test Automation

• An Automated Regression Test Suite for Oracle EBS available on demand during Oracle EBS application releases.

• Reduced regression test efforts and cycle time. Reduced efforts implies cost savings & reduced regression test cycles implies faster go-to-market

• Increased test maturity and test efficiency through test automation• Minimal Oracle SME bandwidth needed during regression test cycles


Drivers Direct Benefits Indirect Benefits One time Cost Recurring Cost

People • Savings in staffing costs due to efficient redeployment of workforce

• Motivated workforce, increased customer satisfaction

• Cost of training staff on Test Automation tools

• Staffing costs for Automated Script development

• Staffing costs for automation script maintenance process

Process • Savings in testing lifecycle costs due to reduced execution time

• Enhanced process efficiency, innovations

• Costs for establishing new processes (workflow, configuration management, process management, etc.)

Not Applicable

Technology

• Improved productivity due to additional test cycles within a given schedule

• Lower application lifecycle costs resulting from improved application quality

• Cost of hardware and software Licenses for test automation

• Cost of maintaining hardware and software

MANUAL REGRESSION

TIMELINES

EFFO

RTS

AUTOMATED REGRESSION

Test Automation ROI – A Holistic View


• The level of customization on an Oracle E-Business Suite depends on how well the Organization’s business processes are aligned with Oracle processes.

• Most of the organizations leverages Oracle vanilla functionalities and minimizes customizations as they prove costly during maintenance/steady phase.

• Use of ready-to-use automated test scripts for Oracle Vanilla functionalities can help accelerate the test script development process.

• Wipro’s re-usable test repository built for Oracle E-Business Suite known as WiSTA (Wipro’s Standard Test Accelerator) for Oracle

Accelerators / Ready to Use Solutions

• Scripts are developed using HP QTP and can be leveraged during automated test script development for Oracle EBS R11.5.x & R12.1.x . Business components are deployable with minimum customization

• An average 25-35% reduction in test script development efforts (data gathered from existing projects employing WiSTA)


Case Study

Automated testing of Oracle E-Business Suite performed for a US based Customer

Requirement• Automate majority regression test scripts designed for Oracle EBS • Automated testing for Oracle EBS major/minor releases• End to End Order Fulfillment process • Majority of the Oracle Sourcing components• Oracle Setups and Process enablement• Maintenance of test scripts and repositories

Key Highlights • Resources – 16 FTE Peak team (manual + automation)• Oracle R11.5.10• Location: US and India• Fixed Price Project


Benefits• 40% of manual test execution time is reduced through automated scripts. 80% scripts used in every monthly/quarterly test cycle

• Supply Chain Visibility Content Check process testing time reduced from 40 PHrs to 4 hours post automation

• 2000+ orders processed by automated test scripts ~900+ PHrs reduction

• 75% time reduction in Oracle Inventory Org setup process ~ 100+ PHrs reduction

• 60% time reduction in Supply Chain content check process ~ 400+ PHrs reduction

• 60% time reduction in Sourcing RFQ E2E process ~ 100+ PHrs saved per test cycle

• 200+ reports generated using 15 scripts

Case Study (Contd...)

© 2009 Wipro Ltd - Confidential

Thank You

© 2009 Wipro Ltd - Confidential Test Automation in Oracle E-Business Suite Projects Step-Auto Conference December 08, 2011.

Documents

confidential test automation

objective of test automation

test efficiency

reliable regression

better test coverage

automated test scripts

accelerated test cycles

business areas