©2011, Cognizant Oracle ERP HRMS Testing 108 countries Roll-out - Challenges & Best Practices - Sathish Rajamani - P R Shankar Oracle Testing
Dec 23, 2015
1
©2011, Cognizant
Dec 2011
©2011, Cognizant
Oracle ERP HRMS Testing108 countries Roll-out- Challenges & Best Practices
-Sathish Rajamani- P R Shankar
Oracle Testing
2 | ©2011, Cognizant 2
Contents
2
Background & Objectives
Application Landscape
5
6
Scope of Engagement
Challenges faced
1
3
4
Solution Approach5
Value adds to client6
Engagement summary7
3 | ©2011, Cognizant 3
Background & ObjectivesB
ackg
rou
nd
Ob
jecti
ves
Leading Biopharmaceutical company.
World-wide operations
Over 50,000 people with presence
across all continents
Company is rolling out Oracle ERP HCM
application covering 108 countries to
streamline the HR function
Ensure smooth rollout of HCM application
Quick time to market
Standardization of HR processes while catering to local/regional requirements.
Deliver in a complex, dynamic environment with business demands, requirements & priorities
Drive lower cost for rollout
QA Objectives
Comprehensive overall test strategy for this global roll-out
Consistency within client’s software quality organization
Maximized value from testing and minimize time spent by business-users
Business Objectives
4 | ©2011, Cognizant 4
I need an accelerated Testing Solution which meets my GTM and Quality benchmarks
I want to Automate my Oracle ERP Testing
Solution
I need assurance on the quality of my Oracle ERP Implementation and that it meets the requirements set out
I need an accelerated Testing Solution which meets my GTM and Quality benchmarks
Scope of the engagement
Testers do not have adequate
functional knowledge of the Oracle ERP
System & System Integration Testing
Engagement Objectives
Multi-lingual Testing
Interface Testing
UAT support
Pre-Release Testing
Global Release & Defect Management
Security Testing
Out of scope
Performance Testing
5 | ©2011, Cognizant 5
Modules in Scope
2010 2011 2012 2013 2014 2015
Core HR (Cluster – 0) (For non-Payroll countries)
Core HR Recruitment Assignment Mgmt Time mgmt Learning ManagementPayroll
Modules in focus
Stock options moduleBenefits & RP
OM , PA, Time Management (Cluster – 3 & 4)
Payroll (Cluster 4 & 5)
OM , PA, Time Management (Cluster – 1 & 2)
Payroll (Cluster 1 & 2)
Rect. Learning Mgmt (Cluster 1 & 2)
Rewarding performance (Cluster 3 & 4)
Rect. Learning Mgmt (Cluster 3 & 4)
Rewarding performance (Cluster 3 & 4)
6 | ©2011, Cognizant 6
Seasonal events to synchronize
7 | ©2011, Cognizant 7
Engagement Summary
Oct ‘10
Jan’11
Apr ‘11
Jul’11
Project Kick off
• Test Lab to exhibit capabilities
• Project Started
First Release
• International Assignment Employee Testing
• Interface Testing
Aug’11
Nov ‘10
WAVE 1
• Belgium
• Spain
• Portugal
Mar’11
Regression Testing
• Belgium
• Spain
• Portugal
• Switzerland
• Italy
• Turkey
• France
WAVE 2
• Norway
• Denmark
• Finland
Mid release
• Test Script Preparation
• Regression Testing
Sep - Nov’11
WAVE 3
• Philippines
• Malaysia
• Indonesia
• South Korea
• Vietnam
• Hong Kong
• New Zealand
• Thailand
• India
• Singapore
• Australia
• Talent Suite ( PM, RP Learning) for Wave 1 to 3 Countries
WAVE 4
Dec - Mar’12
WAVE 2
• 50 countries
• Recruitment
• Talent Suite ( PM, Rewards Learning) for all Wave Countries
8 | ©2011, Cognizant 8
I need an accelerated Testing Solution which meets my GTM and Quality benchmarks
I need someone to guide me on
how to Improve my Oracle ERP
Testing Organization and
Processes
I want to Automate my Oracle ERP Testing
Solution
My Oracle ERP Testing processes are
not aligned to Industry Standards
Testers do not have adequate
functional knowledge of the Oracle ERPI want to Automate my Oracle ERP
Testing Solution
I need assurance on the quality of my Oracle ERP Implementation and that it meets the requirements set out
I need an accelerated Testing Solution which meets my GTM and Quality benchmarks
I need someone to guide me on how
to extend and enhance my Oracle ERP
Testing Organization and Processes I want to reduce the Total Cost of
Ownership for QA activities
I need someone to guide me on
creating an On Demand Test Model
with optimizations while maintaining
consistency in processes and metrics
Testing HRMS systems - Challenges FacedC
halle
ng
es
face
d
Incomplete requirements (specifically local/regional/statutory requirements)
Execution in a multi-vendor scenario
Complex Implementations - involving multiple business processes, integration with external applications and geographies.
Test data preparation:
Identification of meaningful data sets for repeat test execution
Maximum scenario coverage
Test Automation: Tool limitations and application dependencies
Data Privacy – HR, Payroll , Benefits & other modules
End-to-End Test Management
Test Planning
Metrics – Comprehensive set of Metrics for informed decision making
Multi-lingual testing
9 | ©2011, Cognizant 9
Solution – Recommended approach
Complex implementations– involving multiple countries and multi-lingual users across an organization.
Challenges
Model Driven Approach to Testing
Seeding of functional experts and business users within the delivery teams
Two pronged approach – Globalization & Localization
Engaged translators & localites
Tool-agnostic Framework driven automation
Integrate various tools with each other and also with Project planning tool
Using our in-house tool to identify optimum number of datasets for data generation
Data scrambler tool/ tool to mask sensitive fields
Approach
End to end Test Management
Test data preparation
Data Privacy issues
Automation Challenges
Augment team with skilled testers along with business-users
Functional competency for testers
Business requirements are sometimes missed; business scenarios are not detailed enough
10 | ©2011, Cognizant 10
Solutions and Processes Challenges & Complexities Solutions approach
Commonly used languages across
French (France/Canada/Belgium/ African countries)
German (Germany/Switzerland/Austria)
Spanish (Different in Spain & different Spanish in Latin American countries)
One-off languages (many)
Testing with the help of interpreters
Creation of Test cases, Test Data, Reports
Execution by QA team with oversight by interpreters
Test results validation
Comparing test scripts using English & Application
Validation for foreign language characters
Operating systems
Check and compare with English scripts and results
Check results using error messages obtained from commonly used languages and corresponding error numbers to fix issues.
Testing country specific modules Internationalization & Localization
Globalized Test Cases
Localization to suit local countries
Multi-lingual testing Decisions Involving foreign
language testing
Cultural
Multi-lingual testing using Interpreters Localities
Multi-lingual testing Technical methods
11 | ©2011, Cognizant 11
Solution & ProcessesChallenges & Complexities Solutions approach
• Continuous functionality enhancements causing changes to systems landscape.
• Managing multiple upstream, downstream applications & interfaces
• Shorter testing window due to schedule over-run
• Data privacy
• Blend of skilled people
• End-users, Testers and Testers with additional language
• Risk based testing
• Leveraged Cognizant test accelerators
• Automation
• Data scrambler tool
Technical
• Resistance to change
• A number of countries that are new to ERP implementation & has no process or tools to testing.
• Ensure compliance to corporate QA standards and philosophy.
• Managing multiple sets of global & regional business units.
• Managing multiple business partners and acquired entities.
• Operating in 16X6 mode and in 9 different time zones.
• Testing Center of Excellence
• Quality measures through business leaders support
• Region specific initiativesOrganizational
12 | ©2011, Cognizant 12
Value-adds to Client
LN EBPS -Cognizant Partnership
Oracle Platinum partner Expertise on processes, Methodologies and Artefacts
Relationship with Oracle
Heterogeneous talent pool of career testers Innovative tools and techniques to provide accelerated
testing solutions
Testing Capability
Our Commitment
Committed ‘Release-on-Release’ productivity gains Dedicated Innovation charters & teams Seeding of Business Users in delivery teams to act as
product experts at offshore
Solution Accelerators
Visual modeling and Risk Based Testing enabling tool
Test repository for delivered functionalities Tool agnostic proprietary automation Framework Data sensitivity - Data scrambler tool
13 | ©2011, Cognizant 13
I want to Automate my Oracle ERP Testing
SolutionI need someone to guide me on
creating an On Demand Test Model
with optimizations while maintaining
consistency in processes and metrics
Client Appreciation
''Microsoft Word does not have a font big enough to show the gratitude I have for all of you. In the midst of insurmountable challenges you collectively triumph and continue to deliver quality work on the Oracle ERP HRMS project. Your dedication to this project including sacrificing your nights and weekends is commendable. Thanks to you, this important effort met our objectives as a company as we move forward. Your accomplishment is another great example of how innovative thinking and teamwork by QA can help move our company forward.
Thank you for continuing to do an exceptional job!
QA Manager
14
©2011, Cognizant
Thank you