W8 Track 4/28/2010 1:45 PM "Test Automation Success: Choosing the Right People and Process" Presented by: Kiran Pyneni Aetna, Inc. Brought to you by: 330 Corporate Way, Suite 300, Orange Park, FL 32073 888‐268‐8770 ∙ 904‐278‐0524 ∙ [email protected]∙ www.sqe.com
13
Embed
Test Automation Success: Choosing the Right People and …Test Automation Success: Choosing the Right People & Process Kiran Pyneni, Automation Manager Aetna, Inc. Agenda Automation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
W8 Track 4/28/2010 1:45 PM
"Test Automation Success: Choosing the Right People and Process"
Presented by:
Kiran Pyneni Aetna, Inc.
Brought to you by:
330 Corporate Way, Suite 300, Orange Park, FL 32073 888‐268‐8770 ∙ 904‐278‐0524 ∙ [email protected] ∙ www.sqe.com
Kiran Pyneni
As senior QA manager at Aetna, Kiran Pyneni is responsible for improving test organization efficiencies through automation. Kiran leads a team of innovative automation enablers responsible for driving automation across Aetna. Prior to joining Aetna, Kiran had several roles: software developer, senior tester, testing architect, QA lead, and delivery manager for Fortune 500 organizations. Kiran was an invited speaker at the HP Software Universe 2009 USA Conference speaking about automation testing.
1
Test Automation Success: Choosing the Right People & Process
• Aetna is one of the nation's leading diversified health care benefits companies, serving members with information and resources to help them make better informed decisions about their health care.
P d t d t P• Products and management Programs:– Aetna offers a broad range of insurance and employee benefits products. – The first national, full-service health insurer to offer a consumer-directed health
plan, Aetna continues to lead the way with its Aetna HealthFund2 line of products, including HSA, HRA and RRA options.
– Aetna offers a wide array of programs and services that help control rising employee benefits costs while striving to improve the quality of health care, such as case management; disease and patient safety programs; integrated medical, dental, pharmaceutical, behavioral health and disability information.
– Aetna provides members with access to convenient tools and easy-to-understand information that can help them make better-informed decisions about their healthinformation that can help them make better informed decisions about their health and financial wellbeing.
3
Automation TeamImproves efficiencies and quality at our organization by automating consistent and repeatable manual tasks using industry standard technologies / tools / frameworks.
AutomationTeam
Assessments & DesignsReports & Metrics
Standards & Best Practices
Automation Development &
Maintenance
3
Automation Objectives
AutomationObjectives
Automating Right Tasks
Sustaining and Growing Automation Suite
Utilization of existing automation
Our Journey…
Decentralized Approach Centralized Approach
• Benefits– Easy identification of
automation opportunities
• Benefits– Standardization of automation
tool set at enterprise levelautomation opportunities– Higher collaboration between
application & automation teams• Challenges
– Automation development has become expensive
– Usage of different tools & solutions
– Standards & Best practices are not shared across applications
tool set at enterprise level– Sharing of coding best practices,
templates and standards– Cost of automation development
is lowered• Challenges
– Slower automation coverage progression
– Lower automated scripts utilization
– Funding Challenges
4
Our Journey Cont’d. –Challenges & Solutions
Challenges• Identification of automation opportunities Challenges
• Early completion of maintenance for• Prioritization of automation projects based on ROI
• Cost of automation
• Implementation of optimized designs
• Early completion of maintenance forautomation scripts
• Funding for automation projects
• Collaboration between automation & business teams
Solution• Structuring automation as strategy &
delivery team
Solution• Create automation life cycle process and
integrate with company's overall software development life cycle
Automation Team Structure
Automation Team
Automation St t T
AutomationD li TStrategy Team Delivery Team
5
Automation Strategy Team
• Definition:– To provide automation strategic direction and identify
potential new automation opportunities
• Characteristics:– Project management experience– Various automation frameworks/tools knowledge– Ability to manage multiple projects in parallel– Very strong written and verbal communication skills– Very strong leadership and analytical skills
• Activities:– Process & Best Practices– Assessment & Strategies– Design Solutions & Techniquesg q– Estimations & Planning– ROI Cost/Benefit Analysis– Reports & Metrics– Tool Technical Support & Analysis
Automation Delivery Team
• Definition:– To develop, deliver, and maintain automation solutions
• Characteristics:– Understanding of programming principles and best U de sta d g o p og a g p c p es a d best
practices– Knowledge of various automation tools– Knowledge of multiple programming languages– Strong communication skills
• Activities:– Scripts Development– Scripts Maintenance– Coding Standards– Scripts Planning & Execution p g– Day to Day interactions w/End User
6
Benefits of Teams Strategy
Benefits
• Easy identification of automation opportunities• Easy identification of automation opportunities• Prioritization of automation projects based on ROI• Improved automation design• Optimized the cost of automation• Clearly defined roles & responsibilitiesy• Better communication process• Optimized automation project planning
Automation Evaluation
• Understand functionality of the project / application
• Understand testing
Phas
es
Automation Preparation
• Identify the resources needed.
• Understand the requirements with the help
Automation Generation
• Create Business Process Test (BPT) components
• Parameterize test data in BPT components
• Unit testing of automation
Execution & Acceptance
Automation Lifecycle
G1 G2 G3
• Understand testing processes
• Understand target environments
• Understand test data details
• Verify automation tool compatibility
• Identify Automation opportunities
Activ
ities
requirements with the help application demos.
• Create automation framework / design
• Identify timelines and milestones
• Training required for automation tools
• Tool installation if required
• Access & Environment Setup
BPT components
• Review components for quality and correctness
• String the BPT components together to create a test script
• Develop automation scripts for BPT components
• Identify test data to conduct unit & acceptance testing
automation
• Deliver automation to application team
• Execute automation by application team
• Validation of ROI
• Retrospection
• Sign off
• Preliminary Estimations• Automation Test Strategy• Business Case - ROI• Selected automation tool• Detailed Estimations• Go, No Go