Large-scale Test Automation Production. Test Automation is No Longer Optional. Automated Exploratory Tests or Structured Automated Tests Which One is Better and Can You Do Both? June 16 th , 2010 – San Mateo, CA Cem Kaner - Hung Q. Nguyen Moderated by Michael Hackett. - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
2. Production Cost = *One-time Cost + **Recurring Cost*NEW–One-time Cost of Design, Implementation & Execution
– Test Case or Test Script Creation » Test line creation » Sequencing test logic or order of test lines (test steps) » Testing and debugging test script
– Function or Keyword Creation – Interface Capturing or Mapping – Test Dataset Creation
**EXISTING—Recurring Cost Test Execution & Maintenance Cost – Monitoring test suit execution – Investigating and troubleshooting false negatives – Maintaining Test Case or Test Script
» Test line modification » Updating test logic or re-sequencing order of test lines (test steps) » Testing and debugging updated test script » Function or Keyword Modification » Interface Recapturing or Remapping » Test Dataset Modification
Automation is Method-Centric—it is more than about the technology; it is about the effective application of technology– Maintainability—handling high rate-of-change– Reusability—ability to reuse common test
components without having to program/code– Scalability—ability to automate high volume of tests
through reusability (and team-based cost efficiency)– Visibility
• Tests auditable by management and non-programmer staff• Productivity is structurally measurable
• Effective automation can allow tests to support agile system development
• Automation should not dominate. Don't make it into an "agile automation" project
• A keyword driven method is, in my view, essential for successful test development w/ automation in agile development– Automation is separate from test development– Usually doesn’t need user interaction (only some with testers)– Automation focuses on actions, not on tests
2. Don’t underestimate the challenge of keeping maintenance costs low
3. You need to get efficient—optimize your volume of test to exceed 50% coverage
4. Efficiency is key, and it will come from excellent test design and automation methodology (e.g., action-driven), and a well architected framework technology
5. Minimize programming tests
6. High scalability comes from high reusability of common “actions” and team-based staffing model
7. High maintainability comes from keeping maintenance activities at the lowest level
8. High visibility in your automation program to give you control and measurability, which ultimately leads to manageability
9. Practice just-in-time automation
10. Have a global test-design scheme that separate test objectives from test cases; and automation from test development
LogiGear is a world leader in high-volume software test automation production, serving hundreds of companies, from Fortune 100 to startups.
Draw from 15+ years of research and practice, 5 books, including one bestseller, 18 pragmatic training courses, a proven automation methodology and a software framework that elevates automation test coverage to exceed 95% on a diverse set of technology platforms, and 400+ skilled engineers in the US and Vietnam, it delivers unbeatable value that precisely meets each customer’s specific needs.