Next Gen Testing Conference Singapore Mobile Test Automation : Questions to Ask when Picking the Right Tool Brynley Scully , Head of Testing, Singapore Rupesh More , Test Lead Hewlett - Packard Oct - 2014 www.unicomlearning.com 10
Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool
Jul 01, 2015
Presentation at Next Generation Testing Conference Singapore on 30-Oct-2014. The presentation lists down 10 questions that one should ask to the tools vendor and to the business requirements when evaluating and selecting a suitable mobile test automation tool.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Next Gen Testing Conference Singapore
Mobile Test Automation :Questionsto Ask when
Picking the Right Tool
Brynley Scully, Head of Testing, Singapore
Rupesh More, Test Lead
Hewlett-Packard
Oct-2014
www.unicomlearning.com
10
2
Mobile Test Automation
Growth in Mobility
4
Growth in Mobility
5
Mobile Devices in our Daily Life
PCs dominate working hours
Tabletsrule the home
Smartphonesbridge the gaps
Tablets
Smartphones
PCs
6
Growth in Mobility2014 total smartphone subscribers
1,064 million
394 million
213 million
US Europe Asia Pacific
Source: Forrester. “The State of Digital Business in Asia Pacific in 2014”, dated August 2014.
The Need for Mobility Testing
8
Mobility App Testing Coverage
9
Why Automate Mobile Testing?
SpeedFaster Regression test cycles
Unattended test execution
ScopeRepeated execution of test cases across devices, OS, network, browsers
Many checkpoints and validation points in test steps
RiskReduced risk of human errors in test execution
Mobile Test Automation10 Questions to Ask whenPicking The Right Tool
11
Picking the Right ToolChoices, choices, choices
Mobile Automation Tool
?
12
1. Software License Type & Costs ?
Open Source vs Commercial
Seat vs Concurrent
Single vs Multiple Platform
Term vs Annual
AddOn Costs
13
2. Compatible with Automation Scripting Tools ?
Mobile Automation Tool
HP UFT
HP UFT
14
3. Test on Real Devices and/or Emulators ?
Mobile Automation Tool
Real Device
Emulator
15
4. Test on Single or Multiple Mobile Platforms ?
Mobile Automation Tool
16
5. Type of Mobile Application ?
Mobile Automation Tool
Native
Web / HTML5
Hybrid
17
6. Type of Connectivity to Real Devices ?
Mobile Automation Tool
Cloud
WIFI
USB
18
7. Need Additional Hardware and/or Software ?
Mobile Automation Tool
Cloud
WIFI
USB
iOS
emulator
Android emulator
No additional hardware
No additional hardware
USB cables
Mac machine
Windows PC
19
7. Need Additional Hardware and/or Software ?
Mobile Automation Tool
Additional Software
Instrument the App
Why ?
How ?
− By developer
− Self instrument
− SDK needed
− Mac needed for IOS devices
− PC needed for Android devices
20
7. Need Additional Hardware and/or Software ?
Mobile Automation Tool
Additional Software
Instrument the App
Why ?
How ?
− By developer
− Self instrument
− SDK needed
− Mac needed for IOS devices
− PC needed for Android devices
21
7. Need Additional Hardware and/or Software ?
Mobile Automation Tool
Need to install agent software on devices or emulators?
22
8. Object Recognition Methods ?
Mobile Automation Tool
OCR – based on text displayed in application.
Object ID Recognition – based on object properties. Unique ID used to locate and tag the object.
23
9. Same Script on Multiple Platforms ?
Mobile Automation Tool
Same Script
No editing
Runs on multiple platforms
24
10. Results with Screenshots and/or Videos ?
Mobile Automation Tool
Screen shots
Videos
25
10 Questions To Ask when Picking the Right Tool
1. Software License Type & Costs ?
2. Compatible with Automation Scripting Tools ?
3. Test on Real Devices and/or Emulators ?
4. Test on Single or Multiple Mobile Platforms ?
5. Type of Connectivity to Real Devices ?
6. Type of Mobile Application ?
7. Need Additional Hardware and/or Software ?
8. Object Recognition Methods ?
9. Same Script on Multiple Platforms ?
10. Results with Screenshots and/or Videos ?
26
Harness Benefits from the Tool
1. Do not use Record-and-Playback
2. Use Advanced Frameworks ; Insert many checkpoints
3. Script for compatibility across multiple platforms
4. Repeat execution runs across different devices, browsers, OS versions
5. Complement automation testing with manual testing and emulator testing
27
Select your Testing Service Vendor
1 Where to Test? Onshore / Offshore
2 Testers Experience Mobile test tools; mobile testing projects; relevant industry
3 Testing Commercial Models Staff Augmentation, Managed Service, Testing-as-a-Service
4 Mobile Test Strategy Manual testing, automated testing, performance & load testing, network testing, security testing, emulator testing
Demo
29
Demo : Overview
Mobile Test Automation Tool
HP UFT HP UFT Mobile Airline Ticket Booking Mobile App
Devices on Cloud
Screenshots
Videos
30
Demo : Addressing the 10 Questions
1. Software License Type & Costs ? Annual, Concurrent, Multiple Platforms
2. Compatibility with Automation Scripting Tools ? Yes. HP-UFT, HP-ALM
3. Test on Real Devices and/or Emulators ? Yes. Testing on Real device.
4. Test on Single or Multiple Mobile Platforms ? Yes. iOS, Android, Windows
5. Type of Mobile Application Supported? All. Native, Hybrid & Web
6. Type of Connectivity to Real Devices ? Cloud, USB, WIFI
7. Need Additional Hardware and/or Software ? No
8. Object Recognition Methods ? OCR, Object ID
9. Same script on multiple platforms ? Yes
10. Results with screenshots and/or videos ? Screenshots and Videos
Next Gen Testing Conference Singapore
Mobile Test Automation :Questionsto Ask when
Picking the Right Tool
Brynley Scully, Head of Testing, Singapore
Rupesh More, Test Lead
Hewlett-Packard
Oct-2014
www.unicomlearning.com
10
Related Documents
