ashwiniphalle-mobileapplicationtesting-120408234929-phpapp02

7/30/2019 ashwiniphalle-mobileapplicationtesting-120408234929-phpapp02

1/15

Mobile Application Testing : Challenges &Solutions

Ashwini Phalle


2/15

1. Mobile Testing The

Need

2. Mobile Application

overview

3. Mobile Application

TestingRequirements

4. Testing Challenges

5. Possible Solutions

2


3/15

The Mobile Testing The Need

Brand new devices smart phones, tablets being released every week

Analysts at Forrester Research predicted within a few years, the mobilechannel will displace the online channel for day-to-day banking tasks

Mobile apps have limited computing resources still need to be agile and

reliable

Complex mobile environment: Devices, OS, Carries

3


4/15

Mobile ApplicationTest Requirements

4


5/15

Functional & UI related testing

UI functional Testing

System Testing

Regression Testing

Usability Testing

Usability of applications functionality

Usability with various devices

External factor (Device related) testing

Device Related Testing: Battery, SD card interactions,

Voice Call Handling, SMS Handling, Notif ications

External incoming communications Infrared etc

Performance Testing

Application response time

Use of resourcesApplication loading speed

Security Testing

Security Testing for financial apps

Authentication checks

Mobile Application Test Requirements

5


6/15

Mobile TestingChallenges

6


7/15

Mobile Test Environment Elements

7


8/15

Featu

res

OS & Browsers

Device Models

Locations

1. Increased

Testing

Cost

2. Increased

Testing

Efforts

3. Devices at

multiplelocations

Not

Feasible

Mobile Testing Matrix

8


9/15

Possible Solutions

9


10/15

Test Effort Optimization Through Prioritization

Risk Based Testing approach for optimized Testing Effort : With weighted Device Platform Matrix Testing Requirement and application types matrix Test Cases Business priority matrix

Device

OS

RelativeImportanc

e

OS1 OS2 OS3 OS4 OS5

Relative

Importance1 2 3 4 5

Device11

Device22

Device3

3

Device44

App

TestingType

RelativeImportanc

eFinancial Native Webapp App4 App5

Relative

Importance1 2 3 4 5

Functional 1

Usability 2

ExternalFactors

3

Performance

4

Security

10


11/15

Mobile devices with different resolutions, screen sizes and browser implementations

Good for finding browser\platform specific bugs

Test the apps on device emulators, interact with OS, access in browser simulators

Note :

Not all activities can be realisticallyemulated

Mobile apps can exhibit different behavioron device due to

Due to lower device power and memory, Different DPI resolution

Not for Usability Testing

Mobile Emulators

11


12/15

Crowd-sourced Mobile Testing

Community that serves as a virtual

testing team or as an on-demandextension for in-house QA departments

Mobile Could

Remote device access service, gives

online access to numerous real devices

on various networks

Perfectomobile.com

DeviceAnywhere.com

Outsourcing

12


13/15

Best Practices

13


14/15

Browser metrics: Subject to change - depends on changes in technology, popularity ofthe browser, performance issues

Device popularity:Analysis on the popular devices in the market, metrics are going tochange frequently

Metrics for regions, carriers:Analysis for device/carrier popularity in terms of web

traffic from devices in particular countries and regions

Test on desktop browser first for early bug detection

Testing at an early stage for the priority devices from the metrics

Test on emulator then on device for device specific bugs

Early Usability testing on multiple devices

Performance Testing on different device and carrier mix based on country andregion

Best Practices

14


15/15

Q & A

15

ashwiniphalle-mobileapplicationtesting-120408234929-phpapp02

Documents