Efficiency of mobile application testing with effectiveness of tools

INDIUM SOFTWAREAn Independent Software Testing Firm

Efficiency of Mobile Application Testing with Effectiveness of Tools

“Business Assurance through Quality Assurance”

© 2014 Indium Software

ENHANCING SOFTWARE QUALITY

2

Agenda

Why Mobile Testing?

Testing Challenges

Mobile Manual Testing Flaws

Mobile Test Approach

Web Services Testing – REST Client

Automation Tools for Mobile Application

Monkey Talk – Android

Test Studio – IOS

Mobile App Testing Tools Effectiveness

Key Takeaways



3

Why mobile testing?

The explosion of mobile internet, with the advent of Smartphone’s in the market

Download rate of the mobile applications

Ensures user expectations and applications execute properly

Conduct device testing to make sure mobile applications performance



4

Testing Challenges

Multiple platforms and browsers

Rendering and installation challenges

Devices with various active applications Different pixel density and resolution

Different input methods like QWERTY, touch

Different device mode (sleep, lock)

• Multiple network types (e.g., GSM/GPRS/Wi-Fi/Wi-Max)

• Different speeds of connectivity across geographies

• Multiple network operators with customized network features

• Network switching

Device Diversity

Network Challenges

• Limitations in processing speed

• Limitations of mobile memory size

• Differences in device communication protocols (e.g., WAP/HTTP)

• Multifunctioning and interactions

Hardware Challenges



5

Mobile Manual Testing Flaws

Slippage in Test Schedule

Less Productivity

Increase in Cost

Inadequate Test Coverage

Limited execution for code changes



6

Mobile Test Approach

Web Services Test Approach

Automation Test Approach



7

Web Services Testing – REST Client

Web Services Functional Testing with REST : To ensure the functional points and field

validations Opportunities for security error and validate the

Response time of UI Testing Web Services is supported via the REST Client Default bundled plugin in Google chrome



8

Web Services Testing – Cont’d

REST Client

GET POST



9

Automation Tools for Mobile Testing



10

Readiness Checklist

InstallationInstallation

Device Compatibility

Installation & Network

Multi Functioning

Interruptions

User Interface

Monkey

TaLk

Test

Studio



11

Monkey Talk - Android

• Modified through table view/Monkey talk language/ Java script

• Used for regression testing

• IDE – Eclipse based tool to records the script

• Monkey Talk Agents are libraries for Android

• Test Native Hybrid & web application

• Manages test suits on simulators , Emulators and Devices

• Robust & Cross platform tool

• Record and playback scripts

Automation Tool

Mobile applicati

ons

Monkey Talk script

Primary Compone

nts



12

Monkey Talk - Android – Cont’d

Pros Cons Used for testing on an actual

device Require some knowledge of the

application code

Monkey Talk can take screenshots for offline analysis & used to control multiple devices at the same time

Monkey Talk is a low level API based tool



13

Test Studio - IOS

•Supports dev platforms Xamarin.iOS, PhoneGap, Xcode

•Used for regression testing

• Testing solution for iPhone, iPad and iPod touch

• Test all UI Kit based iOS control, gestures

• Test Native Hybrid & web application

• Manages test suits on simulators and Devices

• Open source & downloaded iOS app

• Record and playback

Automation Tool

Mobile applicati

ons

Test Studio Scripts

Ad –hoc testing

tool



14

Test Studio – IOS – Cont’d

Pros Cons

Detects elements on object-based instead image based detection

Do not contain information about the failed objects, need to debug the code

Provides a consolidated report, does not require scripting knowledge

Adding other plug-ins is not possible



15

Mobile App Testing Tools Effectiveness

Maximal Test Coverage

Improved Productivity

Increased Test Efficiency

Reduced Cost

Multiple Test execution for all code changes

Timely Delivery

Return on Investment



16

Key Takeaways….

Risks and challenges can be mitigated by adopting various strategy

Accelerate time to market by meeting the test estimation

Also measure security, compatibility compliance and reduce application testing cost

Improved test coverage and ease of defect identification



17

Thank You

USA: [email protected]

EMEA & APAC: [email protected]@indiumsoft.com

INDIA: [email protected]

SunnyvaleSuite 210, 1250 Oakmead ParkwaySunnyvale, CA – 94085.Phone: +1(408) 501-8844Fax: +1(408) 501-8808

Atlanta Crown Office Suites1870 The Exchange, Suite 100 Atlanta, GA 30339Phone: +1 (678) 608-0809, +1(770) 989-7302

New DelhiF-1/5 Okhla Industrial Area Phase-I, New Delhi – 110 020.Phone: +91-11-6613 0400

BengaluruSRS Plaza, No. 246, 2nd & 3rd Floor13th Cross, Indira Nagar 2nd StageBengaluru – 560 038.Phone: +91-80-4914 7777

ChennaiVDS House41, 2nd Floor, Cathedral RoadChennai – 600 086.Phone: +91-44-2811 6330Fax: +91-44-4210 4033

mailto:[email protected]




https://www.facebook.com/pages/Indium-Software/290116636922

http://www.linkedin.com/company/82503

https://twitter.com/indiumsoft

Efficiency of mobile application testing with effectiveness of tools

Technology

indium software

mobile testing

software quality agenda

device testing

software quality key

test suits

test schedule

test estimation