Beyond Appium: Testing with Espresso & the Real Device Cloud

Beyond Appium:Testing with Espresso and the Real Device Cloud

Asaf Saar, Director Product Management, RDC

Clint Sprauve, Director Product Marketing, Mobile

By 2018, more than 50 percent of users will go to a tablet or smartphone first for all online activities

THE WORLD GOES MOBILE

2

IT’S MOBILE FIRST, BUT NOT MOBILE ONLYTHE NEED FOR MOBILE WEB TESTING

45% 50% 5%Year-On-Year Change:

-20% +30%

Year-On-Year Change: Year-On-Year Change:

-5%

Laptops &Desktops

MobilePhones

TabletDevices

Source: Digital in 2017: Global Review

More than half of the world’s web traffic now comes from mobile devices

3

IMPACT OF POOR MOBILE QUALITY

Source: The 2016 Mobile App Report, ComScore

THE CONSEQUENCES OF POOR APP QUALITY ARE HIGH

● User frustration

● Lost revenue

● App abandonment

● Bad Reviews and word of mouth

● Damage to brand reputation

4

A 4.5 star app is downloaded 3.7x more than a 3.5 star app.

x3.7

79%Of users will only retry an app once or twice if it fails to work the first time.

THE CHALLENGES ARE REAL

5

MASSIVE VARIABILITY MAKES MOBILE TESTING COMPLEX

WebHybridNative

DeviceFragmentation

VariousApp Types

Geographically Dispersed

Users

Test Automation Frameworks

WHY MOBILE AUTOMATION FRAMEWORKS?

7

Appium is an open-source tool for automating

native, mobile web, and hybrid applications on iOS

and Android platforms

WHAT IS APPIUM?

8

▪ Automate native, web and hybrid mobile apps

▪ Test on real devices and emulators/simulators

▪ Use any language that Selenium supports (Java, Python, C#, Ruby, JavaScript, PHP, etc.)

▪ Single framework for both iOS and Android

▪ Supported by a large Open Source Community

ADVANTAGES OF APPIUM

9

Espresso is a Test Automation frameworks for Android that provides

a set of APIs to build UI tests to test user flows within an app. These

APIs let you write automated UI tests that are concise and that run

reliably. Espresso is well-suited for writing white box-style automated

tests, where the test code utilizes implementation code details from

the app under test

WHAT IS ESPRESSO?

10

ADVANTAGES OF ESPRESSO

11

▪ Espresso test development is easy○ Integrated with Android Studio○ Automatically updated○ Based on Java & JUnit○ CI/CD Ready

▪ Simple, super fast and reliable

▪ Automatic synchronization ○ Automatic synchronization results in less flakiness○ Ensures your activity is started before the tests run

Demo

Questions?

MOBILE APP TESTING FRAMEWORK RESOURCES

Source: The 2016Mobile App Report, ComScore

● Continuous Integration for Espresso - The Sauce Labs Cookbook ...

● 3 Step Guide On Parallel Testing on Multiple Mobile Devices ...

● Mobile Testing Automation Framework – Choose The Right One …

● https://github.com/testobject/espresso-reference-test

● https://github.com/testobject/espresso-runner

● https://wiki.saucelabs.com/display/DOCS/Continuous+Integration+for+Espresso

● Additional resources on open source frameworks

14