Top Banner
AppThwack Run Appium Tests On Real Devices in Remote Device Lab Bryan Segale | @bsegaleSF | [email protected]
16

AppThwack - Running Appium Tests on Real Devices

Jan 15, 2015

Download

Technology

Bryan Segale

AppThwack maintains a remote device lab of hundreds of iOS and Android devices and an automation infrastructure that allows you to run automated test scripts in parallel on real devices, not emulators. AppThwack supports all popular automation frameworks. With AppThwack, you can

- Execute your tests, in parallel, across 100s of iOS and Android phones and tablets with results available in minutes
- Initiate tests through a simple web interface or Jenkins Plug-in
- View results in web-based dashboard or download for offline viewing
- Analyze reports in real-time that include high-level results, low-level logs, pixel-perfect screenshots, and performance trends (CPU, Memory, Threads, Frame draw time)
- Integrate report data with CI and other business flow applications

AppThwack offers a free 7-day trial period. Start testing with AppThwack today!
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: AppThwack - Running Appium Tests on Real Devices

AppThwackRun Appium Tests On Real

Devices in Remote Device Lab

Bryan Segale | @bsegaleSF | [email protected]

Page 2: AppThwack - Running Appium Tests on Real Devices

AGENDA

• AppThwack Overview• Appium Solution Overview• Demo• Q&A

Page 3: AppThwack - Running Appium Tests on Real Devices

1,000,000+ apps in

1,000,000+ apps in

2 crashes and 84% will uninstall- Compuware as reported in TechCrunch

YOURAPP

So what’s the big deal?

Page 4: AppThwack - Running Appium Tests on Real Devices

Automated Testing for Android, iOS & Mobile Web

Over 250 devices, phones & tablets hosted in our remote device lab

Choose from built-in compatibility tests or your own custom scripts

Parallel execution of tests, results are available in minutes

Intelligent reports with high-level results, low-level logs & pixel-perfect screenshots

Jenkins plug-in and API available for continuousintegration

appthwack.com [email protected]

Page 5: AppThwack - Running Appium Tests on Real Devices

We make it simple,fast, affordable, and we find real issues.

Our Device Lab - Run automation on real devices

• Over 250 non-rooted or jailbroken Android & iOS devices

• OEM & Carrier handsets• All relevant OS versions• Varying screen sizes• Other hardware

characteristics• Hundreds of combinations• New devices added every

weekComplete coverage – Matching what your customers have in their hands today.

Page 6: AppThwack - Running Appium Tests on Real Devices

Run your own automated scripts

• Implement test scripts with Appium or one of our other supported frameworks

• Develop tests locally• Run them in AppThwack’s remote

mobile device lab• Integrate tests with CI Server using

Jenkins plug-in or our RESTFul API• Increase test coverage• Enable manual testers to focus on

less-repetitive tests

Android Frameworks

• Appium• Calabash• Junit• Robotium• MonkeyTalk• Espresso• UI Automator

iOS Frameworks• Appium• Calabash• UI Automation• KIF• Frank

Page 7: AppThwack - Running Appium Tests on Real Devices

Our Appium Support

• Execute Appium tests on devices in our remote device lab

• Same experience as running on local device

• Run tests cases across multiple devices

• View results in an intelligent dashboard - test case results span all

devices

• Analyze key performance metrics - CPU, Memory, Threads, FPS

• View pixel-perfect screenshots captured during execution

• Drill into lower-level device logs

Page 8: AppThwack - Running Appium Tests on Real Devices

How it Works:

Custom TestsSet desired_capabilities

• Specify AppThwack project name

• Set run_name to combine test runs into single report

• Choose make, model and OS, we’ll run test on that device

• Specify location of APK, IPA file for upload

• Execute the script, test will run on devices in our remote device lab

Page 9: AppThwack - Running Appium Tests on Real Devices

Demo Time

Page 10: AppThwack - Running Appium Tests on Real Devices

Sign Up for Free Trial

• 7-day free trial, sign up at: appthwack.com

• Simple registration process, begin testing in minutes

• Have questions send an email to [email protected]

Page 11: AppThwack - Running Appium Tests on Real Devices

Q & A

Bryan Segale| @bsegaleSF | [email protected]

Page 12: AppThwack - Running Appium Tests on Real Devices

Intelligent Reporting

• Easy-to-navigate dashboard• Actionable insights into compatibility,

performance and functionality• Learn what failed and why• Quickly go from high-level results to

lower-level details:• Pixel-perfect screen shots• Performance (CPU, Mem, Threads)• Frame draw time• Device log files

• Track metrics across application versions• Downloadable report or share with others

Drill into test log

Page 13: AppThwack - Running Appium Tests on Real Devices

Device Logs

Page 14: AppThwack - Running Appium Tests on Real Devices

PIXEL-PERFECT SCREENSHOTS

Page 15: AppThwack - Running Appium Tests on Real Devices

Performance Summary

Page 16: AppThwack - Running Appium Tests on Real Devices

Performance Detail