Top Banner
© 2014 SOASTA. All rights reserved. June 25, 2015 1
21
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 1

Page 2: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 2

Page 3: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 4

o  Expanding Test Plans

Page 4: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 5

o  Expanding Test Plans

o  Shorter Product Cycles

Page 5: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 6

o  Expanding Test Plans

o  Shorter Product Cycles

o  More Device Platforms

Page 6: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 7

o  Expanding Test Plans

o  Shorter Product Cycles

o  More Device Platforms

o  A Changing Focus

Page 7: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 8

o  Expanding Test Plans

o  Shorter Product Cycles

o  More Device Platforms

o  A Changing Focus

o  An Emphasis on Analysis

Page 8: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 9

!  Time

!  Duration

!  Location

!  Intent

TIP: Work with your product owner, review market"research, conduct user focus groups, and verify/validate "with real user monitoring

Page 9: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 10

!  Developers intended execution paths

!  User common use paths

Page 10: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 11

!  Developers intended execution paths

!  User common use paths

!  User revenue generating patterns

!  Current problem areas

TIP: Use real user data to create test cases

Page 11: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 12

Page 12: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 13

!  Core functions and experiences

!  Core differentiators

!  Edge functions !  Complicated

!  Repetitive

!  Measure manual effort

!  Know your person days per cycle, per area

TIP: Use your matrix to know which tests to automate

Page 13: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 14

!  Rank active devices

!  Analyze device usage

!  Weight matrix to device

!  Know problem areas per device

!  Core devices to own

!  Edge devices to borrow/rent

!  TIP: Choose which devices you must own"for testing and which might be optional but available "based on real user monitoring

Page 14: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 15

Page 15: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 16

Page 16: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 18

!  Start ASAP

!  Simple

!  Time Consuming

!  Mundane

!  Rhythm

TIP: Goal is Continuous Integration execution

Page 17: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 21

!  Device reaction to app functionality !  Battery, CPU, Memory…

!  Common user path

!  Speed per screen or page

!  Separate back and front end performance

!  Performance to revenue correlation/transaction or task completion

TIP: Prioritize tests to highest revenue producing/completion paths

Page 18: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 22

Page 19: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 23

!  Time to Market

!  Functional

!  Competitive

TIP: Prioritize which strategy you will apply with the time saved from "test automation

Page 20: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 25

Know your: 1.  User 2.  App 3.  Matrix 4.  Devices 5.  Plan to automate 6.  Performance 7.  Edge

Page 21: 7 steps to pragmatic mobile testing   Vancouver

© 2014 SOASTA. All rights reserved. June 25, 2015 26