Top Banner
Webinar: How To: Remote Prototype Testing
48

Remote Prototype Testing Case Study

Jan 27, 2015

Download

Technology

UserZoom

We thought the best way to explain how UserZoom works with two different prototyping tools was to implement a case study.

With each tool, Axure and Just In Mind, we ran a 30 user study. The Axure study featured a low-fidelity prototype for an e-commerce company. Whereas, the Just In Mind study featured a high-fidelity prototype for a banking company, as you can see in the video

Remote Prototype Testing and 'traditional' remote testing differ in that your prototype is not a live webpage, but is a hosted interactive experience for your participants in a secure testing environment.

Want to read the full article?
Simply go to http://www.userzoom.com/news-feed/prototype-testing-userzoom
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Remote Prototype Testing Case Study

Webinar:

How To: Remote Prototype Testing

Page 2: Remote Prototype Testing Case Study

Webinar Overview & Goals

1. Brief Introductions

2. What do we mean by Remote Prototype Testing?

3. When is Remote Prototype Testing useful?

4. Case study:

How to set up, design a Remote Prototype Test

What results can you expect?

5. Takeaways, Q&A

Page 3: Remote Prototype Testing Case Study

Introductions

Alfonso de la Nuez

Founder & CEO

at UserZoom

Kim Oslob

Dtor. Client Services

at UserZoom

Page 4: Remote Prototype Testing Case Study

4 quick facts about UserZoom

Leading SaaS company specializing in Remote UX Testing

Our obsession is to help businesses create excellent Customer Experiences

Our software solution includes 8 different tools to run Remote UX Research

Around for about 9 years, offices in Sunnyvale (CA), Cheshire (UK) and Barcelona (Spain)

Page 5: Remote Prototype Testing Case Study

50% of Fortune’s Most Admired Companies!!!

Some accomplishments

Page 6: Remote Prototype Testing Case Study

Before we begin, let’s take a quick poll to get to know you better…

Page 7: Remote Prototype Testing Case Study

What do we mean by Remote Prototype Testing?

Page 8: Remote Prototype Testing Case Study

Typical scenario for UX Pros

Sure we’d love to run testing, but…

UX & Usability research tends to be expensive

Time is not on our side

Target audiences are all around

Budget issues anyone???

Page 9: Remote Prototype Testing Case Study

• Hundreds of users agree to participate in a study

• In their natural context

• From geographically spread locations

• Users try to complete tasks (or goals) + answer questions

• No human moderation needed

• Our browser bar connects users’ browsers with a server

Remote Unmoderated Testing

What we mean by Remote Prototype Testing

Page 10: Remote Prototype Testing Case Study

What you can test with Remote Prototype Testing

Of course, low and high fidelity wireframes/prototypes

…but also:

Mock-ups

Images

Multimedia

Page 11: Remote Prototype Testing Case Study

Advantages and benefits or Remote Prototype Testing

Page 12: Remote Prototype Testing Case Study

Advantages and benefits

Cost-effective

Page 13: Remote Prototype Testing Case Study

Advantages and benefits

Quick, agile

You can gather feedback in a matter of hours

Page 14: Remote Prototype Testing Case Study

Advantages and benefits

Stats!

You can test with large samples

Page 15: Remote Prototype Testing Case Study

Advantages and benefits

Geographic representation

Your audience may be anywhere!

Page 16: Remote Prototype Testing Case Study

Advantages and benefits

Unbiased feedback

Page 17: Remote Prototype Testing Case Study

Advantages and benefits

Detailed feedback, results

Page 18: Remote Prototype Testing Case Study

However, not to be used when…

Getting highly qualitative data

In-person interviews are important

Note: Not all research

goals can be met

Page 19: Remote Prototype Testing Case Study

Remote testing and Agile Development

Characteristics: Speed Iterative Requirement

analysis Design User testing

Remote Testing is here to help!

Page 20: Remote Prototype Testing Case Study

Types of Remote Testing projects

Page 21: Remote Prototype Testing Case Study

Types of Remote Testing projects

Task-based surveys (Remote Usability)

Page 22: Remote Prototype Testing Case Study

Types of Remote Testing projects

Click Testing

Page 23: Remote Prototype Testing Case Study

Types of Remote Testing projects

Timeout Testing

Page 24: Remote Prototype Testing Case Study

Types of Remote Testing projects

Tree Testing

Page 25: Remote Prototype Testing Case Study

Types of Remote Testing projects

Multimedia surveys

Page 26: Remote Prototype Testing Case Study

Let’s take poll #2 now!

Page 27: Remote Prototype Testing Case Study

Case Study

Page 28: Remote Prototype Testing Case Study

Examples of Prototyping Tools

Page 29: Remote Prototype Testing Case Study

Case Study Explanation

• With each tool, Axure and Just In Mind, we ran a 30 user remote usability study

• The Axure study featured a low-fidelity prototype for an e-commerce company

• The Just In Mind study featured a high-fidelity prototype for a banking company

• Both vendors generate hosted, trackable prototypes

Page 30: Remote Prototype Testing Case Study

30

Axure Study Initial Questionnaire

1. How often do you shop for clothing online?

11/1/2011

Page 31: Remote Prototype Testing Case Study

31

Axure Study Task - Find Shoes

Add a pair of women's shoes to your shopping cart. When you are done, click "I'm Finished".

Starting page:

11/1/2011

Page 32: Remote Prototype Testing Case Study

32

Axure Study Clickstream

Note: We can validate success by URL

Page click-throughs on Axure prototypes are trackable with UserZoom

Page 33: Remote Prototype Testing Case Study

33

Axure Study Click Heatmap

The large red “heat” indicator shows a majority of people clicked there to begin the the task finding the pair of women’s shoes.

Page 34: Remote Prototype Testing Case Study

34

Axure Study Task - Find Shoes

Task Effectiveness & Efficiency

11/1/2011

Page 35: Remote Prototype Testing Case Study

35

Axure Study Task - Success Questionnaire

1. Please indicate how easy it was for you to find the shoes:

11/1/2011

Page 36: Remote Prototype Testing Case Study

36

Axure Study Task - Abandon Questionnaire

1. Please select the reason(s) why you chose to abandon or were not able to complete this task: (check all that apply)

11/1/2011

Page 37: Remote Prototype Testing Case Study

37

Just In Mind Study

Now let’s look at the Just In Mind Prototype Study

Page 38: Remote Prototype Testing Case Study

38

Just In Mind Study Initial Questionnaire

1. How often do you manage your banking online?

11/2/2011

Page 39: Remote Prototype Testing Case Study

39

Just In Mind Study Task - Find Credit Card

Find the annual fee amount on the PremierPass Rewards Credit Card. When you are done, click "I'm Finished".

Starting Page:

11/2/2011

Page 40: Remote Prototype Testing Case Study

40

Just In Mind Study Clickstream

Page 41: Remote Prototype Testing Case Study

41

Just In Mind Study Click Heatmaps

Page 42: Remote Prototype Testing Case Study

42

Just In Mind Study Task - Find Credit Card

Task Effectiveness

11/2/2011

Page 43: Remote Prototype Testing Case Study

43

Just In Mind Study Task - Validation Questionnaire

1. What is the annual fee for the PremierPass Card?

11/2/2011

Page 44: Remote Prototype Testing Case Study

44

Just In Mind Study Task - Success Questionnaire

1. Please indicate how easy it was for you to find the annual fee amount:

11/2/2011

Page 45: Remote Prototype Testing Case Study

Some takeaways…

1. You don’t need a live website to run remote testing

2. Many benefits to remote prototype testing, including reduced costs, speed, etc.

3. Remote Prototype Testing in Agile Dev: A great fit!

4. There are various types of remote testing projects, not just remote usability, when developing prototypes

5. Make sure the tool used generates trackable prototypes

6. The detailed of the data collected is AWESOME and very actionable, plus you can do iterative testing too!

More info? Check out our How-To articles on www.userzoom.com!

Page 46: Remote Prototype Testing Case Study

Q&A

Page 47: Remote Prototype Testing Case Study

Please don’t go yet! Let’s take the final poll…

Page 48: Remote Prototype Testing Case Study

Thanks so much for your time!

Check out our upcoming news and events at www.userzoom.com

Sunnyvale (USA)

440 N. Wolfe Rd. Sunnyvale,CA 94085 Phone: +1 (408) 524 7445 Contact: Alfonso de la Nuez

Barcelona (Spain)

Av. Diagonal 419 3º 2ª 08008 Barcelona Phone: +34 93 414 7554 Fax: +34 93 209 8380 Contact: Xavier Mestres

Cheshire (UK)

Booths Park. Chelford Road, Knutsford, Cheshire WA16 8GSPhone: + 44 (0)1565 759890Cell: + 44 (0)7900 472 920Contact: Arthur Moan