System Interface Evaluation: Goodreads Group 3 April 17, 2012

System Interface Evaluation:Goodreads

Group 3April 17, 2012

Group 3 Members

Lauren Long, Evaluator•Cataloger, Transylvania Co. Library, Brevard, NC•ITRL Student

JULIE FORKNER,Evaluator•Director, E.G. Fisher Public LibraryAthens, TN•ITRL Student

ANGELA GLOWCHESKI,Evaluator •Information Specialist, Lumpkin Co. Public Library Dahlonega, GA•ITRL Student

SUSAN MACRELLIS,Leader•Director, East Ridge City Library Chattanooga, TN•ITRL Student

MARILYN PONTIUSEvaluator•Branch Manager,Hancock War MemorialBranch LibraryWashington Co, MD•ITRL Student

Leader Responsibilities Planning the evaluation method Developing two tasks to be performed by each group

member (Evaluator) Meeting with evaluators to discuss tasks, responsibilities,

when and where to perform walkthrough, use of Nielsen’s severity rating scale

Performing a walkthrough for each task and creating a task analysis to use as benchmarks for comparison to Evaluator walkthroughs. This includes: time taken to complete each task feelings/emotions experienced problems and errors found and causes for these

problems and errors severity rating of each problem or error found success and failure stories as applicable

Evaluator Responsibilities Meet with the Leader and brainstorm on broad tasks to perform

in a given interface. Follow the procedures outlined by the Leader.

Perform each task individually in the given interface Identify potential problems and errors in the given interface Use Nielsen’s severity rating scale to rate each of the problems

and errors found and describe briefly the causes of these problems and errors

Provide solutions for solving the problems and errors found based on interface design/usability theories and principles learned in class.

Document the feelings and emotions experienced during the process thinking of how target users may feel during the process

Write one success and one failure story as applicable Meet with the Leader to discuss the findings, reach a consensus

on the problems and errors found and their severity ratings, among other things

Generate a usability report as a team

Cognitive Walkthrough Overview

Based on what was learned in Assignment 2: Evaluate tasks frequently preformed by

adult service librarians Evaluate a freely available reader’s

advisory interface

Two Phases: Preparatory Phase Analysis Phase

Walkthrough Methodology Preparatory Phase

Define the interfaceDefine the tasksDefine the target usersDefine the correct sequence of actions to

complete tasks

Favorite Genres generated from user input

Keyword searching

What friends are reading and what they have to say about it

Free Stuff

Book Clubs

Preparatory Phase: Define the Interface

Task 1

Task 2

A user is looking for a book in the Goodreads website. He wants to find the name of the author of this book: Jonathan Strange & Mr. Norrell. Find the author’s name and write it down on the task instruction sheet.

Find how many books there are in the “Blossom Street” series written by Debbie Macomber. What is the title of the most recent book in the series? Find the title name and write it down on the task instruction sheet.

Preparatory Phase: Define the Tasks

Adult services librarian working in a public library Has obtained a college degree, and in many cases a

master’s degree Performs tasks related to reader’s advisory Utilizes a reader’s advisory information system

Supplement personal content knowledge Seeking information

Sequential order of booksBreakdown of genres and subgenres

Preparatory Phase: Define the Users

TASK 1

Preparatory Phase: Correct Sequence of Actions

TASK 2

Preparatory Phase: Correct Sequence of Actions

Walkthrough Methodology Analysis Phase

Evaluators perform tasks and record dataCollect and compare data to correct actionsConstruct success story with defense of

credibilityConstruct failure story

Analysis Phase:Task Instruction Worksheet Example

Action Problem

Actual or Potential?

Nielsen Severity

Cause of Problem

Possible Solution

Feelings/Emotions

1. Go to www.googreads.com

2. Enter “Jonahan Strange and” in title search box

2.1 Error returned

Unexpected error report: Did you mean jonah an strange and

Actual 1 Misspelled name

Improve “did you mean” function to recognize “jonahan” as Jonathan”

Surprised. Confused by message, but recognized the “did you mean” probably ment a spelling error.

Task Data Consolidation and AnalysisTask 1 Example: Compare Actions

Correct Action

Eval 1 Eval 2 Eval 3 Eval 4

1. Go to www.goodreads.com

1. Go to www.goodreads.com

1. Go to www.goodreads.com

1. Go to www.goodreads.com

1. Go to www.goodreads.com

2. Enter “Jonathan Strange and Mr. Norrell” in title search box

2. Enter “Jonahan Strange and” in title search box

2. Entered “Jonathan Strange” in title search box

2. Enter “Jonathan Strange and Mr. Norrell” in title search box

2. Enter “Jonathan Strange and Mr. Norrell” in title search box

2.1 Error returned

Analysis Phase –Consolidation Spreadsheet

Allows problems and errors to be easily identified

Create best success story with credibility data

Create worst failure story with problem areas identified

Summary

Choosing the interfaceWhy Goodreads?

Current status Changes we would have made Questions/Comments for the Group

Group 3 thanks you for listening!

Lauren LongJULIE FORKNER

ANGELA GLOWCHESKI

SUSAN MACRELLIS

MARILYN PONTIUS