Paper Prototype 2 Evaluation

8/3/2019 Paper Prototype 2 Evaluation

1/13

Paperprototype2:EvaluationThe second prototype has been tested on 10 different people, all between

the ages of 20 and 23. 4 of them study computer science, 3 are studyinganother form of engineering and the others are university students as well.

One woman, 9 men. This isn't a very diverse test audience, but it representsa considerable part of the iPhone users (young adults, well educated).

I asked the test persons about their experience with smartphones. As you

can see in figure one, 80% of the tested users either own an iPhone or have

at least used an iPhone. This was important to me because the applicationwill be created for the iPhone, and some basic iOS knowledge is preferred. 2

people had never used a smartphone, so I would also get a perspective on

how difficult it is for inexperienced people to work with the app.

Figure1:iPhoneexperience

NextIpolledfortheirexperiencewithaugmentedrealityapplications.Thiscanbeseeninfigure2.50%hadneverusedanARapp,sosomeexplainingneededto

bedoneinadvance.TheARexperiencewasnotrequired,butpreferred,sincepeoplewithexperiencecouldcomparemyappwiththeonestheyvetested.

Figure2:Augmentedrealityexperience

Then,Iaskedwhichsocialnetworkstheyuse.ThisstatisticisinterestingtoknowthepriorityofthenetworksthatIllbuildin.However,slideshareandmendeley

wereneverselected,becausetheaudiencedidnotincludefacultymembersoracademics.Thesenetworksarenotpopularwithstudents,butphdstudents,


2/13

professorsorotheracademicsmightbemoreinterestedinthesenetworks.Iwill

testtheappwithacademicsinthenextiteration,sothiswillprovidemewithmoreresults.Theothernetworkfilledinonthequestionnairewasfoursquare,

usedby1(10%)ofthetestpersons.

Facebookisaclearwinner,anditwilldefinitivelybeimplementedbecausethefacerecognitionwillrequireit.Twitter

Figure3:Socialnetworks

Notesduringthetesting

Thethinkaloudtechniquewasappliedduringallthetestsandtasksweregiven

totheusers.SomeopinionswereaskedofthingsthatIwasnotyetsureabout.

Inotedhowmanyoftheuserstappedonthenameofarecognizedpersonoronthefaceitself:3tappedthename,7theface.Therelevanceofthiswillbe

explainedlater.

Questionnaireanswers

TheanswerstothequestionnairecanbefoundinappendixA.

ThequestionnaireitselfisthestandardUSEquestionnaire.Iwilldiscussthedifferentcategoriesoftheform.

1. Usefulness:Theappscoredgreatonquestions1,3,6and8.Peoplethinkitisusefulanditdoeswhattheyexpectittodo.Itdoesnotmakethe

thingstheywanttoaccomplisheasier(5),nordoesgivesthemmore

controlabouttheactivitiesintheirlives(4).Thisisnormal,becauseitisntalife-changingproduct.Theanswerstowhetheritmeetstheneeds

oftheuser(7)weredivided,becausesomeusersjustdidnothaveaneed

forthisapplication.2. Easeofuse:Theeaseofusewasingeneralgoodtoverygood.Itsuser

friendly,easytouse,consistentQuestion12howeverdoesnothaveagreatscore.Thisisbecause,duetothelackofahomebuttononalotof

views,usersneededtogobackafewpagestogettothehomescreen.This

willbeadaptedinprototype3.UsingtheapplicationeffortlessdependedontheiOSexperienceoftheuser,becausetheappusesthestandardway

ofnavigatingthroughviewsmostofthetime.

3. Easeoflearning:Noneofthesequestionshadascorebelow5.Thisisverypositive.ThisisduetotheiOSwayofnavigating,asdescribedabove.

4. Satisfaction:Theusersweredividedaboutwhethertheyfeeltheneedtohaveit(29).TheiPhoneownerswouldreallywantit,butthepeoplethat


3/13

donothaveasmartphonewerelessinterested.Thisisbasicallybecause

theyhavebutlittleinterestinapplicationsingeneral.Asidefromthis,theapplicationseemstobefuntouse,andeverybodywassatisfied.

Positive/negativepoints

Iaskedtheuserstolistthepositiveandnegativeaspectsoftheapp.Thepositivepointsweremostlytheconcept(thefacerecognitionandaccumulationofsocial

networks),thecleanUIandtheiOSstyleofworking.Thenegativepointsaremuchmoreinteresting,becausetheyllhavetobe

improvedforthenextiteration.

OneremarkthatIhadfrom9outof10userswasthattherewasonlyonebuttongoingtothehomeview,anditwasonthecameraview.Sonowhereinthe

networkoverviewofapersonorinthespecificnetworkofapersonwastherealinktothehome.Thisway,ittakes3-4clickstogettothehomescreen,whichis

toomuch.Thenextprototypewillhavemorehomebuttons.

Anotherremarkthatwasmadeby6outof10userswasthatthecontactinfo-buttoncouldhavebeenclearer.Atthemoment,itslikeinfigure4,butwiththe

@-symbol,itmakesusersthinkthatitreferstoemailingtherecognizedperson.

Soadifferenticonwillneedtobefound.ThiswillprobablybetheiOScontactsicon,showninfigure5.

Figure4:Oldcontactinfobuttonleft,andthenewoneontheright

AbigissuewastheNothim/her?-button.Thisbuttonwasshownintheperson

overviewview.Sowhenapersonisrecognizedwrongly,andtheuserlooksathisinfo,itwillfetchalltheinfoaboutthewrongpersonbeforetheusergetstheopportunitytocorrecttherecognition.Everybodyagreedthatthiswastoolate.

Theincorrectly-tagged-buttonshouldbeplacedonthecameraview.However,

theopinionsweredividedamongsttheusers.Someofthem(2)wantedanincorrectbuttonunderthetagframe,others(4)wantedithiddenfromtheview

butitwouldbecomevisibleupontappingthenameoftheperson.Thisiswhythe

statisticdescribed2sectionsaboveisuseful.70%tappedthepersonsface,30%hisname.Soitisapossibilitytohidetheincorrectbuttonunderthename,andI

willgoforthisoptioninthenextiteration.Theremaining4usersallhaddifferentsuggestions,buttheystoodaloneintheiropinion.

Onlyonepersoncomplainedaboutthebinarysystemofdisplayingnetworks.He

wantedmorecontrolabouttheaccessibleinformation.Iwillnotdothisfornow,because1outof10isntenoughtorevisethissystem.

Oneotherpersonwantedtobeabletofollowrecognizedtwitterusersfrom

insidetheapp.Thisisntabigchange,andactuallyagoodidea,soIwilladdthisandevaluatethisinthenextiteration.

AppendixA:Questionnaireanswers

Usefulnessquestions


4/13

1) The application helps me be more effective.

Strongly disagree Strongly agree

2) The application helps me be more productive.


3) The application is useful


4) The application gives me more control over the activities in my life.


5/13


5) The application makes the things I want to accomplish easier to get done.


6) The application saves me time when I use it.


7) The application meets my needs


6/13


8) The application does everything I would expect it to do.


Easeofusequestions

9) The application is easy to use


10) The application is simple to use


7/13


11) The application is user friendly


12) The application requires the fewest steps possible to accomplish what I want to dowith it


13) The application is flexible


8/13


14) Using the application is effortless


15) I can use the application without written instructions


16) I don't notice any inconsistencies as I use the application


9/13


17) Both occasional and regular users would like the application


18) I can recover from mistakes quickly and easily


19) I can use the application successfully every time


10/13


Easeoflearningquestions

20) I learned to use the application quickly


21) I easily remember how to use the application


22) It is easy to learn to use the application.


11/13


23) I quickly became skillful with the application.


Satisfactionquestions

24) I am satisfied with the application


25) I would recommend the application to a friend


12/13


26) The application is fun to use


27) The application works the way I want it to work.


28) The application is wonderful


13/13


29) I feel I need to have it


30) It is pleasant to use


Paper Prototype 2 Evaluation

Documents