Brad Nunnally - @bnunnally GIANT CONF 2015 Practical Techniques for Field Research The Workshop
Jul 28, 2015
Brad Nunnally - @bnunnallyGIANT CONF 2015
Today’s Agenda
• Team Creation & Ice Breaker • Project Overview • Section 1 - Planning & Prep Presentation & Activity • Section 2 - Out in the Field Presentation & Activity • BREAK • Section 3 - Finding the Patterns Presentation & Demo • Wrap Up Q&A
Brad Nunnally - @bnunnallyGIANT CONF 2015
Team creation
• Break Into Pairs • No Friends • Mix of Locals
& Out of Towners
Brad Nunnally - @bnunnallyGIANT CONF 2015
Project Overview
• Mobile App for Charleston Tourism
• Focus on Discovery & Exploration
• Sourced by Locals & Past Tourists
Brad Nunnally - @bnunnallyGIANT CONF 2015
–Alan Lakein
“Planning is bringing the future into the present so that you can do
something about it now.”
Brad Nunnally - @bnunnallyGIANT CONF 2015
Key Benefits
1. Validates initial assumptions and existing research
2. Ensures you cover all the necessary topics
3. Helps sessions flow more smoothly
Brad Nunnally - @bnunnallyGIANT CONF 2015
Test Plan
• Project background • Overall purpose • Dictates Methodologies • Communicates Outcomes
• Template - http://www.usability.gov/how-to-and-tools/resources/templates/ux-study-overview-template.html
Brad Nunnally - @bnunnallyGIANT CONF 2015
Recruitment Screener
• Guided Survey • User Profile Breakdown • Demographics • Behaviors • Scheduling
• Source - http://www.usability.gov/how-to-and-tools/resources/templates/usability-test-screener-website-example-1.html
Brad Nunnally - @bnunnallyGIANT CONF 2015
Interview Guide
• Opening Script • Contextual Sections • Goal based questions • Align with project goals • Challenge assumptions
Brad Nunnally - @bnunnallyGIANT CONF 2015
Introduction Packet
• Pre-introduce yourself • Provide background and
key contacts • Send you picture
Brad Nunnally - @bnunnallyGIANT CONF 2015
Travel Logistics
• Map out routes • Estimate travel time • Plan breaks and meals • Avoid over scheduling
Brad Nunnally - @bnunnallyGIANT CONF 2015
Observer Instructions
• Lay down the rules • Avoid asking questions • Control non-verbal
reactions • Stay focused • Debrief instructions
Brad Nunnally - @bnunnallyGIANT CONF 2015
Notes worksheets
• Key for multiple research teams
• Aids in synthesis and analysis
• Allows for backup note takers to help
Brad Nunnally - @bnunnallyGIANT CONF 2015
Goals Avoid talking about people want, rather focus on what problems they have the need to be solved and why they need to solve them.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Objectives Identify the key objectives for doing the research. What outcomes are expected and how will they be used?
Brad Nunnally - @bnunnallyGIANT CONF 2015
Assumptions Base questions on the assumptions that you have on hand and what stakeholders think people do or say.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Hypothesis Frame areas of inquiry around a hypotheses that you can test while interviewing people. This will change as the studies progress, but if gives you a strong starting point.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Digging Deeper
• Why do you need to ask that question?
• Why does this question matter?
• What else do I need to know?
• Rinse and repeat…
Brad Nunnally - @bnunnallyGIANT CONF 2015
Self-Recruiting
Cold Calling Live Recruiting
Email Blasts Screening Surveys
Brad Nunnally - @bnunnallyGIANT CONF 2015
Outsourcing RecruitingMarket Research Firms
Online User Groups Client Recruiting
Brad Nunnally - @bnunnallyGIANT CONF 2015
–Chris Gabrieli
Time is a resource, much like money or autonomy, which can be invaluable or can be squandered.
Brad Nunnally - @bnunnallyGIANT CONF 2015
In-Person It’s important to keep in mind that it takes time to travel between sessions. This can include walking down the hall or driving across town.
Remote Technology is not your friend when doing remote sessions. Plan for some upfront time to train a participant on how to use any online conferencing tools or systems.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Tech Checks
• Testing technology before each session
• Have a checklist for beginning of day, per session, and end of day
Brad Nunnally - @bnunnallyGIANT CONF 2015
Dry Runs
• Practice • Practice • Practice • Then…. • Practice Some More
Brad Nunnally - @bnunnallyGIANT CONF 2015
Warming Them Up
• Sets a friendly tone and context
• Breaks down barriers • Opens up trust • Humanizes your team
Brad Nunnally - @bnunnallyGIANT CONF 2015
Small Talk Master the art of small talk. This is crucial when it comes to warming up a participant and getting them on your side.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Personal Questions Notice unique things about the person and inquire. Keep the topics safe and neutral. Safe topics include - family, job, obvious hobbies.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Inquire About Environment Pay attention to photos, art work, knickknacks to learn more about the person and what types of things they are interested in.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Commonalities Everyone has something in common, pointing it out helps creates a connection.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Managing Flow
Influencing the peaks and valleys of a conversation
Brad Nunnally - @bnunnallyGIANT CONF 2015
Order of Questioning
• Simple/Basic Questions
• Topic Based Questions
• Sensitive Areas
Brad Nunnally - @bnunnallyGIANT CONF 2015
– Barbara Walters
When you're interviewing someone, you're in control. When you're being
interviewed, you think you're in control, but you're not.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Body Language
• Non-verbal signals convey a lot of meaning
• Two-street, your signals and theirs
• Utilizing mirroring to encourage people to open up
Brad Nunnally - @bnunnallyGIANT CONF 2015
Tread Carefully
Closed Body Sudden Shallow Answers
Avoidance Patterns
Brad Nunnally - @bnunnallyGIANT CONF 2015
Avoidance Patterns
• Changing the subject
• Calling it quits
• Physically become closed off
Brad Nunnally - @bnunnallyGIANT CONF 2015
Two Way Street
Participant energy is a direct reflection of your
energy levels.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Nightly Debrief
• Team & Client debriefs
• Highlight key observations - Don’t get into the weeds
• Debrief Template to save time
Brad Nunnally - @bnunnallyGIANT CONF 2015
What’s a Data Point? A data point is a single thought, comment, idea, or notion that relates to the area of inquiry.
Brad Nunnally - @bnunnallyGIANT CONF 2015
Pulling Out Data Points Catalog the data points so that pattern analysis can be performed. The key here is getting the data in a malleable format
Brad Nunnally - @bnunnallyGIANT CONF 2015
Team Notes Gather all the team’s notes together, grab a pot of coffee, and get to reading…
Brad Nunnally - @bnunnallyGIANT CONF 2015
Transcripts Send audio recordings off, gather session transcripts, grab a pot of coffee, and get to reading…
Source - Tomar Sharon via http://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/
Brad Nunnally - @bnunnallyGIANT CONF 2015
– Johann Wolfgang von Goethe
There is nothing insignificant in the world. It all depends on the point of view.
Brad Nunnally - @bnunnallyGIANT CONF 2015
–Bill Nye
“When you go exploring, two things happen. First, you make discoveries. The other thing is you'll have an adventure, and I think we all want to be part of space exploration.”
Brad Nunnally - @bnunnallyGIANT CONF 2015
Next Round of Research Plan for areas that couldn’t be included this round and what areas require additional discovery.
What’s New Territory? Document the areas that were discovered that require focus and discovery in the next round of research.
I like learning stuff. The more information you can get about a person or a subject, the more you can pour into a potential project.
- Brian Grazer
Brad Nunnally - @bnunnallyGIANT CONF 2015
Using Curiosity
• Wonder…the greatest weapon a researcher can have
• Allows a team to get out of its own way
• Throws assumptions out the window and gets the heart of the matter