Top Banner
Managing Lean UX Work in the Enterprise Leading Lean MX Conference | Sunday, March 16, 2014 Kate Rutter | @katerutter
106

Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Aug 11, 2014

Download

Design

Kate Rutter

The need for organizational innovation has never been more acute, and concepts of Lean Startup, Lean UX and Agile Design are emerging to address this need. But what do these ideas really mean for design and product leaders in the corporate world? In this hands-on workshop, participants received rapid exposure to the core ideas driving Lean Startup innovation trends, identified a top need for innovation in their company, and drafted a pilot plan (an experiment) to implement immediately.

This workshop was developed to give enterprise design leaders a clear understanding of where and how lean concepts can benefit UX work today, and how to shape organizational culture to be more innovation-centered in the future. * Includes Templates
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Managing Lean UX Work in the Enterprise

Leading Lean

MX Conference | Sunday, March 16, 2014Kate Rutter | @katerutter

Page 2: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Hello!

Principal, Intelleto.comCo-Founder, Luxr.coSketchnoter, graphic recorderEntrepreneurship + UX

@katerutterhttp://intelleto.com

Page 3: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Around the room intros* name* role * your favorite superpower!

Hello!

Instant infographicsWith dots!

Page 4: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Page 5: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Page 6: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

I am not an expert on your business. You are.

My goal is to help you identify one way you can innovate using lean

practices...

so you can experiment andlearn first-hand if itʼs helpful.

What to expect...

Page 7: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

We are going to be working really, really, really fast.

What to expect...

Page 8: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

There is a purpose to this.

I will push you to get something down rapidly. In 3 hours, you will

have an experiment you can run to test-drive lean methods.

We are going to be working really, really, really fast.

What to expect...

Page 9: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

You will be working solo and also in peer pairs.

Two brains arebetter than one.

And weʼll keep talking to a minimum.(There is a break where we can get all social!)

What to expect...

Page 10: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

You may not like the pace/process/pressure/perspective, etc. etc.

That is okay.

All I ask is that you keepan open mind and try it.

What to expect...

Page 11: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

About the whole “Lean” thing

Page 12: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Build.Measure.

Learn

Lean startup?

Page 13: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Lean StartupStartup: a human institution designed to create new products or services under conditions of extreme uncertainty.

Page 14: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

3 Key Ideas

Build. Measure.

Learn!

Validated

Learning

Get out of the building!

Customer

DevelopmentAgile

Development

Collaborate.Release.Improve!

Page 15: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

The Agile Manifesto came about at a ski scrum in February 2001.

The big idea...

over over over over

Page 16: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Steve Blank introduced “Customer Development” in...um...2006.

The big idea...

Page 17: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Eric Ries wrote a blog post on Sept 8, 2008 titled “The Lean Startup.”

+incremental

releasesmake products

customers want

+reduce waste

The big synthesis...

Page 18: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

• Experiments• Validated learning• Reduce waste

Lean Startup

So, what does it look like?

Page 19: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

http://www.slideshare.net/ellendunne/failchat-ux-comes-first-because-ux-is-everything-12883354

(story starts on slide 19)

View the Lumatic story on Slideshare:

Page 20: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Okay, fine.But how does this relate to

User Experience

Page 21: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Features

Users

Uses

Product

NeedsCompany Purpose

via @luxrco

sketches, prototypes, wireframespixelsUI

UX as a stackBUILD

MEASURELEARN

Page 22: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Lean + enterprise?

riskinnovation

focus

Page 23: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

via The Lean Entrepreneur: http://leanentrepreneur.co/

Page 24: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

risk

timeDefine

The old way

Design

Develop

Release

Page 25: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

risk

timeDefine

Design

Develop

Release

a better old way

Page 26: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

risk

time

A different way

Page 27: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

risk

time

A different way

MAKE

release

MEASURE

BUILD

LEARN

MEASURE

BUILD

Page 28: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

BUILD

MEASURE

LEARN

More cycles in less timereduce the risk.

faster!

Page 29: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Features

Users

Uses

Product

NeedsCompany Purpose

via @luxrco

sketches, prototypes, wireframespixelsUI

Stakeholders

Team purpose

Programs & Processes

Needs & Goals

Experiments{ hypothesestests

evidencelearning

BUILD

MEASURELEARN

UX as a stack

Page 30: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

New competencies• Frame our work differently• Draft and run experiments• Focus on observable metrics• Intent = learning, not time & budget

Page 31: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Letʼsmake stuff

Page 32: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

an area to innovate

an experiment

• opportunity• molecule

• hypothesis• evidence

(metrics)• test

+

define it test it

Page 33: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

an area to innovate

an experiment

• opportunity• molecule

• hypothesis• evidence

(metrics)• test

+

define it test it

Page 34: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

find an opportunity

Page 35: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Brainstorm 6 areasto innovate

Not like this...Spread

collaborative design practices

through all product teams

More like this...

Be more innovative

Page 36: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Brainstorm 6 areasto innovate

• Team dynamics• Spreading design in the

enterprise• Maintaining innovation • Engaging with the rest

of the organization

Some themes...

Page 37: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Brainstorm 6 areasto innovate

• 1 idea per stickynote• Working solo• Focus on an internal

opportunity• Specific is GOOD• Go fast!

5 min

Page 38: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

more important

less important

{Activity}

Divide into 2 piles2 min

Page 39: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

more important

{Activity}

Pick one1 min

Page 40: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

more important

{Activity}

Pick one

this is your opportunity

Page 41: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

letʼs hear a few

Page 42: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

explore the opportunity

Page 43: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Users + problems + solutionSketch it out

Who are the stakeholders?What problems do they have?

What would be a proposed solution?

Page 44: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Sketch it outpeople + problems + solutions

related to your opportunity

Who are the stakeholders?What problems do they have?What would be a proposed solution?

Page 45: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

“the DNA of an idea” 7 min

Page 46: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

a training program for collaborative

design techniques

Product managers

Long product release cyclesDuplication of effortSilo’d product teams

UX Team @ Acme.com 03 16 14

“the DNA of an idea” 7 min

Page 47: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

an area to innovate

an experiment

• opportunity• molecule

• hypothesis• evidence

(metrics)• test

+

define it test it

Page 48: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

an area to innovate

an experiment

• opportunity• molecule

• hypothesis• evidence

(metrics)• test

+

define it test it

Page 49: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

About experiments

Page 50: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

The belief you want to test.

The testable “thing.”

An indicator of the outcome.

“We believe people like [customer type] have a need for (or problem doing) [need/action/behavior].”

“The smallest thing we can do to prove that need is [experiment].”

“We will know we have succeeded when [quantitative/measurable outcome] or [qualitative/observable outcome].”

Hypothesis

Experiment(test)

Evidence

Something accepted as true without proof.

“Collaborative design delivers better products”

AssumptionSounds like...Definition...

Lean Experiments

Page 51: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

http://techcrunch.com/2012/03/10/100proof/

Page 52: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Page 53: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

! 2000 users" high sharing

Page 54: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Break!

Page 55: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

an area to innovate

an experiment

• opportunity• molecule

• hypothesis• evidence

(metrics)• test

+

define it test it

Page 56: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Make a hypothesis

Page 57: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

The belief you want to test.

The testable “thing.”

An indicator of the outcome.

“We believe people like [customer type] have a need for (or problem doing) [need/action/behavior].”

“The smallest thing we can do to prove that need is [experiment].”

“We will know we have succeeded when [quantitative/measurable outcome] or [qualitative/observable outcome].”

Hypothesis

Experiment(test)

Evidence

Something accepted as true without proof.

“Collaborative design delivers better products”

AssumptionSounds like...Definition...

Lean Experiments

Page 58: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

✓Simple, clear & specific

✓Written as a statement

✓Establishes • participants (who)• problem or need (why)• behavior (observable with evidence)

✓Testable

A good hypothesis is...

Page 59: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Keep it small,keep it tasty.

mmmm!

cupcake via @brandonschauer

Page 60: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

State the opportunity as a hypothesis.

5 min

Page 61: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Peer check & improve10 min

Find a partner.Do a 1-minute “quiet read”Ask questions to clarify understanding.Make 2 suggestions to strengthen the work.• ~5 minutes each

Page 62: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Define some evidence (aka: metrics)

Page 63: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

The belief you want to test.

The testable “thing.”

An indicator of the outcome.

“We believe people like [customer type] have a need for (or problem doing) [need/action/behavior].”

“The smallest thing we can do to prove that need is [experiment].”

“We will know we have succeeded when [quantitative/measurable outcome] or [qualitative/observable outcome].”

Hypothesis

Experiment(test)

Evidence

Something accepted as true without proof.

“Collaborative design delivers better products”

AssumptionSounds like...Definition...

Lean Experiments

Page 64: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

✓Simple, clear & specific

✓Quantifiable

✓Based on behavior

✓Time-dependent

✓Testable

A good metric is...

Page 65: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com 64

vanity

total # of visits to intranet info page

awesome% of PMs

signing up for a

workshop in first week

better# of PMs

signing up for a

workshop in first week

good# of PMs

signing up for workshops

useless

more collaborative

design thinkers

A good metric measures the behavior of a person doing a specific thing that delivers value to them.

Metrics Tips : Is it actionable?

Page 66: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Brainstorm 6 metricsNot like this...

% of PMs signing up for a workshop in

first week

More like this...

more collaborative

design thinkers

Page 67: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Brainstorm 6 metrics• 1 idea per stickynote• Working solo• Focus on measuring

actions or behaviors• Specific is GOOD• Go fast!

5 min

Page 68: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

more important

less important

{Activity}

Divide into 2 piles2 min

Page 69: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

more important

{Activity}

Divide into 2 piles

these are your (working) metrics

Page 70: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Make a dashboard.1 min

% of PMs

signing up

for workshops

in first week

# of

employees

attending an

info session

Avg daily

views of intro

to design

thinking video

Page 71: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

letʼs hear a few

Page 72: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Write atest

Page 73: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

The belief you want to test.

The testable “thing.”

An indicator of the outcome.

“We believe people like [customer type] have a need for (or problem doing) [need/action/behavior].”

“The smallest thing we can do to prove that need is [experiment].”

“We will know we have succeeded when [quantitative/measurable outcome] or [qualitative/observable outcome].”

Hypothesis

Experiment(test)

Evidence

Something accepted as true without proof.

“Collaborative design delivers better products”

AssumptionSounds like...Definition...

Lean Experiments

Page 74: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

✓Simple, clear & specific

✓Generates evidence

✓Time-based

✓Uses minimum amount of time, money and effort

✓Doable - doesnʼt require approval!

A good test is...

Page 75: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

What you have to work withSpread

collaborative design practices

through all product teams

opportunity hypothesis

molecule evidence

test

Page 76: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

The experiment template

Page 77: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Create an intranet landing page for sign-

ups for a 1-hour info session on collaborative

methods.

Put an announcement on the PM intranet

site.

Email all PMs, designers and developers in

the division.

What will you do or make?

Who is involved?

How much will it cost?

How long will it take?(Shorter is better. Max of 2 months.)

What do you need to do it?

{Activity}

Write a test.10 min

Page 78: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Put it all together & iterate

Page 79: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

The belief you want to test.

The testable “thing.”

An indicator of the outcome.

“We believe people like [customer type] have a need for (or problem doing) [need/action/behavior].”

“The smallest thing we can do to prove that need is [experiment].”

“We will know we have succeeded when [quantitative/measurable outcome] or [qualitative/observable outcome].”

Hypothesis

Experiment(test)

Evidence

Something accepted as true without proof.

“Collaborative design delivers better products”

AssumptionSounds like...Definition...

Lean Experiments

Page 80: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Combine5 min

Page 81: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Smallify10 min

How can you get the same amount of learning in less time?

Redesign the experiment in a shorter timeframe:• 2 hours• 2 days• 2 weeks

Page 82: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Peer check & improve15 min

Find your partner.Do a 2-minute “quiet read.”Make 3 suggestions to strengthen the experiment.• 5 minutes each

Page 83: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Refine5 min

Page 84: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Letʼsshare stuff

Page 85: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

{Activity}

Pitch practice10 min

Come up and share your experiment.2-minute time limit.3 volunteers!

Page 86: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

an area to innovate

an experiment

• opportunity• molecule

• hypothesis• evidence

(metrics)• test

+

define it test it

Page 87: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Q&ADiscussion

Page 88: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Geek out & learn more

Page 89: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

This way of working is hard. But itʼs worth it.

Page 90: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Go be awesome.

Page 91: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Kate Rutter@katerutterhttp://intelleto.com

Thanks!

Page 92: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

HANDOUTS

Page 93: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

Managing Lean UX Work in the Enterprise

Leading Lean

Handouts

Page 94: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

• Experiments• Validated learning• Reduce waste

Lean Startup

Customer Development • make products customers wantAgile Development • Iteration & incremental releasesLean Manufacturing • Reduce waste

Startup: a human institution designed to create a new product or service under conditions of extreme uncertainty.

Page 95: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

Features

Users

Uses

Product

NeedsCompany Purpose

sketches, prototypes, pixelsUI

BUILD

MEASURELEARN

UX Stack + Lean Startup

Page 96: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

The belief you want to test.

The testable “thing.”

An indicator of the outcome.

“We believe people like [customer type] have a need for (or problem doing) [need/action/behavior].”

“The smallest thing we can do to prove that need is [experiment].”

“We will know we have succeeded when [quantitative/measurable outcome] or [qualitative/observable outcome].”

Hypothesis

Experiment

Evidence

Something accepted as true without proof.

“People need our product.”AssumptionSounds like...Definition...

Lean Experiments

Page 97: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

✓Simple & clear

✓Written as a statement

✓Establishes • participants (who)• variables (whatʼs involved)• prediction of an outcome (evidence)

✓Testable

A good hypothesis is...

Page 98: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

3. Is there an object basis?

• “per user” [ ___/user]• “per user per week” (fancy!)• Examples: per user, per session, or by interaction or item (messages per file, emails per thread)

* not required, but super-helpful

• “per week” [ ___/wk ]• “per month” [ ___/mo]2. Is there a time basis?

• “number of...” [ # ]• “average number of...” [avg ]• “percent of...” [ % ]

1. Does the metric begin with a number?

Metrics Tips

Page 99: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

98

vanity good betteruseless awesome

total number of registered

users

% of users who post an update 3+

times a day,per week

% of users who sign in 3+ times a

day,per week

% of new registered users per

week

sign-ups

a great metric......makes you look at all the other metrics and say “none of those other numbers matter if we donʼt get this right first.”

a good metric......measures the usage of the product by a person. The usage should be specific to features that deliver value to the user.

* In this example, posting an update is a key feature of the product.

Metrics Tips : Is it actionable?

Page 100: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

Further Reading

Page 101: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

The Molecule

people

problem solution

have

addressesuse

Company or team name date

/ /

Page 102: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

Assumptions

1Riskiest

Assumption

Te

stin

g n

ow

Lat

er

Team name date

/ /

2 3

Ne

xt u

p

Page 103: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

Hypothesis H

ypo

the

sis

Team name date

/ /

“We believe people like ________________________________

have a need for (or problem doing)

_______________________________

_______________________________

_______________________________.”

customer type

need/action/behavior

Page 104: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

Experiment

We believe that...

We will do/make...

We will know the hypothesis is valid if by we get...

Hyp

oth

esi

s

date

quantitativemeasurable outcomes

Te

st E

vid

en

ce

qualitativeobservable outcome

Team name date

/ /

Page 105: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

!"#$%&

Evidence dashboard

!"#$%&

!"#$%&

by

Goal

Notes

/ / / / / /

'()*++"++),$(-$"++.)/")/%00)!"*+1$")#2"+")!"#$%&+3

4*#"

Page 106: Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014

http://leanstartupmachine.com/validationboard/