Was it Worth It? Measuring the Success of an Agility Project in Business Terms - Ethan Ram at Agile Israel 2015

How to Measure Agility Project Success in Business Terms?

Agile Israel 2015

Ethan Ram

v1.1

© All rights reservedWant to use slides from this presentation? Ask for permission: [email protected]

11-Jun-15 2

Going Agile: Scrum, Kanban, CI, DevOPs

11-Jun-15 3

How to Measure? Number of code lines? Number of releases? Number of QA bugs opened? Need less support engineers?

Main operations KPIs– Support queue– Fault rate

Release cycle timeMeasure wasteEmployee gleeBottom lines: revenues

11-Jun-15 4

Support KPI: Open Escalations in R&D

• Number of support cases pending R&D resolution

11-Jun-15 5

Agile Injection

Agility Project

Support KPI: Fault Rate

• Oper1 fault rate is under SLA after 2 years above

11-Jun-15 6

Agile Injection

Agility Project

---- Oper1 daily/trend ---- SLA ---- Oper2 daily/trend

Waste KPI: Builds vs Deliveries

• QA builds vs. Customer deliveries• Build automation reduced miss-configs by 40%• Builds per delivery down from 2.2 to 0.8

11-Jun-15 7

Agile Injection

Agility Project

QA KPI: Bugs Resolution Turnaround

• Avg. days to resolve a QA bug is down from ~30 days to ~15 days

11-Jun-15 8

Agile Injection

Agility Project

QA KPI: Game Sign-offs per Month

• Games signed-off by QA• Games titles up from 15/m to 25/m (+60%)• Game variations up from 150/m to 260/m (+73%)

11-Jun-15 9

Agile Injection

Agility Project

• Game Dev Gantt 2012 – 22 weeks critical path

Release Cycle Time: Game Dev.

11-Jun-15 10

Scoping

Week

Math

Graphics HD

2 4 6 8 10 12 14 16 18 20 22

1

Graphics SD

Scene layout

Coding

QA

6

4

2.5

8

4

4Low-spec support

4

• 2013: from 22 weeks to 12 weeks

Release Cycle Time: Game Dev.

Week2 4 6 8 10 12 14 16 18 20 22

1

3

4

4

3

3

4

2

Scoping

Math

Graphics HD

Graphics SD

Scene layout

Coding

QA

Low-spec support

11-Jun-15 11

HR: Employee Survey

Dec. ’13

11-Jun-15 12

Processes and planning57% Improved37% Same6% Worse

Working Environment73% Improved25% Same2% Worse

Mar. ’13 TOP 5 DEMOTIVATORS

Revenues: Q2-12 >> Q2-13

• Customers: Up 30%

• Deployed terminals: Up +26%

• Headcount: no-change

• Revenues: Up 14%

11-Jun-15 14

How to Measure Agility Project Success in Business Terms?

Ethan [email protected]/in/ethanram@ethanram