Integrating Beta Community Testing into Development using Gamification (EuroSTAR 2015)

Integrating  Beta  Community  Testing  into  Development  using  Gamification

Jana  Gierloff,  InnoGames

Travel  Plan

Introduction

First  Stop

Construction  Zones

Switches

Future  Tracks

Introduction  -­‐ Train

• Cross-­‐platform  (Browser,  Mobile)  MMO,  RPG• 150+  million  registered  players• 350+  employees  from  30  nations• F2P  Publisher,  Developer

Introduction  -­‐ Conductor

• Since  2011  working  for  InnoGames• Currently  Senior  QA  Technical  Tester• Projects:  Tribal  Wars,  Forge  of  Empires

Introduction  -­‐ Passenger

• Care  for  the  customers  and  quality  of  the  product

• The  less  bugs  the  less  complaints

Introduction  -­‐ Passenger

• Dedicated  and  motivated  players• Like  to  play  with  a  minimum  of  

nuisance• Interested  in  new  content  before  it  

goes  live

First  Stop  -­‐ Gamification

Gamification is  the  use  of  game  thinking  and  game  mechanics  in  none-­‐game  contexts  to  

engage  users  in  solving  problems  and  increase  users’  self  contributions.

First  Stop  -­‐ Game  Mechanics

Bonuses

AchievementsCountdown

Discovery

Levels

Points Progress

Status

First  Stop  -­‐ Team

• Strengthening  the  Beta  team• Experienced  players  with  game  knowledge• Prior  testing  knowledge

• Direct  communication  channels• Faster  reaction  and  feedback  cycle

Construction  Zone  -­‐ Mission  Goal

• Activation  and  increasing  the  beta  testing  activities  • Increase  issue  spotting  rates  for  features  with  random  content  • Gauge  reactions  and  reception  of  a  slightly  more  regulated  

feedback  approach

Construction  Zone  -­‐ Missions

Rules• Template  usage• No  duplicates• No  comments,  discussions,  etc.• Not  “by  design”

Construction  Zone  -­‐ Missions

• Short  descriptions• TemplateTasks

• Questions• ProblemsTesting

• Error  reporting• Test  reportReport

Construction  Zone  -­‐ Mission  Result

• Reduction  of  defect  reporting  after  release  by  25%

• Bug  reports  of  higher  quality  by  beta  testers

• Increased  beta  testing  activities

Construction  Zone  -­‐ Experience

• Better  planning  certainty  in  bigger  teams• Steady  testing  activities  through  regular  feature  

updates• High  fluctuation  among  beta  testers

Switches  -­‐ Long-­‐term

• Everlasting  leaderboard• Points  &  levels

• Achievements• Badges

Switches  – Mid-­‐term

• Seasonal  leaderboard• 3  months  duration

Future  Tracks

• Automated  workflow• Bug  reporting  tool  integrated  into  forum• Extending  to  mobile

Thank  You!