Emerging Trends in Testing - Conclusions from the 2013-2014 World Quality Report

Welcome to the 2013

www.eurostarconferences.com

@esconfs #esconfs@qacooper

This webinar is presented by Makarand Teje, Capgemini & Michael Cooper, HP Software and they will discuss:

‘Emerging Trends in Testing - Conclusions from the 2013-2014 World Quality Report’

Join the conversation on Twitter!

2013-14

Highlights from World Quality Report 2013-14Fifth Edition

3Copyright © 2013 Capgemini and Sogeti. All Rights Reserved

World Quality Report 2013-14 | September 2013

World Quality Report 2013-14

Makarand (Mak)TejeSenior Vice President

Applications North America

Capgemini

Co-author of the World Quality Report 2013-14

Speakers

Michael W CooperWorldwide Sr. Product Marketing Manager

& Software Quality and Testing Evangelist

HP Software



Agenda

About the World Quality Report 2013-14

Highlights from Key Findings

Research Highlights

Recommendations



World Quality Report 2013-14

This year’s report is the fifth edition. WQR first published

in 2009.

Recognized as industry’s largest research study and most

comprehensive source of market analysis and

commentary on the state of enterprise application quality

and testing practices.

* Quality Ratings of Thought Leadership for H1 2012, White Space



World Quality Report 2013-14: Interviews by Region

WQR based on

1,500 telephone

interviews across 25

countries.

Each structured

interview lasts 35-40

minutes

Interviewees asked

up to 42 multiple

choice questions

depending on job

function

In WQR report, data

combined with

quotes / open ended

responses from 20

in-depth interviews



World Quality Report 2013-14: Interviews by Job Title

Sample: companies and other

organizations with more than

1,000 employees.

34% of interviews were

conducted with CIOs, 26% with

IT directors

Survey sample size and

composition designed to be

similar to last year’s survey to

allow for data trending

By sector: Banking & FS 26.4%; Public sector 18.3%; TME 17.1%



Key Findings



World Quality Report 2013-14: Key Findings

• The QA function is adapting to business demands by

streamlining and centralizing its structure, to achieve

efficiency and cost optimization

• A higher proportion of overall IT budget is being invested in

testing and focused on transformation projects

• Testing’s late engagement in the application delivery lifecycle

and its reliance on basic IT metrics is possibly applying a

negative brake on this increasing maturity

• Mobile testing has increased in importance as a key

discipline within the function, but lacks specialized methods,

expertise and environment



World Quality Report 2013-14: Key Findings

• Cloud adoption and cloud-based testing has slowed as

organizations continue to manage concerns regarding data

security and performance

• Significant investment in Test Environments may also be

undermined by a lack of specialist expertise

• Agile development is now widely adopted but still gives rise

to problems for testing, particularly in relation to specific

methodologies and expertise

Research Highlights



QA Budgets: Continued Growth, Shifting Priorities

QA budgets are still largely spent in infrastructure

DATA POINT: The average spending on QA as a percentage of

the total IT budget has grown from 18% in 2012 to 23% in 2013.

Testing is forecast to reach 28% of IT budgets in 2015.



QA Budgets: Continued Growth, Shifting Priorities

Proportion of Testing budgets allocated to transformational

projects grew to 46% up from 41% last year. Testing of existing

applications can be performed more efficiently and at lower costs

using automation tools and reusable assets



Transforming the Testing Organization

DATA POINT: Compared to only 4% of operational TCOEs in

2011 and 6% in 2012, this year’s research data shows rapid

growth in fully operational inhouse TCoEs to 19%



Transforming the Testing Organization

QA organizations are still mostly capturing IT based, reactive

performance metrics with Number of Defects Found being tracked by

73% of the organizations surveyed.



Mobile Testing: A Shift from Tools to Methods

Organizations across all sectors show

considerable increase in mobile test

ing

DATA POINT: Organizations across all sectors show considerable

increase in mobile testing. More than half of all organizations

interviewed (55%) have now test mobile applications compared to

an industry average of 31% in last year’s research.



Testing in the Agile Development Environment

DATA POINT: 64% of executives cite a lack of an adequate agile testing

approach as a major concern. 49% cite difficulties in identifying where to

focus their testing. 39% don’t have right tools to create reusable test sets.



Test Infrastructure and Data Management: Building Environments to Ensure Quality

DATA POINT: 53% of organizations state having to maintain multiple test

environments as a significant challenge. 45% cite lack of clarity on efficient

usage of configurations as a hurdle in provisioning test environments



Recommendations



World Quality Report 2013-14: Recommendations

• Improve reporting of business-oriented metrics to

demonstrate the value of QA

• Innovate and optimize QA operations for return on

investment

• Establish a specialized function for mobile testing

• Make greater use of the Cloud for testing

• Establish test environment and test data management

practices

• Integrate testing into agile projects

Thanks for listening!

@esconfs#esconfs @qacooper

www.eurostarconferences.com

Go towww.eurostarconferences.com

www.worldqualityreport.com or

www.hp.com/go/capgeminifor more information

http://www.eurostarconferences.com/

http://www.worldqualityreport.com/

http://www.hp.com/go/capgemini

www.capgemini.comwww.capgemini.com/testing

www.sogeti.com/testing

www.hp.com

The information contained in this presentation is proprietary. It is for internal and intermediary use only.

Copyright ©2013 Capgemini and Sogeti. All rights reserved.

Rightshore® is a trademark belonging to Capgemini.

No part of this document may be modified, deleted or expanded by any process or means without prior written permission from Capgemini.

About HP

HP creates new possibilities for technology to have a meaningful impact on

people, businesses, governments and society. The world’s largest

technology company, HP brings together a portfolio that spans printing,

personal computing, software, services and IT infrastructure to solve

customer problems.

More information about HP (NYSE: HPQ) is available at

http://www.hp.com.

About Capgemini and Sogeti

With more than 125,000 people in 44 countries, Capgemini is one of the world’s foremost providers of

consulting, technology and outsourcing services. The Group reported 2012 global revenues of EUR 10.3

billion. Together with its clients, Capgemini creates and delivers business and technology solutions that

fit needs and drive the results they want. A deeply multicultural organization, Capgemini has developed

its own way of working, the Collaborative Business Experience™, and draws on Rightshore®, its

worldwide delivery model.

Sogeti is a wholly-owned subsidiary of Cap Gemini S.A., providing local professional services,

specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti

offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security. Sogeti

brings together more than 20,000 professionals in 15 countries and is present in over 100 locations.

The Capgemini Group has created one of the largest dedicated testing practices in the world, with over

11,000 test professionals and a further 14,500 application specialists, notably through a common center

of excellence with testing specialists developed in India. Together Capgemini and Sogeti have developed

innovative, business-driven quality assurance (QA) and testing services, combining best-in-breed testing

methodologies (TMap® and TPI®) to help organizations achieve their testing and QA goals.

TMap®, TMap, NEXT®, TPI® and TPI NEXT® are registered trademarks of Sogeti, part of the Capgemini

Group

Emerging Trends in Testing - Conclusions from the 2013-2014 World Quality Report

Technology

years report

wqr report

testing conclusions

testing practices

capgemini michael cooper

cloudbased testing

testing evangelist hp

qa function