Page 1
1 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Brought To You By
&
Testing & QA Transformation Trends -
Capgemini’s 2015 World Quality Report
Renu Rajani, VP, Capgemini India
Page 2
2015-16
World Quality Report 2015 October 2015
Page 3
3 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Contents
World Quality Report 2015-16
About the Report
Key Research Findings
Page 4
4 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015
Section 1: World Quality Report 2015-16
Page 5
5 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
World Quality Report 2015-16 (7th Edition)
The 80 page report + 10 country pullouts (translations for
Germany, France, China)
6 main chapters covered in this edition:
• Digital Transformation
• QA and Testing Budgets Outperform
• Security Testing is the Top IT Strategy Priority
• Agile Testing Maturing to the Enterprise
• Industrialization Becoming More Advanced
• Test Environments and Test Data Management
Mark Buenen & Ajay Walgude (co-authors) & 50+ other
Capgemini and Sogeti Testing SMEs, Region/Country Leads,
Sector and TLI SMEs, as well as SMEs from HP
Sector analysis (included in the main report) + country pull-
outs:
• Industries: CPRD; E&U; FS; Govt. & Public Sector; TME, High
Tech, Automotive, Healthcare & LifeSciences (new)
• Geographic analysis: ANZ; China; France; Germany; Benelux;
North America; Nordics; UK, Eastern Europe, Middle East (new)
Page 6
6 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
About the Research Study
Company size: 1,000 –
4,999, 5,000 – 10,000
and 10,000+
Controlled mix of CIOs,
IT Directors, VP
Applications/QA, Testing
Manager and CDO/CMO
See next slide for
detailed splits
1560 interviews
CATI 25% (390)
CAWI 75% (1170) Global study
April – June 2015
All interviews
conducted abided by
the rules and
regulations set by the
MRS
How
When
Where
Who
What
Study details
Page 7
7 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Detailed Split of Research Surveys by Region/Sector/Profile
Page 8
8 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015
Section 2: Key Research Findings
Page 9
9 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Executive management objectives with QA & Testing
Page 10
10 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Top 5 technical challenges in Application development
Page 11
11 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Top 5 business challenges for Application development
Page 12
12 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Top 5 most important aspects of your IT strategy
Page 13
Digital Transformation
Page 14
14 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Percentage of Organizations with a dedicated Chief Digital Officer
Page 15
15 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
QA and Testing budget split for new developments
Page 16
16 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Challenges for Testing Customer Experience in Multi-channel solutions
Page 17
17 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Focus areas for testing mobile applications
Page 18
18 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Greatest challenge in testing mobile and multi channel (Mobile, Social, Traditional) applications
Page 19
QA and Testing budgets outperform
predictions
Page 20
20 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Budget allocation as percentage of IT spend
Page 21
21 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
QA & Test budget versus Digital Maturity
Page 22
22 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Split of QA and Test Budget
Page 23
23 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Focus areas for IT Strategy
Page 24
24 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015
Security Testing is the Top IT Strategy
Priority
Page 25
25 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Commonly performed security testing activities
Page 26
26 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Type of security testing team
Page 27
27 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
In what stage of Application Lifecycle is security testing undertaken?
Page 28
Agile Testing Maturing to the Enterprise
Page 29
29 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Approaches to testing in agile in your organization
Page 30
30 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Challenges faced in applying testing to agile development
Page 31
31 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Implementation of various DevOps practices
Page 32
Industrialization Becoming More
Advanced
Page 33
33 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Standardized/industrialized Testing Center of Excellence (TCOE)
Page 34
34 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Plan to create Standardized / Industralised TCOE
Page 35
35 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Important Elements in the setup of TCOE
Page 36
36 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Roles in Agile TCoE
Page 37
37 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Percentage of automated test cases within the organization
Page 38
38 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Test Automation Benefits
Page 39
39 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Test Automation challenges
Page 40
Test Environments and Test Data
Management
Page 41
41 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Allocation of Testing Budget
Page 42
42 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Test Environment types
Page 43
43 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Percentage of testing performed in a Cloud-based test environment
Page 44
44 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Challenges with Test Environment Provisioning
Page 45
45 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Test Data Generation techniques
Page 46
46 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Challenges in managing test data
Page 47
47 Copyright © 2015 Capgemini, Sogeti, and HP. All Rights Reserved
World Quality Report 2015-16 | Sep 2015 Agile Testing Alliance Global Gathering
Summary of Findings & Recommendations
Re-focus QA &Testing on Customer Experience and Business Assurance
Transform traditional TCoE to Agile & DevOps
Industrialize Security Testing
Use Predictive Analysis to prioritize testing activities
Continue to grow Test Automation
Build Virtualization and Cloud Testing Platform capabilities
Expand skill sets of QA & Test teams
Page 48
www.capgemini.com/testing
www.sogeti.com/testing
www.hp.com
The information contained in this presentation is proprietary and confidential.
Copyright ©2015 Capgemini, Sogeti, and HP. All rights reserved.
Rightshore® is a trademark belonging to Capgemini.
No part of this document may be modified, deleted or expanded by any process or means without prior written permission from Capgemini.
About HP
HP is a technology company that operates in more than 170 countries around
the world. We explore how technology and services can help people and
companies address their problems and challenges, and realize their
possibilities, aspirations and dreams. We apply new thinking and ideas to
create more simple, valuable and trusted experiences with technology,
continuously improving the way our customers live and work.
No other company offers as complete a technology product portfolio as HP.
We provide infrastructure and business offerings that span from handheld
devices to some of the world’s most powerful supercomputer installations.
About Capgemini and Sogeti
With almost 180,000 people in over 40 countries, we are one of the world’s foremost providers of
consulting, technology and outsourcing services. The Capgemini Group reported 2014 global
revenues of EUR 10.573 billion. A multicultural organization through and through, we’ve
developed our own way of working via the Collaborative Business Experience™ and Rightshore®,
our worldwide delivery model.
Sogeti is a leading provider of technology and software testing, specializing in Application,
Infrastructure and Engineering Services. Sogeti brings together more than 20,000 professionals in
15 countries and has a strong local presence in over 100 locations in Europe, USA and India.
Sogeti is a wholly-owned subsidiary of Cap Gemini S.A., listed on the Paris Stock Exchange.
Together Capgemini and Sogeti have developed innovative, business-driven quality assurance
(QA) and Testing services, combining best-in-class testing methodologies (TMap® and TPI®) to
help organizations achieve their testing and QA goals. The Capgemini Group has created one of
the largest dedicated testing practices in the world, with over 17200 test professionals.
Page 49
Confidential | Copyright © Agile Testing Alliance Global Gathering
Thank You!
[email protected]
@AgileTA
https://www.facebook.com/AgileTestingAlliance
[email protected]
@UNICOMLearning
https://www.facebook.com/joinunicom