CompTIA Colloquium 2014: Big Data: Are You Ready for this Growing Market?

Big Data: Are You Ready for this Growing Market?

Tim Herbert VP, Research & Market Intelligence

CompTIA [email protected]

On Tap for Today: Learning Objectives

Objective 1: framing the discussion

Objective 2: understanding needs

Objective 3: assessing opportunities

What is Big Data?

…it’s ‘complicated’

Big Data: It’s All Relative

Consensus Definition: the 3 Vs A volume, velocity and variety of data that exceeds an organization’s storage, compute and management capacity for accurate and timely decision-making. (Source: The MetaGroup)

Emerging add-ons to the definition: veracity and value

Most companies operate somewhere along the data continuum

Users Become More Familiar with Concepts Associated with Big Data

45%

55%

24%

76%

SomewhatFamiliar / NotThat Familiar

NET Familiar

2012 2013

Familiarity with Big Data Concepts

0

20

40

60

80

100Cloud Computing

Big Data

BYOD

2012 2011 2013

Google Search Trending

1

2

3

4

5

Wasted time that could be spent in other areas of the business

Internal confusion over priorities

Inefficient or slow decision-making / Lack of agility

Inability to effectively assess staff performance

Lost sales

8 in 10 executives agree (NET) to the statement: "If we could harness all of our data, we'd be a much stronger business”

Top 5 Consequences of Ineffectively Managing/Using Data

Why the Interest in Big Data?

Data Management and Utilization Framework

Challenge #1: Lack of a Unified Data Strategy

Unstructured Data

10%

Structured Data

Silos Reduce Data Utility for Many Businesses

16%

56%

28%

High Degree of Data Silos

Little or No Data Silos

Moderate Degree of Data Silos

Fewer than 1 in 3 companies can provide a robust single customer view (CSV)

Source: CompTIA’s Big Data Insights & Opportunities study

Challenge #2: Asking the Right Questions and then Aligning to Possible Sources of Answers

Matching data findings to business objectives

Integrating data tools with existing data sets

Understanding data needs of all business units

Building appropriate skills in areas of data management/analysis

Evaluating available tools for data management/analysis

Top 5 Challenges in Using Data Analysis Tools

1

2

3

4

5

57% of businesses report currently using some type of data analysis, data mining or business intelligence tools; another 36% plan to start using soon.

Challenge #3: Reducing Big Data Challenges to Lots of Manageable Small Data Tasks

Data Analytics or Data Capability Type Currently

Doing Well

Doing, But Want to Improve

Want to Start Doing

Real-time analysis of incoming data 26% 52% 17%

Search capabilities across organization's data sources 24% 50% 17%

Website traffic analysis 28% 47% 16%

Remote or mobile access to corporate data 26% 46% 20%

Customer profiling and segmentation analysis 24% 46% 24%

Visualization capabilities (e.g. dashboards, etc.) 24% 46% 19%

Predictive analytics 23% 44% 25%

Email marketing campaign effectiveness 32% 42% 14%

Social media monitoring 26% 40% 22%

Metrics and Key Performance Indicators (KPIs) 23% 39% 26%

Relationship analysis and pattern recognition 26% 37% 26%

6 in 10 businesses report being significantly or moderately deficient in data-related skills

Big Data Skills Span Many Functional Areas

IT-centric skills

Business-centric skills

Hybrid skill sets

Data Infrastructure

Interpretation, BI, Visualization & Presentation

Data Management, Processing &

Analytics

Big Data Jobs: Demand Projections

Projects 4.4 million new IT jobs will be created globally by 2015 to support big data, with 1.9 million of the jobs created in the U.S.

By 2018, projects a shortage of up to 1.69 million big data positions. Of which, 140,000 – 190,000 unfilled positions in deep technical fields and 1.5 million in the area of analytics, business intelligence and data-savvy managers.

During last 90 days, there were 67,478 job postings that included a skills requirement in the area of data mining.

23%

23%

26%

42%

43%

33%

29%

31%

32%

62%

30%

39%

41%

36%

59%

Contract with outside technologyconsultants or vendors

Contract with outside businessconsultants or vendors

Hire new employees with desiredexpertise

Utilize current capabilities, working to improve along the way

Provide training to current employeesLarge Firms

Small Firms Medium-size Firms

Planned Strategies to Meet Data-Related Skills Needs

Big Data Training & Development Framework

Data Infrastructure

Data Management &

Processing

Data Interpretation & Visualization

- Storage - Data center - BC/DR - Security - Data capture

- Database administrator - Architecture / developer - Data / application integration - Data lifecycle management

- Data analytics / BI - Data scientist - Presentation / Visualization

- IBM Certified Specialist – Netezza - MicroStrategy Certified Developer - SAS Certified Predictive Modeler - Tableau Certified Professional

- Cisco CCNP Data Center - EMC Storage Administrator - CompTIA Storage+ powered by SNIA - CompTIA Security+ - VMware Datacenter Administration

- Microsoft Certified DBA - Oracle DBA Certified Master - Cloudera Certified Administrator

for Apache Hadoop (CDH3)

*Examples are for illustrative purposes ; not meant to be an all inclusive list or not meant to represent market shares.

Desired Data Skill Areas of Improvement

13%

15%

21%

28%

32%

34%

35%

37%

37%

46%

Machine learning

Non-relational databases (e.g. MongoDB etc.)

Data visualization

Distributed storage (e.g. Hadoop etc.)

Standard storage options (cloud, SSD, etc.)

Data security

Predictive analytics

Relational databases

Data mining

Real-time analytics

Closing Thoughts

- The market will take time to develop. Remember Amara’s Law, “It’s easy to overestimate a technology’s impact in the short-term, while underestimating its impact long-term.”

- Many emerging Big Data tools and tactics can be applied to small data

problems. - Big Data is an expansive topic with many moving parts. There are

opportunities along the entire Big Data chain.

For More Information

CompTIA’s research program publishes around 25 unique studies year. CompTIA members and partners have access to a research library containing more than 100 reports covering technology, business, workforce and channel trends. CompTIA research and events is a couple of ways in which the association re-invests resources in the IT channel and the IT workforce. As the voice of the IT industry, CompTIA has hundreds of tools, market intelligence reports and business training programs to help IT channel organizations grow. CompTIA also guides industry training and certification in order to build a stronger and more diverse IT workforce. Visit www.comptia.org for more information.