1 Data mining goes mainstream - The truth is out there Mike Davis Principal Analyst UKKDD March 2013 © All images acknowledged © msmd advisors Ltd 2013 responsive, credible, flexible
May 12, 2015
1
Data mining goes mainstream- The truth is out there
Mike Davis Principal Analyst
UKKDD March 2013
© All images acknowledged © msmd advisors Ltd 2013
responsive, credible, flexible
2 © msmd advisors Ltd 2013
(c)
20th
Cen
tury
Fox
3 © msmd advisors Ltd 2012
Running order Why all the fuss about big data?
So who uses big data? (and why)
How has it helped business to date?
How do you convey the importance?
What is a data scientist? Will data science ever be 'sexy'?
4
5 Terabytes of electronic data under management
© msmd advisors Ltd 2012
5
Big data and the challenge of decision making
Size
Scope
Speed © msmd advisors Ltd 2012
6
Decision making requires effective information
…That’s delivered:
At the right place – and in context
At the right time – and complete / credible / trusted
To the right person(s) – who have authority to
make decisions
© msmd advisors Ltd 2012
7
There's simply too much data to deal with
The petabyte is the new data norm
Tsunami of human and machine generated dataMultiple formats
Democratisation of data800 Tweets per second (12 gigabytes)Facebook generates 100 TB of data…per day
Organisations are struggling to store, access and process data efficiently
Structured and unstructured information is processed in separate systems
Some formats are difficult to process © msmd advisors Ltd 2013
8
So where's the value in big data?
© msmd advisors Ltd 2013
9
Big data in marketing - Social network analysis
World’s biggest marketing focus group
Who’s talking about you? What are they saying? Why?
Who are the opinion leaders?
Highly contextual text analytics
Classic many-to-many relationship problemMap & measure relationships & flows
between people, groups, computers, URLs, etc.
Facebook adds 10 – 15 TB/day to DW © msmd advisors Ltd 2012
10
The need for precision
© msmd advisors Ltd 2012
11
Understanding data
© msmd advisors Ltd 2013
12
Understanding data
© msmd advisors Ltd 2013
13
Understanding data
© msmd advisors Ltd 2013
14
Understanding data
© msmd advisors Ltd 2013
15
The emergence of in memory databases
© msmd advisors Ltd 2013
16
Who or what is a data scientist?
© msmd advisors Ltd 2013