Fitting Microsoft Hadoop Into Your Enterprise BI Strategy Cindy Gross | @SQLCindy | SQLCAT PM http://blogs.msdn.com/cindygross
Feb 24, 2016
Fitting Microsoft Hadoop Into Your Enterprise BI Strategy
Cindy Gross | @SQLCindy | SQLCAT PMhttp://blogs.msdn.com/cindygross
What Big Data Is and Isn’t
Microsoft Hadoop
Data, Insights,Visualization
Big Agenda
SQL, NoSQL, Hive
Unstructured NoSQL
Structured SQL
SQL Server
I don’t need no NoSQL…. Do I?
Hadoop
Fulfill Different Needs
HiveQL TSQL
How do I leverage my #SQLAwesomeness?
SELECT deviceplatform, state, countryFROM hivesampletableLIMIT 200;
Hive
SFTPAmazon S3
Azure Data Market
Azure Blob Store
All your data are belong to us
Sqoop to/from relational
Hive ODBC Driver
MapReduce
HDFS
Big Data is what again?
HadoopMassivel
y Parallel Processing
Streaming
Machine Learning
Unstructured
Hadoop Ecosystem SnapshotETL Tools BI Reporting RDBMS
External Stores (S3, Azure Blobs,
Azure Data Market, etc)
Telemetry Management• Clickstream and
Application Log Analysis
• Sensor Data
IT Management• SLA Monitoring• Cyber Security• Forensic Analysis
When is big data a big fit?
Online Commerce• Sentiment Analysis• Recommendation
Engines• Search Indexing /
Quality
Financial Services• Risk Modeling• Threat Analysis• Fraud Detection• Credit Scoring
Replacement for relational - NO
Simply a VLDB - NO
Big data is not the only tool
Fast for subsets & filtered data - NO
The answer to everything - NO
Variability – Multiple interpretations
Velocity – Need decisions fast
VVVVroom
Variety – Many formats
Volume – beyond what environment can handle
Hive ODBC Driver
Sqoop
What does Microsoft bring to the table?
JavaScript
Hadoop On Azure - CTP
OpenSource Apache Hadoop
Elasticity
Familiar, reusable skills
Why is Microsoft Hadoop a fit for my Enterprise?
Ease of data movement
Interactivity
Visualization
Self Service
Those Seeking Insights
Information Workers
Who uses Big Data?
Anyone who uses BI now
Data Scientists / Data Teams
Hive ODBC Driver + Excel Add In
PowerPivot
How do we visualize the results?
Power View
Custom Tools
Take Action
Insights to Action
Discover Insights
Rinse and Repeat
What Big Data Is and Isn’t
Microsoft Hadoop
Data, Insights,Visualization
Big Summary
SQL, NoSQL, Hive
Big Data References
Hadoop: The Definitive Guide by Tom WhiteSQL Server Sqoop http://bit.ly/rulsjX JavaScript http://bit.ly/wdaTv6Twitter https://twitter.com/#!/search/%23bigdata Hive http://hive.apache.orgExcel to Hadoop via Hive ODBC http://tinyurl.com/7c4qjjjHadoop On Azure Videos http://tinyurl.com/6munnx2Klout http://tinyurl.com/6qu9php Microsoft Big Data http://microsoft.com/bigdataDenny Lee http://dennyglee.com/category/bigdata/ Carl Nolan http://tinyurl.com/6wbfxy9 Cindy Gross http://tinyurl.com/SmallBitesBigData
Thank You to our Sponsors
Fitting Microsoft Hadoop Into Your Enterprise BI Strategy
Cindy Gross | @SQLCindy | SQLCAT PMhttp://blogs.msdn.com/cindygross