Don’t Lose The Data Battle Before It Even Begins Maneesh Joshi Senior Director, Product Marketing and Strategy SnapLogic
Jan 15, 2015
Don’t Lose The Data Battle Before It Even Begins
Maneesh JoshiSenior Director, Product Marketing and StrategySnapLogic
2
The data battle is brewing
Commodity Hardware
Open Source
Algorithm Output= f(Your Data)
Data is everywhere
Users
Mobile
Enterprise
CloudBig Data
Data Center
ESB RDBMS
Simplifying Data Access
Users
Mobile
Enterprise
Cloud Big Data
Data Center
ESB RDBMS
Data Containerization with Snaps
BUY• SnapStore• Certified and
supported by SnapLogic
BUILD• SDK + API• Java, Python• Customer, Partner or
SnapLogic
6
Big Data as a Service Architecture
Structured Data
UnstructuredData
DB
Collect Translate & Enrich Distribute1 32
DataView
DB
Amazon Redshift
Select Customers
7
Corporate Power
• Store information on CouchDB in AWS
as semi-structured JSON documents with 100+ attributes
• SnapLogic, TIBCO and Java programs to be used in “ingestion” layer to maintain data in CouchDB
• Use AWS Elastic Search Layer on top of CouchDB to provide querying
APPROACH
• 6x improvement in development time compared to TIBCO and hand-coding
• Intuitive graphic designer allows for agile changes in response to requirements
• Seamless integration between cloud applications and on-premise legacy applications with conversion between structured and semi-structured data
• Building snaps in SnapLogic to connect with new systems determined to be the fastest way to connect to a new system
• Full-automated one-touch deployment allows for elastic scaling of SnapLogic cluster
BENEFITS TO THE CLIENT
• BBY Open vision to encourage a vibrant reseller and developer community.
• Data propagation from 15-20 major backend systems, accrued over 12-15 years
• Backend Systems are continually changing (30+ per month), so need to move away from hand coding
• Million+ SKUs: Product information, Warranty Plans with 100+ Attributes and Pricing (with 16 Localization Scenarios)
• External traffic is expanding by million hits per month
BACKGROUND
Agile Cloud ETL for CouchDB on AWS
Summary
• Algorithm Output = f(Your Data)
• Without comprehensive data inputs, the battle of Big Data is lost before it even begins
• SnapLogic speeds up access of structured and unstructured data in the cloud, and on-premise
Q&A