Page 2
Who is Agile Lab?
GO BIG (data) or GO HOME
Page 3
Summary
•Why streaming matters
•Why prediction?
•Streaming architecture
•Spark streaming
•Demo time
Page 4
Why streaming
matters
Ⓒ2015 Agile Lab S.r.l.
Page 5
Why streaming matters
Data Big Data
Business Reaction
Batch Analysis
Typical BigData Workflow
Page 6
Why streaming matters
DataReal Time Processing
FASTER REACTIONS MORE PROFITS
Business Reaction
Streaming BigData Workflow
Page 7
Why streaming matters
• Fleet Management• Insurance• Recommendation• Etc...
Page 8
Why prediction?
Ⓒ2015 Agile Lab S.r.l.
Page 9
Why prediction?
• Rule based categorization and clustering is obsolete
• Pattern discovery
• Adaptation to fast changing data
• Smart thinking: no dummies
• Prediction is more valuable
Page 10
Streaming
architecture
Ⓒ2015 Agile Lab S.r.l.
Page 11
Streaming architecture
Ingestion Layer
Processing Layer
Serving Layer
Page 13
Spark Notebook
Use Apache Spark straight from the Browser
Page 14
Demo time...
Ⓒ2015 Agile Lab S.r.l.
Page 15
Card transaction analysis
PAN CIFRATO | AMOUNT | DESCRIPTION | TIMESTAMP
Classificazione delle transazioni
online/offline
PAN CIFRATO | AMOUNT | DESCRIPTION | TIMESTAMP | ISONLINE
fraud detection algorithm
SQL aggregation
Generazione di allarmi in tempo reale
Page 16
We are
hiring...
Ⓒ2015 Agile Lab S.r.l.
[email protected]