ABDW17-Lightning Talks track-Complex Event Processing using Apache Apex

1

CEP Using Apache Apex and Drools

Priyanka Gugale (Shah)

priyag@apache.org

2

•Understand CEP•CEP Characteristics•CEP Use cases•Challenges•CEP using Apache Apex•Drools•Example Application

Agenda

3

•Complex Event Processing•Processing multiple events to identify meaningful events in event cloud•Realtime analysis of stream event data

CEP

4

•Only a few events in huge events volume are important•Strong temporal relationships between events•Usually composition and aggregation of events is important

CEP Characteristics

5

•Financial• Algorithmic trading

•Security• Fraud detection

•E-commerce• Recommendation Engine

•Healthcare• Realtime Health Monitoring System

•Energy• Outrage detection

CEP Use cases

6

http://www.idigitaltimes.com/silicon-valley-season-3-spoilers-what-richards-failed-plans-mean-pied-piper-532555

CEP, What’s new in it?

7

•Data is growing•No support for scale out•Meeting SLAs•Fault Tolerance•Managing unstructured data•Handling different data types

http://numericanalytics.com/tag/big-data/

Challenges

Data is growing bigger everyday

8

•Platform to process stream data in real time•Scalable•Highly performant•Fault tolerant•Stateful•Distributed•Easily operable

Apache Apex

9

•Rules engine•Enables temporal correlation of events•Provides stream processing mode•Manages Event life cycle•Support sliding windows of interesting events•Support a session scoped unified clock

Drools

10

•Supported Rule Formats• DRL (Drools Rule Language)• DSL (Domain-specific language)• Decision Tables• Guided rule editor• XML

Drools

11

Example Application

Data Sources

Sensor Data

Social Media

Web Servers

App Servers

Click Streams

Real-time analytics & Visualizatio

ns

Real-time DataVisualization

CEPInput Output

12

Thank You...