Top Banner
74

Interactive analytics at scale with druid

Jul 14, 2015

Download

Technology

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Interactive analytics at scale with druid
Page 2: Interactive analytics at scale with druid
Page 3: Interactive analytics at scale with druid
Page 4: Interactive analytics at scale with druid
Page 5: Interactive analytics at scale with druid
Page 6: Interactive analytics at scale with druid
Page 7: Interactive analytics at scale with druid
Page 8: Interactive analytics at scale with druid
Page 9: Interactive analytics at scale with druid
Page 10: Interactive analytics at scale with druid
Page 11: Interactive analytics at scale with druid
Page 12: Interactive analytics at scale with druid
Page 13: Interactive analytics at scale with druid
Page 14: Interactive analytics at scale with druid
Page 15: Interactive analytics at scale with druid
Page 16: Interactive analytics at scale with druid
Page 17: Interactive analytics at scale with druid
Page 18: Interactive analytics at scale with druid
Page 19: Interactive analytics at scale with druid
Page 20: Interactive analytics at scale with druid
Page 21: Interactive analytics at scale with druid
Page 22: Interactive analytics at scale with druid
Page 23: Interactive analytics at scale with druid

By advertiser…

By country…

Page 24: Interactive analytics at scale with druid
Page 25: Interactive analytics at scale with druid
Page 26: Interactive analytics at scale with druid
Page 27: Interactive analytics at scale with druid
Page 28: Interactive analytics at scale with druid
Page 29: Interactive analytics at scale with druid
Page 30: Interactive analytics at scale with druid

Device Publisher Cost

Iphone Google 0.1€

Android Yahoo 0.2€

Dimension Cost

Iphone 0.1€

Android 0.2€

Google 0.1€

Yahoo 0.1€

Iphone, Google 0.1€

Android, Yahoo 0,2€

Page 31: Interactive analytics at scale with druid
Page 32: Interactive analytics at scale with druid

Device Publisher Product Cost

Iphone Google Computer 0.1€

Android Yahoo Cloth 0.2€

Dimension Cost

Iphone 0.1€

Android 0.2€

Google 0.1€

Yahoo 0.1€

Computer 0.1€

Cloth 0.2€

Iphone, Google 0.1€

Iphone, Computer 0.1€

Google, Computer 0.1€

Android, Yahoo 0.2€

Android, Cloth 0.2€

Yahoo, Cloth 0.2€

Iphone, Google, Computer 0.1€

Android, Yahoo, Cloth 0.2€

Page 33: Interactive analytics at scale with druid
Page 34: Interactive analytics at scale with druid
Page 35: Interactive analytics at scale with druid
Page 36: Interactive analytics at scale with druid
Page 37: Interactive analytics at scale with druid
Page 38: Interactive analytics at scale with druid
Page 39: Interactive analytics at scale with druid
Page 40: Interactive analytics at scale with druid
Page 41: Interactive analytics at scale with druid
Page 42: Interactive analytics at scale with druid
Page 43: Interactive analytics at scale with druid
Page 44: Interactive analytics at scale with druid

SELECT sum(revenue) AS “Revenue",sum(sales) AS “Sales"

FROM customer-insightsWHERE client_id = 2255 AND date BETWEEN "2014-08-01" AND "2014-08-08"GROUP BY day(date)

Page 45: Interactive analytics at scale with druid

{queryType: "Timeseries",dataSource: "customer-insights",granularity: "day",aggregations: [

{ type: "longSum", fieldName: "revenue", name: "Revenue" },{ type: "longSum ", fieldName: "sales", name: "Sales" }

],filter: { type: "selector", dimension: "client_id", value: 2255 },intervals: ["2014-08-01T00:00/2014-08-08T00"]

}

Page 46: Interactive analytics at scale with druid

{queryType: "Timeseries",dataSource: "customer-insights",granularity: "day",aggregations: [

{ type: "longSum", fieldName: "revenue", name: "Revenue" },{ type: "longSum ", fieldName: "sales", name: "Sales" }

],filter: { type: "selector", dimension: "client_id", value: 2255 },intervals: ["2014-08-01T00:00/2014-08-08T00"]

}

Page 47: Interactive analytics at scale with druid

{queryType: "Timeseries",dataSource: "customer-insights",granularity: "day",aggregations: [

{ type: "longSum", fieldName: "revenue", name: "Revenue" },{ type: "longSum ", fieldName: "sales", name: "Sales" }

],filter: { type: "selector", dimension: "client_id", value: 2255 },intervals: ["2014-08-01T00:00/2014-08-08T00"]

}

Page 48: Interactive analytics at scale with druid

{queryType: "Timeseries",dataSource: "customer-insights",granularity: "day",aggregations: [

{ type: "longSum", fieldName: "revenue", name: "Revenue" },{ type: "longSum ", fieldName: "sales", name: "Sales" }

],filter: { type: "selector", dimension: "client_id", value: 2255 },intervals: ["2014-08-01T00:00/2014-08-08T00"]

}

Page 49: Interactive analytics at scale with druid

{queryType: "Timeseries",dataSource: "customer-insights",granularity: "day",aggregations: [

{ type: "longSum", fieldName: "revenue", name: "Revenue" },{ type: "longSum ", fieldName: "sales", name: "Sales" }

],filter: { type: "selector", dimension: "client_id", value: 2255 },intervals: ["2014-08-01T00:00/2014-08-08T00"]

}

Page 50: Interactive analytics at scale with druid

{queryType: "Timeseries",dataSource: "customer-insights",granularity: "day",aggregations: [

{ type: "longSum", fieldName: "revenue", name: "Revenue" },{ type: "longSum ", fieldName: "sales", name: "Sales" }

],filter: { type: "selector", dimension: "client_id", value: 2255 },intervals: ["2014-08-01T00:00/2014-08-08T00"]

}

Page 51: Interactive analytics at scale with druid

{queryType: "Timeseries",dataSource: "customer-insights",granularity: "day",aggregations: [

{ type: "longSum", fieldName: "revenue", name: "Revenue" },{ type: "longSum ", fieldName: "sales", name: "Sales" }

],filter: { type: "selector", dimension: "client_id", value: 2255 },intervals: ["2014-08-01T00:00/2014-08-08T00"]

}

Page 52: Interactive analytics at scale with druid
Page 53: Interactive analytics at scale with druid

{queryType: "groupBy",dataSource: "customer-insights",granularity: "all",dimensions: ["device"],aggregations: [

{ type: "longSum", fieldName: "clicks", name: "Clicks" },{ type: "longSum", fieldName: "cost", name: "Cost" }

],filter: { type: "selector", dimension: "client_id", value: 2255 },intervals: ["2014-08-01T00:00/2014-08-08T00"]

}

Page 54: Interactive analytics at scale with druid
Page 55: Interactive analytics at scale with druid
Page 56: Interactive analytics at scale with druid
Page 57: Interactive analytics at scale with druid
Page 58: Interactive analytics at scale with druid

Iphone Google 0.35€08:12:00

Android Yahoo 0.2€08:12:00

Iphone Google 0.1€08:12:37

Android Yahoo 0.2€08:12:38

Iphone Google 0.15€08:12:39

Iphone Google 0.1€08:12:40

Page 59: Interactive analytics at scale with druid

Iphone Google 0.1€08:12:37

Android Yahoo 0.2€08:12:38

Iphone Google 0.15€08:13:02

Iphone Google 0.1€08:13:08

[email protected]

[email protected]

[email protected]

[email protected]

Page 60: Interactive analytics at scale with druid
Page 61: Interactive analytics at scale with druid
Page 62: Interactive analytics at scale with druid
Page 63: Interactive analytics at scale with druid
Page 64: Interactive analytics at scale with druid

Iphone Google Computer 0.1€08:12:37

Android Yahoo Cloth 0.2€08:12:38

Iphone Google Computer 0.1€08:12:37

Android Yahoo Cloth 0.2€08:12:38

Page 65: Interactive analytics at scale with druid

Iphone Google Computer 0.1€08:12:37

Android Yahoo Cloth 0.2€08:12:38

Page 66: Interactive analytics at scale with druid

Google

Yahoo

Microsoft

Google

Yahoo

1

2

3

1

2

Page 67: Interactive analytics at scale with druid

Google

Yahoo

Microsoft

Google

Yahoo

Google 1,0,0,0,1

Yahoo 0,1,0,1,0

Microsoft 0,0,1,0,0

Page 68: Interactive analytics at scale with druid
Page 69: Interactive analytics at scale with druid
Page 70: Interactive analytics at scale with druid
Page 71: Interactive analytics at scale with druid
Page 72: Interactive analytics at scale with druid

Filter Time period Aggregated rows Time

Biggest advertiser 6 months 1.5M 225ms

Android devices 1 month 42M 750ms

Desktop 1 month 110M 910ms

RTB networks 7 months 753M 2.4s

Page 73: Interactive analytics at scale with druid
Page 74: Interactive analytics at scale with druid