Elasticsearch as a DMP

Intimate Merger Inc.

Elasticsearch as a DMP

1

Kazuki Matsuda

about me

Kazuki Matsuda Intimate Merger Inc. (Employees: 9) Development Division

Job content • IT Infra Structure

• Development of open DMP - AudienceSearch • Such as BlueKai, Krux, Demdex

2

Elasticsearch as a DMP

3

What is DMP ?

4

DMP is …

DMP (Data Management Platform) is • The Platform for centralized management and analyzing • about Audience Data

• web site, e-commerce • Internet Survey • offline data • others…

• to achieve the optimization of the marketing action plan

5

DMP is …

6

DMP

Partner Media

Internet Survey

PrivateDMP（1st Party）

Ad Serving

Other Tools

Data Provider

DMP is …

7

DMP

Partner Media

Internet Survey

PrivateDMP（1st Party）

Ad Serving

Other Tools

Psychographic

Demographic

Site Access

Data Provider

Geographic

Practical use of Elasticsearch

Our DMP contains 360 Million IDs (3rd Party Cookie) • Psychographic Data (Partner Media) • Demographic Data (Internet Survey) • User Agent (Access Log) • Geographic Data (remote IP Address & どこどこJP)

• etc… Practical use of elasticsearch

• Extraction of IDs in any conditions • Analysis of the audience group

8

360 Million

Data Flow

9

Update

Update

Update

JOIN

※Distinct by ID

(KVS)

Data Flow

10

Update

Update

Update

JOIN

※Distinct by ID

(KVS)

Psychographic

Demographic

Site Access

Geographic

Data on Elasticsearch

11

_id segment keywords user_agent area org

1001 [234, 542] [Trip, Hawaii] Mac Safari Tokyo Intimate Merger

1002 [2, 34, 112] [sushi, soccer] Win7 Chrome Chiba -

1003 [14] [elasticsearch] Android Chrome Tokyo Recruit

Total Documents: 360 Million

Total Size: 1TB

Sample

Usage example

Case1: Ad Serving • Target

• Female • Age: 20-29 • Interested in trip to Hawaii • in Tokyo

Case2: Analyzing • Comparison of some audience groups • Extraction of features

12

Case1: Ad Serving

13

DMP

Partner Media

Internet Survey

PrivateDMP（1st Party）

Ad Serving

Other Tools

Trip, Hawaii

Female Age: 20-29

Data Provider

in Tokyo

Case2: Analyzing

14

keyword: “elasticsearch"

Streaming

Streaming Engine

johtani

Case2: Analyzing

15

keyword: “elasticsearch"

Advertising

Case2: Analyzing

16

keyword: “elasticsearch"

Cyber Agent Inc.

Case2: Analyzing

17

keyword: “elasticsearch"

Male

Case2: Analyzing

18

keyword: “elasticsearch"

Demo

19

Thank you

20

エンジニア募集

最新の技術に興味のある新メンバーを募集中です！

21

採用技術 開発基盤