MicroStrategy at Badoo

at Dorota KuleszoFrancesco Mucio MicroStrategy Symposium, London, 22 april 2016

What is ?● Social Network for meeting people near you

● Over 300M users in 190 countries

● 200 employees based in London and Moscow

● Over 100M downloads on Android

● Also on iOS, Windows Phone, Web and Mobile Web

● Very Agile working environment

● We needed a proper BI tool - among 14 candidates

● Our data volumes - user level data

● Environment - Linux, Database, SSO

● Technical users with high expectations

Why ?

● Hard to set up in our environment

● No real dimensional model

● Data/ETL Team had to prepare data for us

● Time to onboard users and earn their trust

vs

What does with now?● Fancy Dashboards around the office● Data Discovery tools● Analysis delivered by email● Self Service Reports● Weekly releases

90+ Users in Finance, Billing, Marketing, Developers, User Ops, Founders

‘s BI Architecture

‘s BI Architecture

Badoo’s Database

EXASOL is an Massive Parallel Processing (MPP) database.

It is an in memory columnar database.

● 8 Nodes (plus 1 spare) with 5.6 TB of RAM

● ~100 TB of Raw Data - ~30 TB of Data on Disk

● Each node has 8 TB of Disk, in RAID 2 and redundancy factor = 2

and Query Generation Time: 0:00:00.13Total Elapsed Time in Query Engine: 0:18:36.68

Sum of Query Execution Time: 0:16:08.46Sum of Data Fetching and Processing Time: 0:01:03.73

Sum of Data Transfer from Datasource(s) Time: 0:00:57.93Sum of Analytical Processing Time: 0:00:00.00Sum of Other Processing Time: 0:01:24.49

Sum of Cube Publish Time 0:19:06.37

Number of Rows Returned: 5759450Number of Columns Returned: 38Number of Temp Tables: 0Total Number of Passes: 15Number of Datasource Query Passes: 15Number of Analytical Query Passes: 0

Query Improvements

● Use real tables

● Use parallelization

● Use the Pre/Post Processing statements

and

and Query Generation Time: 0:00:00.13Total Elapsed Time in Query Engine*: 0:11:18.82Sum of Query Execution Time: 0:18:30.86Sum of Data Fetching and Processing Time: 0:01:04.82


* This report has some passes that have been executed in parallel. Individual time components may not add up to Total Elapsed Time in Query Engine.

Sum of Cube Publish Time 0:11:28.63

Number of Rows Returned: 5759450Number of Columns Returned: 38Number of Temp Tables: 17Total Number of Passes: 49Number of Datasource Query Passes: 49

and Query Generation Time: 0:00:00.09Total Elapsed Time in Query Engine: 0:02:43.29

Sum of Query Execution Time: 0:00:53.08Sum of Data Fetching and Processing Time: 0:00:52.09


Sum of Template Calculate Time 0:00:00.00Sum of AE Data Persisting Time 0:00:00.46Sum of Cube Publish Time 0:02:56.36

Number of Rows Returned: 4702678Number of Columns Returned: 38Number of Temp Tables: 12

Enable Your Users with Visual Insight

● High Level Dashboards

● Analysis Dashboards

● OLAP Reports


● High Level Dashboards

● Analysis Dashboards

● OLAP Reports


This is still not enough for our users!

Let Your Users Do the Legworkwith Transaction Services

Enable Your Users with Transaction Services

● Agile environment

● New analysis have an assessment period

● People just like to play with data

This was just bad

Time consumingSelf esteem problems

We would end up hating our users


“We have a Coefficient that we would like to use in our calculation, this can be different for Campaign Media Source, Country, and Platform...”

200+ Media Sources

254 Countries

12 Platforms

200+ x 254 x 12 = 609600!


We had to convince them to have a go withTransaction Services!




Don’t Reinvent the Wheel

Just Use MicroStrategy

Don’t reinvent the wheel: use MicroStrategy

Problem: Deliver a csv file to an external location.

Proposed Solution:

❏ Generate the data

❏ Put the data on a local drive

❏ Create a tool to copy it remotely

Don’t reinvent the wheel: Use MicroStrategy

Beat The CommuteLearn to use

Command Manager

Save Time with Command Manager

Few things we do with Command Manager

● Cube Refresh

● Start Schedules

● Manage Our Users

● Configure Database Connections


My two cents about Command Manager:

● Get familiar with it

● Try to script repetitive tasks

● Integrate it with other tools


MicroStrategy Web Deployment Made Easy


What we started with:

● MicroStrategy WAR File

● SDK Customizations

● Deployment scripts

● Settings changes

- Deployed Manually

- Deployed Manually

- Executed Manually

- Undocumented


1. GIT

2. Maven

3. Jenkins


http://192.168.99.100:8080/

http://192.168.99.100:8080/

that’s all folks… maybe

q & a

MicroStrategy at Badoo

Documents