Top Banner
IoT Analytics Martin Keseg Enterprise Account Manager 26/10/2017
26

IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Apr 22, 2018

Download

Documents

vothuan
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

IoT Analytics

Martin KesegEnterprise Account Manager

26/10/2017

Page 2: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

What is IoT Analytics?

Raw Goods Equipment Temperature/Pressure

Equipment Vibration

Equipment Utilization Trip Distance Customer Behavior

SpeedIdle Time Inclement Weather

Page 3: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Equipment Vibration

IoT is a Big Data Problem

Equipment Temperature

Customer Behavior

Equipment Pressure

SpeedEquipment Utilization

Trip Distance

LARGE VARIETY OF SENSOR DATA

LA

RG

E V

OLU

ME

OF

DA

TA P

ER

DA

Y (

> M

ILLI

ON

)

Page 4: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Contextualize the Data

ERP

CRMAsset

Management

STRUCTURED DATA

Sensor Data

Geo-Location DataMachine Data

Image Data

Video or Voice Data

SEMI-STRUCTURED DATAUNSTRUCTURED DATA

What is the solution?How to contextualize all these data?

Page 5: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Contextualize the DataSTRUCTURED DATASEMI-STRUCTURED DATAUNSTRUCTURED DATA

SIMPLIFIED BY PENTAHO IOT ANALYTICS

Ingest Process BlendData Prep

Action

Machine Learning

ERP

CRM

Asset Management

Sensor Data

Geo-Location Data

Machine DataImage Data

Video or Voice Data

Page 6: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

6

IoT Analytics Value Tenants

321

Sense & Capture Integrate & Blend Infer & Act

Page 7: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

7

IoT Analytics Value Tenants

1

Sense & Capture

1

Asset Mgmt

Register Sensors

Model Assets

Store Sensor Data

Stream Sensor Data

Page 8: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

8

IoT Analytics Value Tenants

2

Integrate & Blend

2

Data Refinery

Validate and Cleanse

Process & Blend

Stream Processing

Rules Engine

Page 9: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

9

IoT Analytics Value Tenants

3

Infer & Act

3

Analytics

Machine Learning

Report & Alert

Workflow Integration

Business Outcomes

Page 10: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

10

3 IoT Platform Modules

1

Asset Mgmt

Register Sensors

Model Assets

Store Sensor Data

Stream Sensor Data

2

Data Refinery

Validate and Cleanse

Process & Blend

Stream Processing

Rules Engine

3

Analytics

Machine Learning

Report & Alert

Workflow Integration

Business Outcomes

Page 11: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

IoT Platform Demo Scenario

Page 12: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

12

Big Fleet (222 Vehicles)

24

46

152

Web-Based Fleet Management Platform

Page 13: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

13

Asset Model Types

Page 14: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

14

Asset Models

Page 15: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

15

Hierarchical Vehicle Modeling

Store models and sensor data

Asset ModelSensor DataUtility Vehicle Asset

Air Pressure

Axle Vibration

Lights

Load Weight

Movement

Temperature

Sensor Data

Journey

StreamBlend

Infer

Sense

Inspect

Embed & Integrate

Store

Page 16: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

16

Adding Context to Sensor Data

Vehicle Location

•GPS

•Lat / Long

•Mapping

•Movement

Vehicle Profile

•Make

•Model

•Mileage

Operational Systems

•Maintenance History

•Maintenance Schedule

•Service Centers

•Parts Ordering

•Parts Inventory

Sensor Data Contextual Data

Business Outcomes

• Real-Time Fleet Status and Health

• Repair Recommendations

• Optimized Maintenance Scheduling

• Automated Parts Ordering

IoT Data Refinery

Sensor Data

Journey

StreamBlend

Infer

Sense

Inspect

Embed & Integrate

Store

Page 17: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Pentaho’s IoT Analytics Workflow Orchestration

IOT Data Refinery

Analytic Database

Pentaho Analyzer

Sensor

Traditional Data

Pentaho Data

Integration

Pentaho Reporting

MSG QueueKafka, JMS, MQTT

Machine Learning

R, Python, Weka

Stream Feedback Loop

LOB Applications

Embedded

Pentaho Data

Integration

Page 18: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Why Pentaho?

Industrial IoTwith Hitachi

Expertise in Machine Learning

Solve Big Data Problems

for IoT

Page 19: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Telematics Analytics

Customer Experience

Trains as a Service

Driver, Equipment and Fuel Analysis

Categorize Customer

Preference

Predictive Maintenance

Reduced Down Time and Cost

Savings

Customer Retention & Upsell

Multi-million Dollars Maintenance

Savings

IOT Transforms Business Outcomes

Business Requirements IoT Analytics Business Outcomes

Page 20: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Q & A

Page 21: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Customer Use Case in Detail

Page 22: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Customer Experience – IMS

Challenges

• Create custom dashboards

• 1.6 Billion data points/day

• Predictive behavior patterns

Solutions

• Seamless integration to IMS data sources

• Embedded IoTAnalytics

• Data-driven insight and predictive analytics

Benefits

• Retain customers

• Reduce driver claims

Page 23: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Predictive Maintenance – Hitachi Rail Europe

Challenges

• 3.6 million data points per second

• Correlating multiple data points

• Visualization in multi-tenant

Solutions

• End-to-end Big Data platform

• Scale to data growth

• Predict operational events

Benefits

• Millions maintenance savings

• More reliable andcost effective

• Better service delivery

Page 24: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Customer Experience – Veikkaus

Challenges

• Stream customer behavior –20K terminals

• Blend structured and unstructured data

• Data from other gaming platform

• Slow reporting

• Casino competition

Solutions

• Open architecture

• Tight Integration to Cloudera HDFS

• Professional services

• 24/7 support

Benefits

• Marketing

Timely and accurate data

Customized offers

• Boost sales

• + Customer experience

• Identify gambling addiction

Page 25: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Telematics Analytics – Caterpillar

Challenges

• Integrate sensor data and other data

• Data integrity was in question

• Dashboard development

Solutions

• Connected all data sources

• Ingest, process and blend all sensor data

• Process high volume of data

• Faster delivery to market

Benefits

• Adjust power to operate the generators – $650K savings

• Reduced ship’s hull build-up – $800K fuel reduction cost per ship

Page 26: IOT Analytics - PosAm · Pentaho’s IoT Analytics Workflow Orchestration IOT Data Refinery Analytic Database ... Kafka, JMS, MQTT Machine Learning R, Python, Weka Stream Feedback

Thank You