A Spotfire Demo Gallery with Data Science Dr. Brand Niemann Director and Senior Data Scientist Semantic Community November 13, 2011 DRAFT 1.

1

A Spotfire Demo Gallery with Data Science

Dr. Brand NiemannDirector and Senior Data Scientist

Semantic CommunityNovember 13, 2011 DRAFT

2

Spotfire Inverts your Bathtub and improves communication flow

Data in motion

Zero Install

Web Player

In-Memory Processing

Professional

Administration & Integration

Spotfire Server Software

RelationalDatabases

SAP BISAP BW

HR Siebel

OracleeBusiness

*. **.mdb…etc

*.csv*.txt…etc

*.xml ,customsources

WebServices

PowerPointExcelWordPDFHTMLImages (eg. gif, jpg, png, bmp)

Professional

Enterprise

Collection Analysis Communications

Activity levels without Spotfire

Activity levels with Spotfire

FLOW

Time to complete task

Activ

ity L

evel

s

FLOW

3

Spotfire Experience for “big data”

• Improve raw performance of data engine– The user experience with1 million records today should be

possible with much much more tomorrow.• Methods for analyzing large data

– New visuals, transformations and functions• Improved performance for On Demand Data Loading

• Rapidly swap 100k-1M rows in and out of memory from a total data set in the billions of rows

• Architecture for Big Data In-Memory– Server side data engine. Client side free-dimensional

analysis.

4

In-Database Analytics

• Leave “big data” in the data source• Only metadata used to design analytic application• User interaction generates new queries• Filtering and aggregation performed in the data source• Possible data souces:

– Google Earth– DataClock

• Possible data engines– Microsoft Analysis Services– Netezza– Teradata– Vertica

5

Import World Shape File

6

Import Middle East and Eastern Mediterranean Shape File

7

Occupational Series Labor-cost

8

Labor AE & Construction Cost

9

2011 Fantasy Football Draft Analyzer

10

Afghan Events Report

11

Afghan Events Report

12

Application Integration Networks

13

Spotfire Web Player

14

Search

15

World Energy

16

Real-Time Data

One new value per minute. If it doesn't run the first time, you may need to start the procedure from MS SQL Studio before running this, but first try to hit "Run" from the StoredProcedure's property page in Information Designer

17

Census Housing

Start from US Census 2000 data and drilldown onto on-the-fly aggregated Housing sales data, to finally drill down into the full details of Housing data.

18

Data on Demand

Easy to understand but advanced data-on-demand demo

19

Price Binning

20

DoD Presidential Budget Request

21

Genetic Body Map

Genes are mapped to organs with their activity. You can find groups of genes or single genes being active in different parts of the human body. The analysis lets you find out the associated Pathways and Gene Ontology information.

22

Janes-Terrorism DB

23

Warehouse Storage

24

World Facts Analysis

25

World Facts Analysis

26

Kenyan Survey Analysis

27

London Tunnel Bombing Search Results

28

Information Designer

29

Information Link

30

Column

31

Join

32

Data Source

33

Data Source - Expanded