Tech Talk SQL Server 2012 Business Intelligence

Microsoft Business IntelligenceUpdate on SQL Server 2012

Preliminary Information Subject to Change

Agenda

Microsoft and Enterprise Information Management

Update on Microsoft Business Intelligence Capabilities


Evolution of BI

Self-Service BITraditional BI

IT Pro

End Users

Existing Data

LOB Applications FilesData Marts

ETL/Data Quality

Analysis Reports Dashboards & Scorecards

Provision

Analysis Cubes

Data Warehouse

Data Staging

Spreadsheets

Specialized Tools

?


Microsoft Business Intelligence

Analysis Services

Reporting Services

Integration Services

Master Data Services

SharePointScorecards

Excel Workbooks

PowerPivot Application

s

SharePointSearch &

Dashboards

Most widely deployed EIM &

BI Platform

Most Broadly adopted

Productivity & Collaboration

Tools

OdataFeeds

LOB Apps


Phases of Enterprise Information Management

Market-leading ETL and data

integration tool

Knowledge-based Data Cleansing &

Matching

Discover Origins & Relationships between artifacts

Project Barcelona* Integration Services

Master Data Services Data Quality Services

Easy-start solution for master and reference data management

* Will be shipped separately from SQL Server 2012 and is subject to change


Integrated Data Management Scenario

Data Sources Temp Table

MDS Reference

Store

Cleanse, matchDQS

CurateMDS

Match, de-duplicate

DQS

AcquireSSIS

Consumer

PublishSSIS

View

s

DiscoverBarcelona

Project BarcelonaMetadata Discovery

http://projectbarcelona.cloudapp.net/

demo

Project Barcelona Platform Architecture

Metadata Graph Query, Augmentation, and Annotation API

SQL ISSharePoint

Excel 3rd Party Crawler

3rd Party / Vertical

Application

AdminUI

Information Worker

Experience

DBA/IT ProExperience

Crawler Harvested Data API

Barcelona Index Server

Other Microsoft

Project Barcelona Key Features

Minimal Investment

• No up front planning, modeling, ongoing maintenance

• Out of the box, just starts working

Incremental Investment

• As more of the enterprise is crawled, more and more dependencies are uncovered

Open & Extensible

• New crawlers, UIs added over time

• In-house customized solutions

• Opportunity for partners

• Crawlers shipped out of band


Why is Data Quality Important?

Data quality problems cost U.S. businesses more than $600 billion a year.

Data Warehousing Institute (TDWI)

Costs associated with bad data include: • Excess inventory

• Higher supply chain costs

• higher direct marketing costs

• Billing

• And more…


Common Data Quality Issues

Data Quality Issue Sample Data Problem

Format Do values follow consistent formatting standards ?

Telephone number formats:xxxxxxxxxx, (xxx) xxx-xxxx 1.xxx.xxx.xxxx, etc.

Standard Are data elements consistently defined and understood ? ‘Gender code’ = M, F, U

‘Gender code’ = 0, 1, 2

Consistent Do values represent the same meaning ? How is revenue presented ?Dollars, Euro, Both?

Complete Is all necessary data present ? 20% of customers’ last name is blank, 50% of zip-codes are 99999

Accurate Does the data accurately represent reality or a verifiable source?

A Supplier is listed as ‘Active’ but went out of business six years ago

Valid Do data values fall within acceptable ranges? Salary values should be between 60,000-120,000

Duplicates Data appears several times Both John Ryan and Jack Ryan appear in the system – are they the same person?


How to Manage Data Quality?

Data quality management entails the establishment and deployment of:

RolesResponsibilitiesPoliciesProceduresTechnology


Make Data Quality Approachable to Everyone

Improve your data quality with DQSCleanse the data and keep it clean Build confidence in your enterprise dataShare the responsibility for data quality

Remove Barriers for Data QualityDesigned for ease of useEmpowering the business usersSee data quality results in minutes rather than months


DQS Solution Concepts

Knowledge-DrivenBased on a Data Quality Knowledge Base (DQKB) that is reusable for a variety of data quality improvements

Knowledge Discovery

Acquire additional knowledge through data samples and user feedback

SemanticsData is mapped into Data Domains, which capture its Semantics

Open and Extendible

Support use of user-generated knowledge and IP by 3rd party reference data

providers

Easy to Use

Compelling user experience designed for increased productivity


DQS Architecture Overview

DQS Clients

Knowledge Discovery and Management

DQS Cloud Services

DataMarket - Categorized Reference DataDQS Client

DQS Server

Reference Data API(Browse, Set, Validate…)

Reference Data API(Browse, Get, Update…)

Common Knowledge Store

DQS Engine

Knowledge Discovery

Data Profiling Exploration Matching

Cleansing

Reference Data

Reference Data

Services

DQS Store - KB, Domains

Interactive DQ Projects

Administration

Future Clients: Excel, SharePoint,MDS…

DQ Active Projects

Published KBs

SSIS DQS Cleansing Component

DQ Projects Store

Other DQS Clients

3rd Party Reference Data


dqs demo flow

Create DQKB

Knowledge Discovery to

create a domain

Manage Domains

Create DQS Project


What is Master Data?

Objects that are the focus of organizational activity

Exists in different forms at each level of the organizationThe requirements of a product model can vary between org levelsDifferent object types are more specific to certain org levels

CharacteristicsRelatively slowly changingObjects of the transactions rather than transactional data Shared among contributors and consumers


Main Scenarios

Data Solutions

Provides storage and management of the objects and metadata used as the application knowledge

• Object mappings

• Reference Data / managed object lists

• Metadata management / data dictionary

Data Warehouse / Data Marts Mgmt

Operational Data Management

Enables business users to manage the dimensions and hierarchies of DW / Data Marts

• BI scenarios

Central data records mgmt and consumption sourced by other operational systems

MDS focusPartners Value Add

A company has adopted 6 “best of breed” systems from different vendors. They need to be able to propagate the correct customer information to each system in a consistent way.MDS provides a platform for central schema, integration points and validation for SI/ISV/Internal IT to develop a custom solution1


Versioning

ValidationAuthoring business rules to ensure

data correctness Modeling

Entities, Attributes, Hierarchies

Enabling Integration & Sharing

MDS Capabilities

MDSRole-based Security and Transaction Annotation Master Data

Stewardship

External (CRM, ..)Excel DWH

Loading batched data through Staging Tables

Consuming data through Views

Registering to changes through APIs

Excel Add-In Web UI Data Matching

Workflow / Notifications

Focus on Foundational PlatformV1 product

Empowering IWs through Excel Add-in and improved Web UIEnhanced performance and scalabilityImproved quality (usability, robustness, security)

SQL Server 2012 Focus for MDS


Empowering IW: MDS Excel Add-in

Load filtered set of data from your MDS database, update leveraging the full power of Excel and publish the data back to the database

Create new entities and attributes

Define attribute constrains, validate and correct entries

Create relations between entities with domain based attributes

Create shortcut of the MDS connection and share it easily with others for easy collaboration


mds demo flow

Create MDS Model

Create Entity's in XLS

Publish data updates in XLS

Explore/Update data

Create subscription

views


Whats new in SQL Server 2012

Analysis Services and PowerPivot

Reporting Services and Power View

Master Data Services and Data Quality Services


Analysis Services: Tomorrow

Build on the strengths and success of Analysis Services and expand its reach to a much broader user base

Embrace the relational data model – well understood by developers and IT Pros

Bring together the relational and multidimensional models under a single unified BI platform – best of both worlds!

Provide flexibility in the platform to suit the diverse needs of BI applications

Analysis Services VisionBI Semantic

Model


BI Semantic Model

Data model

Business logic and queries

Data access ROLAP MOLAP VertiPaqDirectQuery

MDX DAX

Multi-dimensional

Tabular

Third-partyapplications

Reporting Services & Power

ViewExcel PowerPivot

Databases LOB Applications Files OData Feeds Cloud Services

SharePointInsights

BI Semantic Model: Architecture


Depends on the application needs for each layerData modelBusiness logicData access & storage

Two Visual Studio (BIDS) project types in SQL Server 2012

Multidimensional project – with MDX and MOLAP/ROLAPTabular project – with DAX and VertiPaq/DirectQuery

How Should I Build my Model?


SSAS: Multidimensional Model Improvements

Multidimensional projects received over 300 improvements across the board for performance, supportability, reliability and functionality

Almost 100 were reported directly by customers

Major new features include:Visual Studio 2010 designersRemoval of 4GB string store limit for attributesNew events for monitoring lock usage and contentionsNew messages for tracking resources used per commandNew PowerShell support


What’s New in PowerPivot for Excel Add-in

Includes the same designer and the same features available to the IT Pro in the Tabular Project in BIDS, except:

Table partitionsSecurity rolesConfiguring Direct Query mode

Note it is possible to restore a PowerPivot workbook on a tabular instance of Analysis Services and then create and manage table partitions



Perspectives and the reporting properties are hidden by default, otherwise they are available on the PowerPivot Window’s Advanced ribbon tab

The specialized functionality on the Advanced ribbon tab (which is hidden by default) includes:

PerspectivesSummarize ByReporting properties



Excel’s PowerPivot ribbon tab includes the ability to create, edit and delete KPIs

The PowerPivot Field List has been updated to:Allow perspective selectionDisplay hierarchies and KPIsCreate a KPI based on a measure

The Measure Settings window, used to create and edit measures, supports the configuration of formatting options



SharePoint Server 2010 SP1 is a prerequisite

The add-in has update to include:New administrative capabilitiesNew setup experiencePower View authoring from the PowerPivot Galley


Whats new in Reporting Services

New SSRS SharePoint Integration Benefits

SSRS SharePoint 2010 Shared ServiceHosted in SharePoint Shared Service App poolSSRS catalog DBs are SharePoint Service App DBsWCF and Claims based communicationCentral Admin UI for all RS administrationULS Logging integrationBuilt-in scale-out and load balancer

Report Performance ImprovementsParity with SQL Server 2012 Native mode performance• Top SharePoint mode pain point• Small reports used to be 2-3 times slower: Fixed

Faster than 2008 R2 SharePoint mode ~ 30-60%

SQL Setup option for SSRS SharePoint service


Data Alert Workflow

Create Alert

Emai

l D

eliv

ery

Alert Management

Office Open XML Rendering Extensions

Support for new file formats introduced in Office 2007

Word rendering to *.docx formatExcel rendering to *.xlsx format

Feature parity with existing Word and Excel renderers

ZIP-compressed files

Larger worksheets in Excel65k -> 1M rows256 -> 16k columns

More colors in Excel56-color palette -> 24-bit color (16M colors)

What is Power View

Power View is an interactive data exploration and visual presentation experience.


Highly Visual Design Experience

Presentation-ready at all times

Rich metadata-driven interactivity

SQL Server 2012 Power View

• Interactive Presentation turns pervasive information into persuasive information

• Deliver and collaborate through SharePoint• Full screen presentation mode for interactive boardroom session

• Fully integrated with PowerPivot• Drive greater insight through smart and powerful querying• Zero configuration highlighting and filtering• Animated trending and comparisons

• Interactive, web-based authoring and sharing of information• Familiar Microsoft Office design patterns• Powerful data layout with banding, callout and small multiples

visualizations


Power View Architecture

RS Shared Service

SharePoint Farm

Power View client

App Server

Data sources

Analysis Services SP Integrated

PowerPivotSystem Service

AS ServerTabula

r

Web Front End

SSRS Addin for SharePoin

t

PowerPivotWeb Service

Excel PowerPivot Model

SQL Server BIDSBISM Model

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after

the date of this presentation.MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not

be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Tech Talk SQL Server 2012 Business Intelligence

Technology

bad data

data samples

data domains

duplicates data

data dictionarymds

data elements

data quality important

data quality approachable