Mark Kromer Microsoft Data Platform Technology Specialist What’s New in SQL Server 2012 for Philly Code Camp 2012.1 For developers, architects, IT pros & DBAs
Nov 11, 2014
Mark KromerMicrosoft Data Platform Technology Specialist
What’s New in SQL Server 2012 for Philly Code Camp 2012.1
For developers, architects, IT pros & DBAs
MSSQLDUDE
Twitter: @mssqldudehttp://mssqldude.wordpress.com
SQL Server Magazine BI Bloghttp://www.sqlmag.com/blog/sql-server-bi-blog-17
New SQL Server Architectures
Business Intelligence
SQL 2012 Developer
Experience
To the Cloud!
A Brief History of SQL Server
QUESTION #1
SQL Server 2000 falls out of support …
20122013NeverAlready out of support
AlwaysOn, ColumnStores, GeoClustering
Mission Critical Architectures
Mission Critical Confidence
ORGANIZATIONAL COMPLIANCE & PEACE
OF MIND
REQUIRED 9s & DATA PROTECTION
BLAZING-FAST PERFORMANCE
Greater flexibility and availability with SQL Server AlwaysOn
Maximized hardware resources
Support for Windows Server Core to reduce planned downtime
AA A
Column-based query accelerator for dramatic performance gains
Faster performance for FILESTREAM, spatial & FTS
User-defined server roles for better separation of duties & Audit support across editions
SharePoint & Active Directory integration for secure BI data
Simplified application testing with Distributed Replay and streamlined troubleshooting with Extended Events
GREATER UPTIME WITH HIGH AVAILABILITYKey technologies to deliver required 9s
ALWAYSON WINDOWS SERVER CORE SUPPORT
ONLINE OPERATIONS ENHANCEMENTS
Availability Groups provide database level protection
Multiple Secondaries
Failover Cluster Instances provide instance level
protection
Reduce OS patching by as much as with new support for
1
by reducing OS patching
Maintain uptime during maintenance
operations using enhanced online operations
Reindexing of large object data types
Adding non-null columns
Add column with default
1The percentage reduction in patching varies & can be less based on the server roles that are enabled & the type of patches that are applied .
SQL SERVER 2012 HA & DR SOLUTIONS
1Multi-site Failover Cluster Instance (FCI) for HA & DR
• Shared Storage solution• Instance Level HA • Instance Level DR• Doesn’t require database to be in FULL recovery
model
2 Availability Group for HA & DR
• Non-Shared Storage solution• (Group of) Database Level HA• (Group of) Database Level DR• DR replica can be Active Secondary• Requires database to be in FULL recovery model
3Failover Cluster Instance for local HA & Availability Group for DR
• Combined Shared Storage and Non-Shared Storage• Instance Level HA • (Group of) Database Level DR• DR replica can be Active Secondary• Requires database to be in FULL recovery model
AlwaysOnHelping enable global HA, through greater uptime and manageability
Synchronous data
movement
Asynch
ronou
s dat
a
mov
emen
t
AG
AG
AG
AG_Listener
HIGHER PRODUCTIVITYSingle solution to manage; Availability Groups for Clustering, Mirroring, Log Shipping, and Diagnostics
Wizards for easy set up; dashboards for visibility
GREATER UPTIME & H/W USEMultiple, active secondaries
Multi-database failover
Faster connections and page repair
Offload & distribute workloads to secondaries
ADDITIONAL BENEFITS
Scale on demand; distribute workloads across readables
Performance gains by shifting workloads off primary to secondaries, including backups
Unified HA Solution
Blazing-Fast Performance
¹Source: Microsoft customer evidence, Choice Hotels International²Source: Microsoft customer evidence, KAS Bank³Source: Microsoft customer testing; common data warehousing queries
ColumnStore IndexNew
transactions per day²
100,000,000
10xNow, up to Faster³
transactions per second¹
57,000“400 percent improvement in performance.”
First American Title Insurance Company
Columnstore Indexes:Fetch Only Needed Columns
SELECT ProductKey, SUM (SalesAmount) FROM SalesTable WHERE OrderDateKey < 20101108
StoreKey
01
04
04
03
05
02
StoreKey
02
03
01
04
04
01
RegionKey
1
2
2
2
3
1
RegionKey
1
2
1
2
2
1
Quantity
6
1
2
1
4
5
Quantity
1
5
1
4
5
1
OrderDateKey
20101107
20101107
20101107
20101107
20101107
20101108
OrderDateKey
20101108
20101108
20101108
20101109
20101109
20101109
ProductKey
106
103
109
103
106
106
ProductKey
102
106
109
106
106
103
SalesAmount
30.00
17.00
20.00
17.00
20.00
25.00
SalesAmount
14.00
25.00
10.00
20.00
25.00
17.00
Columnstore Indexes:Processing Data
Columnstore vs. RowstoreNew Batch Processing in EngineColumnstore index scan can produce batches or rows
Batch-enabled operators get batchesNon-batch operators get rows
Query optimizer decides
List
of
qualif
yin
g
row
s
Column vectors
Batch object
13
DBA Productivity Enhancement
Point in Time Recovery Using New Timeline
SQL Server Capabilities Standard
Business Intelligence
Enterprise
SQL Server 2012 Editions
*Enterprise legacy servers licensed under Server/CAL licensing are subject to a 20-core per server limit.** Basic include 2 node Failover Clustering
SQL Server 2012 SKUs & LicensingAligned with how businesses consume DB and business intelligence software
Principal Editions Licensing OptionsServer+CAL Core-based
EnterpriseHigh-end datacenter
w/ BI Server capabilities
Business IntelligenceEnterprise BI projects, user-
based licensing
StandardDepartmental, limited scale
16
QUESTION #2
SQL Server AlwaysOn Allows for how many secondary replicas?
0123
QUESTION #3
Which editions of SQL Server has been EOL’d?
Data CenterWeb EditionSQL Server 11gStandard Edition
SQL Server Data Tools Visual Studio 2010
Developer Experience
Build in a Productive Development EnvironmentSQL Server Data Tools (SSDT)
Database
Projects
SQL SERVER DATA TOOLS
Declarative not scripted
Model-based design & validation
Same tools when connected or offline
Schema & app under team source code control
Integrated development environment
Target on-premises or in the cloud
Unified across server, BI & cloud
Simplify complex programming tasks with T-
SQL enhancements
Ease database migrations with improved
support for ANSI SQL standards
Schema differencing for‒ Incremental import & deployment ‒ Drift detection & reconciliation
Test locally, deploy to all versions SQL Server or SQL Azure
Extended Events Enhancements• Flexible event selection, logging, and filtering with Extended Events
• Simplified diagnosis of functional and performance troubleshooting with new user interface for Extended Events
MISSION CRITICAL CONFIDENCE
Distributed Replay• Simplified application testing and upgrade
• Minimize errors in upgrades and proactively conduct capacity testing to simulate production environment and protect performance
PEACE OF MINDStreamlined management
Programmability T-SQL Enhancements
Date/Time Constructors• Construct date/time values without messy string
manipulation• DATEFROMPARTS, TIMEFROMPARTS• DATETIMEFROMPARTS, SMALLDATETIMEFROMPARTS• DATETIME2FROMPARTS, DATETIMEOFFSETFROMPARTS
Programmability T-SQL Enhancements
OFFSET / FETCH• Works like MySQL’s LIMIT, but ANSI standard• No performance gain, just syntactic sugar
SEQUENCE• Central IDENTITY mechanism (like Oracle)• Performs better than IDENTITY• Same transaction limitations
Programmability T-SQL EnhancementsWindowing Enhancements
• Moving average and other aggregates based on preceding/following rows• LAG/LEAD, DATEDIFF, FIRST_VALUE/LAST_VALUE
• Distribution / Median• CUME_DIST(), PERCENT_RANK(), PERCENTILE_CONT()• Can also use WITHIN GROUP
IIF(), CHOOSE(), CONCAT(), EOMONTH()FORMAT()
• .NET parity, with exceptions
PARSE(), TRY_CONVERT(), TRY_PARSE()FORCESEEK enhancements• Can now specify index/columns
New FORCESCAN hint• For large bulk continuous read scenarios where you want a scan
QUESTION #4
Which of these is NOT a new T-SQL construct?
SequenceOffsetTry-CatchThrowNone of the above
Power View, DQS, Tabular Models, SharePoint Integration
Business Intelligence
Rapid Data Exploration and Visualization
Stunning, interactivedata visualizations,
Power View
Familiar tools built on Excel &
SharePoint
Mashup data, PowerPivot
“Only 28% of
potential users are using
the standard BI platform
of choice in
organizations¹”
¹ Gartner, “The Consumerization of BI Drives Greater Adoption,” James Richardson, June 3, 2011
Managed Self-Service BI
Gaininsight
& oversight
End usercreated,
IT managed
Single administration
from SharePoint28
“We can balance our employees’ need for rich
information and collaboration with IT’s
need to manage the safety & confidentiality
of information.”
CareGroup Healthcare System
And Big Data Analytics & Data Warehousing
“Parallel Data Warehouse runs
complex queries about 160 times
faster, providing a data load over
1 Tb/Hour and fully integrates into
a complete BI Solution”
StructuredUNSTRUCTURED,
& real-timeMassive Scale,
Low Cost
>24TBANALYTICAL SOLUTIONS¹
>600TBDATA WAREHOUSES W/ TRUE MPP²
¹Source: Microsoft customer evidence, Yahoo ²Source: Microsoft testing
CompleteBI SOLUTION
—DirectEdge, US Stock Exchange
Credible, Consistent Data
% of master data complete & accurate
Hrs spent per employee each week searching for info
Top 20% Performers 1.2hrs
Middle 50% Performers 2.8hrs
91%
68%
Under 50%Bottom 30% Performers 6hrs
Companies with accurate data perform better¹
Single BI Semantic
Model
Data Quality Services
¹Source: “Turning Pain into Productivity with Master Data Management,” Aberdeen Group, Feb 2011
MasterDataServices
CREDIBLE, CONSISTENT DATAAccessible data cleansing tools
Data Quality Services
• Profile, cleanse, and match data• Build a knowledge base • Improve data quality using organizational knowledge and
3rd party data providers including providers in Windows Azure Marketplace
• Accessible by data stewards
BREAKTHROUGH INSIGHT
CREDIBLE, CONSISTENT DATAEfficient and familiar data managementMaster Data Services Enhancements
BREAKTHROUGH INSIGHT
• MDS Add-in for Excel• Improves access to master data• Lowers the barriers to getting started
• Overhauled user experience for Explorer and Integration Management capabilities• Add/deleted more quickly• More easily move members in a
hierarchy• Entity-based staging for easier data
loading
Master DataServices
Two Hadoop connectors for SQL Server and Parallel Data Warehouse now available included with SQL Server
Hadoop based distribution on Windows Server and Windows Azure currently in CTP
Big Data, Unlocked for Deep InsightsBusiness Insights to all users from structured or unstructured data
Data
Velocity
Variety Variability
Volume
Microsoft partnering with Hortonworks for an Apache Hadoop™ based distribution for Windows Server and Windows Azure
• Broader access of Hadoop to end users, IT professionals and Developers
• Enterprise-ready Hadoop distribution with greater security, performance and ease of management
• Breakthrough insights with the use of familiar tools such as PowerPivot for Excel, SSAS and SSRS
SQL SERVER DELIVERS
Big Data is defined by
• Volume: Cheaper storage & new sources
• Variety: 80% non-relational
• Velocity: Real-time analytics needed
• Variability: Challenging to analyze
MICROSOFT ROADMAP & STRATEGY
QUESTION #5
What is HDFS?Open Source Framework for Distributed AppsHadoop Distributed File SystemOpen Source Distributed File System for WindowsAll of the above
To The Cloud!
Windows Azure
Cloud On Your Terms
OPTIMIZED PRODUCTIVITY
SCALE ON DEMAND & FAST TIME
TO SOLUTION
EXTEND DATA ANYWHERE
DAC parity across Denali and SQL Azure to seamless extend new applications
FileTable for increased data storage flexibility
Greater interoperability and support for web applications
Single database application development experience with Microsoft Project “Juneau”
Streamline virtualization management with System Center Virtual Machine Manager
Roadmaps for SQL Server appliances and reference architectures
Common architecture across server, appliances and cloud
WHY SQL SERVER 2012 FOR HYBRID IT Common > • Active Directory® • Common Development Tools
• Common Management Tools
FLEXIBILITY & CHOICE SCALE ON DEMAND ANY DATA, ANY SIZE
Cloud on your terms
FLEXIBILITY & CHOICE SCALE ON DEMAND ANY DATA, ANY SIZE
• Build and extend applications quickly
• Move apps seamlessly on-premise to cloud
• License mobility
• AlwaysOn & SLA-driven availability
• Scale up on-premises
• Scale out quickly with self-built private clouds, appliances and SQL Azure
• Any type of data - unstructured | structured | complex
• Integrate 3rd party data and activate new data
• Monetize your data
Hybrid IT
TraditionalNON-VIRTUALIZED
PrivateCLOUD
PublicCLOUD
SQL Azure Federations
• Provides Data Partitioning/Sharding at the Data Platform• Enables applications to build elastic scale-out applications• Provides non-blocking SPLIT/DROP for shards (MERGE to come later)• Auto-connect to right shard based on sharding keyvalue• Repartitioning operations without downtime• Examples: Web scale DB, Multi-tenant SaaS, Workloads with spikes,
burst, peaks, NoSQL apps, Big Data apps.
Single tenant per databaseMultiple-tenants per database Multiple databases per tenant
SQL Azure Federation Concepts
40
Federation “Orders_Fed”
ShardedApplication
Azure DB with Federation Root
Federation Directories, Federation Users, Federation Distributions, …
Federation- Represents the data being sharded
Federation Root- Database that logically houses federations, contains
federation meta data Federation Key
- Value that determines the routing of a piece of data (defines a Federation Distribution)
Federation Member (aka Shard)- A physical container for a set of federated tables for a
specific key range and reference tables Federated Table
- Table that contains only atomic units for the member’s key range
Reference Table (DDR)- Non-sharded table
Atomic Unit- All rows with the same federation
key value: always together!
Member: PK [min, 100)
Member: PK [100, 488)
Member: PK [488, max)
(Federation Key: CustomerID)
AUPK=5
AUPK=25
AUPK=35
AUPK=105
AUPK=235
AUPK=365
AUPK=555
AUPK=2545
AUPK=3565
Con
nectio
n
Gate
way
Cloud-Ready Information Platform
On Premises & Private cloud Public Cloud
OData
Common Tools
Data Sync
Extend any data
Extend anywhere
End user analytics
Common Architecture
QUESTION #6
What SQL Services are NOT YET Available in Azure?
Reporting ServicesFederationsAnalysis ServicesFan Out QueriesNone of the above
QUESTION #7
Which area of SQL Server 2012 was most interesting to you?
High AvailabilityDeveloper ToolsBig DataAzure
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to
be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.