The Journey to the 2012 R2 wave The 2012 R2 wave File Based Storage Storage Management for Private Cloud Storage Spaces.

Software-Defined Storage in Windows Server 2012 R2 and System Center 2012 R2Elden ChristensenPrincipal Program Manager LeadMicrosoft

DCIM-B349

Agenda

The Journey to the 2012 R2 wave

The 2012 R2 wave

File Based Storage

Storage Management for Private Cloud

Storage Spaces

The Journey to the 2012 R2 waveWe made great strides with Windows Server 2012

Great Storage Improvements in 2012 Wave

Cluster-Aware

Updating

SMB3

Virtual Fibre

Channel

Hyper-V Replica

8,000 VMs

per Cluster

VM Prioritizati

on

64-node clusters

Dedup

Scale-Out File Server

Storage Spaces

Offload Data

Transfer

VM Storage

Migration

iSCSI Target Server

ReFS VHDX

Block storage

provisioning

File storage provisionin

g

Hyper-V Storage

Management

SMI-S Storage Service

NTFS Trim /

UnmapNFS 4.1SM API

CSVFS online

CHKDSK

Storage Pool

Classification

iSCSI Target SMI-S

Provider

Thin Provision

Alert Monitor

SAN based Rapid

Provisioning

SM API Integration

Storage Utilization Trending

Dynamic iSCSI Target

Array

SAS Array Support

Thin LUN provisionin

g

Windows Server 2012 System Center 2012 SP1

New Approach to Storage

StorageSpaces

Cost-Effective Business Critical Storage

File Based

Storage

High Performance SMB Protocol for Hyper-V Storage over Ethernet networks

Strategic shifts to reducing storage costs with Windows Server 2012 Software-Defined

Storage

Enterprise Storage Management Scenarios with System Center 2012 R2

Performance

Faster enumerations through SMI-S storage service

Real-time updates for out-of-band changes using CIM indications

Fibre Channel

Management

Fibre channel fabric discovery and zone provisioning

Support for Hyper-V virtual fibre channel

Rapid Provisionin

g

ODX optimized virtual machine deployments

Rapid provisioning using differencing disks

DemoContinuing the Windows Server 2012 InvestmentsHector LinaresPrincipal Program ManagerSystem Center Virtual Machine Manager

The 2012 R2 waveVision for Software-Defined Storage with Windows Server 2012 R2

Focused Scenarios for 2012 R2 waveWindows Server 2012 R2 is cloud

optimized

Private CloudsHosted CloudsCloud Service Providers

Reducing capital and operational storage and availability costs

Infrastructure-as-a-Service Storage VisionDramatically lowering the costs and effort of

delivering IaaS storage services

Disaggregated compute and storage

Independent manage and scale at each layer

Industry standard servers, networking and storage

Inexpensive networksInexpensive shared JBOD storage

SMB

Shared JBODStorage

Scale-Out File Server

Syste

m C

ente

r

Hyper-V Clusters

Storage Management for Private Cloud

Storage Management Pillars

Allocation and Assignment

Standards Based Management

VM, Host, and Cluster Storage Management

Extensive Device Support

Scalable Provisioning

Storage Monitoringand Capacity Trending

Scale-out File ServerBare Metal Provisioning

Pool, Volume, and File Share Classification

Rapid Provisioning Copy File, Diff Disks

Block and FileProvisioning

End to End Discovery and Mapping

Insight Flexibility Automation

Disaster Recovery

Storage Mangement API (SM-API)New architecture with 10x faster enumerationsAdded remoting and cluster-awareness for managing Storage SpacesAdded support for new Storage Spaces features (write-back cache, tiering, etc.) SCVMM manages Storage Spaces and Scale-Out File Server through SM-API

Storage Spaces compatible JBOD

SMI-S compliant subsystem

SMP based subsystem

Storage Spaces

Storage Management API (WMI)

Windows Server 2012Server Manager

ISV or Storage Vendor Applications

Windows Server now has a single standardized management

interface to manage storage

SMI-S compliant NAS

SMI-S compliant Fibre Channel switch

CIM Pass Through

System Center Virtual Machine Manager

VMM + Scale-out File Server and Storage Spaces

Scale-Out File Server ClustersStorage Spaces Virtualization and Resiliency

Hyper-V Clusters

SMB

Shared JBODStorage

Capacity Manageme

nt

Pool/volume/file share classification

File share ACL management

VM workload deployment to file shares

Scale-out File Server

Deployment

Bare metal deployment of file server

Creation of scale-out file server cluster

Adding/removing file server nodes

File share management

Spaces Provisionin

g

Discovery of physical spindles

Storage pool creation and deletion

Mirror and Parity Spaces creation and deletion

End-to-end management of both file and block based

storage with System Center Virtual Machine Manager

File Based StorageBlock Storage

Guest Clustering with Shared Virtual Disks

VHDX VHDX

Modernized Hyper-V with virtual SAS

Flexibility of Guest Clustering with any storage topology

Guest Clustering

Guest Clustering with commodity storage

Sharing VHDX files provides shared storage for Hyper-V Failover Clustering

Maintains separation between infrastructure and tenants

Virtual SAS

VM presented a shared virtual SAS disk

Appears as shared SAS disk to VM

Cluster Shared Volumes (CSV) on block storage

Scale-Out File Server for file based storage

Simplified configuration

of Guest Clusters

Scalable to create large

node clusters

iSCSI Target Server

VHDX Support

• Provision LARGER (up to 64TB) LUs• Online expand/shrink of LUs• Provision dynamically-growing LUs

SMI-S Support

• Fully manage iSCSI Target Server using SMI-S

• Empowers full end-to-end management with System Center Virtual Machine Manager

• Standards-based management

iSCSI Target Server

SCVMMSM

I-S

iSCSI Target Server is highly scalable and flexible using

VHDX

Manage iSCSI Target Server out-

of-the-box with SCVMM

iSCSI Target Server delivers a

comprehensive management experience

DemoStorage Management with System CenterHector LinaresPrincipal Program ManagerSystem Center Virtual Machine Manager

File Based StorageLow cost scale-out storage fabric

Scale-Out File Server ClustersStorage Spaces Virtualization and Resiliency

Hyper-V Clusters

SMB

Shared JBODStorage

SMB Direct Performance Enhancements

Scale-out File Server

SMB Direct

Hyper-V

VHD50% improvement for small IO workloads

Efficiency

Increased efficiency and density of hosting workloads with small I/O’s such as OLTP database in a VM

Optimizes 40Gbps Ethernet and 56Gbps InfiniBand

Performance

50% improvement for small IO workloads with SMB over RDMA

Increased 8KB IOPs from ~300K IOPS to ~450K IOPS per interface

SMB

Scale-out File Server

Hyper-V host

Optimized Rebalancing of Scale-out File ServerScale-Out File Server clients are now

redirected to the “best” node for accessAvoids unnecessary redirection trafficDriven by ownership of Cluster Shared Volumes SMB connections managed per share

No longer per file server

Dynamically moves as CSV volume ownership changes

Clustering is now also balancing CSV volumes automatically

Automatic behavior, no administrator action

File Server 2File Server 1

Storage Spaces

\\SOFS\Share2

Share1 Share2 Share1 Share2

CSV and SMB shares automatically rebalanced

Improved network efficiency through

drastically reducing redirection traffic

Hyper-V Live Migration over SMBSMB as a transport for Live Migration of VMsDelivers the power of SMB to provide:

RDMA (SMB Direct)Streaming over multiple NICs (SMB Multichannel)

Provides highest bandwidth and lowest latency

Live migration can stream over multiple

networks for improved bandwidth

Live Migration can take advantage of

high speed networking

RDMA enables offloading CPU

resources to NIC during live migration

0

2

4

6

8

10

12

Live Migration Times

Seco

nds

TCP/IP Compression

SMB w/RDMA(no compression)

Hyper-V host 2Hyper-V host 1

SMB Bandwidth ManagementFile Server for library Storage

Scale-out File Server

VHDX

Live MigrationLimit = 500

MB/s

StorageNo Limit

Enables hosters to control different SMB

traffic types

DefaultLimit = 100

MB/s

Control

Configurable SMB bandwidth limits per category

Three defined SMB categories: Default, VirtualMachine and LiveMigration

Common Infrastructur

e

SMB being leveraged for VMs to access storage, distribution from VM library, and live migration

Desire to manage bandwidth of different types of SMB communication

Hyper-V Online Resizing and Storage QoS

Hyper-V

VHDX

QoS

VHDX Resize

Expand or shrink a VHDX based virtual disk with no downtime

Storage QoS

Maximum IOPSSetting to limit the maximum IOPS allowed to a virtual disk

Minimum IOPS AlertsNotifications when specified minimum IOPS are not met for a virtual disk

VM Storage Metrics

Storage attributes added to VM MetricsAverage normalized IOPSAverage latency

DemoAutomatic SMB Balancing of a Scale-out File ServerJose BarretoPrincipal Program Manager LeadFile Server

Data Deduplication

Simplify storage hardware and

minimize hardware expenditures through Data

Deduplication in Windows Server

Gain space savings as high as 90% on VDI deployments with minimal

impact

Performance

Faster read/write of optimized files

Improved optimization speed

Live VHD’s

Deduplication of open VHD/VHDX files

Scale-out File Server

SMB Direct

Hyper-V VDI

VHDDedup

Compatibility

Support for Scale-out File Server with Cluster Shared Volumes (CSV)

Storage SpacesSoftware Defined Storage Platform for the Private Cloud

Scale-Out File Server ClustersStorage Spaces Virtualization and Resiliency

Hyper-V Clusters

SMB

Shared JBODStorage

Storage Space

Reduced Mean Time To RecoveryMirror Spaces Rebuild

Parallelized Recovery

Increased ThroughputOptimized Disk UtilizationUtilization of spare capacity

Hot Spare no longer necessary in R2

Performance improvements to radically

reduce MTTR

Rebuild Metric Measurement

Data Rebuilt 2,400 GB

Time Taken 49 min

Rebuild Throughput

> 800 MB/s3TB HDDs, 2-way, 4-column Mirror SpaceSource: Internal Testing, No Foreground Activity

Storage Spaces – Storage TieringOptimized Data Placement

Pool consists of both SSDs and HDDsTiers within a Storage SpaceHot Data (SSDs), Cold Data (HDDs)Sub-File-Level Data MovementComplements write-back caching

Administrative Controlled PinningPin hot files to faster SSD tierExample: VDI Pooled VM’s VHD

Tiered Storage Spaces provides

persistent performance improvement for hot data

The best of both worlds:

SSD Performance & HDD Capacity

Storage Space

HDD Tier

Cold Data

SSD Tier

Hot Data

400GB EMLC SAS SSD

4TB 7200RPM SAS HDD

Virtual Machines

Storage Spaces - Write-Back CacheRandom Disk Access

Inherent to storage access patterns with virtualized deploymentsSSDs provide higher IOPs for random access

Improved performance for real-world workloads

SSDs absorb random writes at high IOPS levelsSeamless integration and familiar management

Windows Server 2012 R2 maximizes performance and

capacity

The Spaces Write-Back Cache absorbs spikes in random write

activity

Virtual Machines

Storage Space

HDD Tier

Cold Data

SSD Tier & WBC

Hot Data

400GB EMLC SAS SSD

4TB 7200RPM SAS HDD

DemoWrite back cache & Storage TieringTobias KlimaProgram Manager IIStorage and File Systems

In Review: Session Objectives And Takeaways

Reducing Costs

Performance

Scalability

Manageability

Reliability

• Improved IOPS performance with Write-Back Cache support• Improved hot data performance through storage tiering using

SSDs and HDDs in the same storage space• 50% performance improvement for small IO in SMB Direct

• Hyper-V hosts automatically directed to the “best” file server node avoids unnecessary redirection traffic

• CSV volumes are automatically distributed across the cluster• Hyper-V Live Migration using SMB3

• Improved MTTR from drive failures through parallel rebuild• Resilient to dual-drive failures in parity spaces• SMB instances dedicated for CSV traffic

• Grow or shrink a virtual disk (VHDX) with no downtime• Hyper-V Storage Quality of Service (QoS)• Enhanced SM-API for remote management of scale-out file servers with

storage spaces and improved performance

• Data deduplication of VDI storage on Scale-Out File Servers• Tenant clustering without requiring Fibre Channel or iSCSI storage

Scale-Out File Server ClustersStorage Spaces Virtualization and Resiliency

Hyper-V Clusters

SMB

Shared JBODStorage

Syste

m C

ente

r

Breakout SessionsDCIM-B338 Software-Defined Storage Solutions: Storage Management Plane Functionality in Windows Server 2012 R2 and Microsoft System Center 2012 R2

DCIM-B311 Delivering Exceptional IOPS/$ with Windows Server 2012 R2

DCIM-B384 Microsoft Azure Storage

DCIM-B310 The StorSimple Approach to Solving Issues Related to Growing Data Trends

DCIM-B327 Cluster-in-a-Box Using Windows Server 2012 R2: Solutions and Applications

DCIM-B397 Maximizing Storage Efficiency with Dell and Microsoft Storage Spaces

DCIM-B337 File Server Networking for a Private Cloud Storage Infrastructure in Windows Server 2012 R2

DCIM-B346 Best Practices for Deploying Tiered Storage Spaces in Windows Server 2012 R2

DCIM-B349 Software-Defined Storage in Windows Server 2012 R2 and Microsoft System Center 2012 R2

DCIM-B357 StorSimple: Enabling Microsoft Azure Cloud Storage for Enterprise Workloads

Related content

LabsDCIM-IL200 Build Your Storage Infrastructure with Windows Server 2012 R2 (repeats on May 14 at 5 pm)

DCIM-IL200-R Build Your Storage Infrastructure with Windows Server 2012 R2 (repeated from May 14 at 8:30 am)

DCIM-H205 Build Your Storage Infrastructure with Windows Server 2012 R2

DCIM-IL305 Managing Your Storage with Microsoft System Center 2012 Virtual Machine Manager

Come Visit Us in the Microsoft Solutions Experience!

Look for Datacenter and Infrastructure ManagementTechExpo Level 1 Hall CD

For More InformationWindows Server 2012 R2http://technet.microsoft.com/en-US/evalcenter/dn205286

Windows Server

Microsoft Azure

Microsoft Azurehttp://azure.microsoft.com/en-us/

System Center

System Center 2012 R2http://technet.microsoft.com/en-US/evalcenter/dn205295

Azure PackAzure Packhttp://www.microsoft.com/en-us/server-cloud/products/windows-azure-pack

Resources

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

msdn

Resources for Developers

http://microsoft.com/msdn

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Sessions on Demand

http://channel9.msdn.com/Events/TechEd

Complete an evaluation and enter to win!

Evaluate this session

Scan this QR code to evaluate this session.

© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.