Hyper-V Storage

MicrosoftVirtual Academy

Hyper-V Storage

Symon Perriman Jeff WoolseyTechnical Evangelist Principal Program Manager

MicrosoftVirtual Academy

First Half Second Half

(01) Introduction to Microsoft Virtualization

(05) Hyper-V Management

(02) Hyper-V Infrastructure (06) Hyper-V High Availability and

Live Migration

(03) Hyper-V Networking (07) Integration with System Center

2012 Virtual Machine Manager

(04) Hyper-V Storage(08) Integration with Other System

Center 2012 Components

** MEAL BREAK **

Introduction to Hyper-V Jump Start

MicrosoftVirtual Academy

• Storage Considerations

• Creating VHDs• Storage options• iSCSI• Virtual Fibre Channel

Agenda• MultiPath I/O (MPIO)• Offloaded Data

Transfer (ODX)• Storage Virtualization

with Spaces• Hyper-V over SMB

Your input on StorageLeverage storage array capabilities

Maximize your investment

Native access to SANs from VMs

No tradeoffs

Help reduce the cost of storage

For workloads that don’t require a SAN

Highly Scalable Virtual Disks

Big data is here

Storage ConsiderationsStorage performance is almost always the virtualization bottleneckImplement storage solutions with multiple hard drives to distribute disk I/OThe faster the drives the betterConsider deploying centralized storage SAN/File Server for High Availability & Live Migration

StorageVirtual machines require storage for virtual hard disk files, snapshots, failover clustering, and the application’s data files

PhysicalDAS (SATA, eSATA, PATA, SAS, SCSI)SAN (Fibre Channel, FCoE, iSCSI, SAS)

Required for failover clustering so all nodes can access a diskHost clustering: Fibre Channel, FCoE, Serial-Attached SCSI (SAS), iSCSIGuest clustering: iSCSI, FCoE, Fibre Channel, SMB

Virtual adaptersIDE, SCSIBoot – IDE onlyFibre Channel

VHD (VHDX)Fixed, dynamic, differencingPass-throughiSCSI direct (applicable to running iSCSI in guest OS)

Creating Virtual MachinesNameLocationMemoryNetworkVirtual hard diskOperating system

New-VM, New-VHD, New-VMSwitch

Creating VHDs

Creating VHDsUse the Virtual Disk WizardDisk Type: Fixed, Dynamically Expanding, DifferencingName & LocationConfigure Disk: Size, Contents can be copied from another location

Configuration can be changed using the VM settingsIDE controller(s) & locationSCSI controller(s) & locationMedia: VHD, physical hard driveDiskette drive

Virtual Disk TypesDynamicGrows to a maximum size, but will only take as much space as required.

FixedSize of the disk is defined during configurationRegardless of how much is actually stored on the virtual disk, it will take up the maximum amount on the host disk

DifferencingStores the delta changes since the differencing disk was created – such as installing an operating system into the parent disk and then creating differencing disks to perform further configurations on

Hot Add/Remove StorageOverviewAdd and remove VHD and pass-through disks to a running VM without requiring a reboot

Hot-add/remove disk applies to VHDs and pass-through disks attached to the virtual SCSI controller

BenefitsEnables storage growth in VMs without downtimeEnables additional datacenter backup scenariosEnables new SQL/Exchange scenarios

Live VHD MergeWindows Server 2012 Hyper-V provides the ability to merge the .avhd files associated with a virtual machine without having to shut it down firstIn the past, after deleting a snapshot an administrator had to shut down the virtual machine first

Merge-VHD

Hyper-V Host

Large Sector Support – Native 4K DisksWindows Server 2012 supports native 4K disksSoftware read-modify-write512b logical sector virtual diskPerformance penalty for RMW

4K logical sector VHDX No performance penalty

VHD VHDX

512

4K

SoftwareRMW

VHDX

512

4K4K 4K

Native 4K Disk

VM

Hyper-V Host

VHD Stack

Increased Storage Efficiency – Unmap • Unmap

• Storage Informed Of Unused Space

• Efficiencies At Virtual Layer• Allows Reuse Of Unused Blocks

• Efficiencies At Physical Layer• VMs Unmap Passed To Hardware

• Supported On• VHDX & PassThru Disks

• Virtual SCSI or Virtual Fibre Channel

VHDX

External Storage Array

VM

VHDXThe New Default Format for Virtual Hard Disks

Up To 64 TB

Larger Virtual Disks

MB Alignmen

t

Large Sector Support

Enhanced Perf

Larger Block Sizes

Internal Log

Enhanced Resiliency

Embed Custom

Metadata

User Defined Metadata

VHDX Performance - 32KB Random Writes

PassThru Fixed Dynamic Differencing125000

135000

145000

155000

165000Disk VHD VHDX

+10%

+10%

Queue Depth 16

IOPS

VHDX Performance - 1MB Sequential Writes

PassThru Fixed Dynamic Differencing0

200

400

600

800

1000

1200

1400

1600

1800

Disk VHD VHDX

Queue Depth 16

MB/S

+25% +25%

Windows Server 2008 R2

Windows Server 2012

250,000 IOPs 1,000,000+ IOPs

Over 1 Million IOPs from a Single VM

Industry Leading IO Performance• VM storage performance on par with

native• Performance scales linearly with

increase in virtual processors• Windows Server 2012 Hyper-V can

virtualize over 99% of the world’s SQL Server.

Hyper-V Storage: No Limits & DynamicWindows Server 2008 Windows Server 2008

R2Windows Server 2012

Live Storage Migration No. Quick Storage Migration via VMM

No. Quick Storage Migration via VMM

Yes, with no limits. As many as hardware will

allow.

VMs on File Storage No No Yes, SMB 3.0

Guest Fibre Channel No No Yes

Virtual Disk Format VHD up to 2 TB VHD up to 2 TB VHD up to 2 TBVHDX up to 64 TB

VM Guest Clustering Yes, via iSCSI Yes, via iSCSI Yes, via iSCSI or FC

Native 4k Disk Support No No Yes

Live VHD Merge No, offline No, offline Yes

Live New Parent No No Yes

Secure Offloaded Data Transfer (ODX)

No No Yes

Storage Options

Storage Options for Virtual MachinesIDETwo IDE controllers

Two devices eachMethods supported

Pass-throughFixed-diskDynamic

SyntheticUsed for OS boot partition

SCSIFour SCSI controllers256 devices eachMethods supported

Pass-throughFixed-diskDynamic

Synthetic

Choosing VM LocationsVM StorageVHDs: C:\Users\Public\Documents\Hyper-V\virtual hard disksVMs (configuration): C:\ProgramData\Microsoft\Windows\Hyper-V

Virtual machinesSnapshots

ConsiderationsPerformanceHard drive spaceSecurityShared storage for failover clustering

iSCSI

Microsoft iSCSI Software TargetiSCSI is a cost effective SAN solutionSupports failover clustering

Uses the existing IP networkCan be a storage array or DAS on a serverFree downloadhttp://www.microsoft.com/download/en/details.aspx?id=19867

iSCSI InitiatorInitiator connects to the iSCSI targetTarget must be configured

Use a dedicated NICCan use any iSCSI target

Configuring iSCSITarget: Create virtual disksInitiator(s): Request access to disksTarget: Accept access request from initiator(s)Initiator(s): Refresh configuration to check connectionInitiator(s): Log in to the targetEnable automatic reconnections

Servers: Initialize, format and bring disks onlineNow you can use these disks for your VMs or cluster

Virtual Fibre Channel

External Storage Array

LUN

Hyper-V Server

VM

Virtual Fibre ChannelExtends Fibre Channel into VMsHigh-performance workloadsGuest clusteringExposes SAN functionality

Uses NPIV functionalitySupportGuest: Windows Server 2008 & laterHost: Windows Server 2012

Updated NPIV HBA driver

Live migration just works

vHBA

WWN

NPIV HBA

VM

vHBA

WWN

Virtual Fibre Channel and Live Migration

Live Migrate

Shared Storage

WWPN A: C0:03:FF:78:22:A0:00:14

WWPN B: C0:03:FF:78:22:A0:00:15

WWPN A: C0:03:FF:78:22:A0:00:14

WWPN B: C0:03:FF:78:22:A0:00:15

1. Create A Temporary VM On Destination Hyper-V Server2. Connect Temporary VM’s HBAs To FC Fabric Using WWPN B 3. Verify Temporary VM Has Connectivity To Shared Storage

4. Complete Normal VM Live Migration (copy memory etc..) Limit IO Queue Depth To 1

5. Pause Source VM6. Change Temporary VM To Permanent VM and Start IO7. Logout of FC Fabric and Delete Source VM

Fibre ChannelTips:Requires Windows Server 2008 and later for the guest OSVerify latest drivers & firmware for FC adapterVerify NPIV is enabled on the FC adapterVerify NPIV is enabled on the FC switch port

Note: You may see NPV as a switch option, Hyper-V doesn’t use NPV.

MultiPath I/O (MPIO)

MPIO and MCSMicrosoft MPIO (Multipath IO) and MCS (Multiple Connected Sessions) work transparently with Hyper-VTwo options for multi-paths with iSCSIMultiple connections per sessionMicrosoft MPIO (multi-pathing input/output)

MPIO supported with Fibre Channel, FCoE, iSCSI, SAS

Microsoft Multipath I/O (MPIO)Use more than one path for read and write functions to your storage deviceProvides redundant failover and load-balancing support for disks or LUNsSupports bandwidth aggregationDistribute I/O transactions across multiple adaptersWindows Server feature

Offloaded Data Transfer (ODX)

Hyper-V Host

VHD Stack

Offloaded Data Transfer (ODX)Traditional data copy modelServer issues read request to SANData is read into memoryData is written from memory to SAN

IssuesIncreased CPU & memory utilizationIncreased storage trafficInefficient for SAN

External Storage Array

LUN1 LUN2

Hyper-V Host

VHD Stack

Offloaded Data Transfer (ODX)Offload-enabled data copy modelServer issues offload read request to SANSAN returns token representing requestServer issues write request to san using tokenSAN completes data copy internallySAN confirms data was copied

Reduce maintenance timeMerge, mirror, VHD/VHDX creation

Increased workload performanceVMs are fully ODX-aware and enabled

External Storage Array

LUN2LUN1

Toke

n

Toke

n

Hyper-V ODX Support

• Secure Offload data transfer

• Fixed VHD/VHDX Creation

• Dynamic VHD/VHDX Expansion

• VHD/VHDX Merge

• Live Storage Migration

• Just one example… Average Desktop

ODX0

40

80

120

160

200

Creation of a 10 GB Fixed Disk

Time (seconds)

<1 Second!

~3 Minutes

Storage Virtualization with Spaces

Storage SpacesInbox storage virtualization solution providesPoolingResiliency

Simple spaceMirror spaceParity space

Thin provisioning

Hyper-V Host

Space

JBOD

Storage Spaces & ClustersCluster supports spacesSimple Mirrored

Mirrored spaceCSV redirection from non-owning nodesUse low latency network (10 G or RDMA) for cluster network

Hyper-V Host

Hyper-V Host

CSV

Clustered

Space Space

Shared JBOD SAS

Hyper-V with Windows Server 2012 File Server and SMB 3.0

Hyper-VHyper-VHyper-VHyper-VHyper-VHyper-V

Hyper-V over SMBFile storage for virtualization

What is it?Store Hyper-V files in shares over the SMB 3.0 protocol

Include VM configuration, VHD files, snapshots

Works with both standalone and clustered servers

File storage used as cluster shared storage

File Serve

r

File Serve

r

SharedStorage

Hyper-V

SQLServer

IIS

VDIDeskto

pHyper-V

SQLServer

IIS

VDIDeskto

pHyper-V

SQLServer

IIS

VDIDeskto

p

Hyper-V Cluster

File Server Cluster

Handling Intermittent Network Failure

• Resiliency:

• Transparently Re-establishes Network Connection

Temporary DisconnectX

Normal Operation1

Connections & Handles Re-establishedApplication Does Not Receive IO Error

3

1X3

Hyper-V Host

File Server

\\FS\Share

Hyper-V Host

File Server

13 1

Handling Permanent Network Failure

• Multichannel: • Transparently Uses Alternate Network Path

Permanent Disconnect

X

Normal Operation1

Connections & Handles Failover, Application Does Not Receive IO Error

3

X

\\FS\Share

Clustered

File Server

Node B

File Server

Node A

Handling File Server Node Failure

• Continuous Availability• Transparently Fails Over Share To Different File Server

Failure of File Server,Share Failed Over To New Node

X

Normal Operation1

Connections Re-established,Application Does Not Receive IO Error

3

1

\\FS\Share\\FS\

Share

3

X

Hyper-V Host

ClusteredHyper-V Host A

File Server

Handling Hyper-V Node Failure

•Cluster Client Failover (CCF)• VMs communicate identity• Enables Quick Recovery

Hyper-V Host Failure, VM Starts On Different Hyper-V Node

X

Normal Operation1

Stale Handles Shot Down, New Handles Opened Without Delay

3

1

\\FS\Share

3

Hyper-V Host B

X

Host based Backup And Restore

• Virtual Shadow Service For SMB

• No Change in Flow For Backup

File Server

Hyper-V Host

\\FS\S1

VSS Service

Backup

Agent

Remote VSS

Agent

Remote VSS

Provider

\\FS\S1~ Snap

VSS Service/ Provider

Hyper-V over SMBFile Storage for Virtualization

HighlightsIncreases flexibilityEases provisioning, management and migrationLeverages converged networkReduces CapEx and OpEx

Supporting featuresSMB Transparent Failover - Continuous availabilitySMB Scale-Out – Active/Active file server clustersSMB Direct (SMB over RDMA) - Low latency, low CPU useSMB Multichannel – Network throughput and failoverSMB Encryption - SecurityVSS for SMB File Shares - Backup and restoreSMB PowerShell - Manageability

Windows Server 2012 File Server Disk Deduplication

Use for Virtual Disk LibraryStore more data in less space Redundant copies of segments of VHDs are replaced by a reference to the single copyCompressed and then organized into special container filesEnable-DedupVolume Disable-DedupVolume

Deduplication on a Hyper-V Library

After Deduplication: 1.39 GB of disk used

Before Deduplication: 62.3 GB of disk used

60.9 GB of Savings!

• When picking the disk type, consider how it will be used and change over time

• Clustering requires using a shared storage• SANs• Microsoft iSCSI target is a free solution

• File Server

• MPIO and MSC can be used for additional resiliency

Takeaways

©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.