1© Copyright 2012 EMC Corporation. All rights reserved. EMC INFRASTRUCTURE FOR VMWARE CLOUD ENVIRONMENTS EMC Symmetrix VMAX 40K, EMC Symmetrix FAST VP,

1© Copyright 2012 EMC Corporation. All rights reserved.

EMC INFRASTRUCTURE FOR VMWARE CLOUD ENVIRONMENTS

EMC Symmetrix VMAX 40K, EMC Symmetrix FAST VP, EMC SRDF, and VMware vSphere 5

EMC Solutions Group


Agenda

Solution Overview

Key Technology components

Solution Architecture and Design

Validation and Testing

Summary and Solution Benefits

Q & A


Solution Overview

Deploy multiple critical database applications on a VMware private cloud enabled by a VMAX 40K array running Enginuity 5876 Code and optimized by FAST VP with site protection enabled by EMC SRDF replication

Simulate a highly active customer database environment, serving multiple Tier-1 Applications

• Oracle Database 11g R2• SAP ERP 6.0 EHP 4• Microsoft SQL Server 2012

Online Transactional

Databases

• Microsoft SQL Server 2012 Data Warehouse


Solution Overview, continued

Managed, monitored, and optimized through EMC Unisphere for VMAX

– Simplified array management of FAST VP using “Allocation by Policy” feature of FAST VP

– Assured performance in DR scenarios enabled by SRDF-aware FAST VP (Enginuity 5876) with constant, automated tuning of application storage at both production and disaster recovery sites

Virtualized with VMware vSphere 5 update 1


Symmetrix VMAX 40K Array with Enginuity 5876 Operating Environment

High-end enterprise storage array with simple, intelligent, modular design that allows system to grow seamlessly and cost-effectively from entry-level configuration to world’s largest storage array

New dense configuration options with 2.5” Flash, FC, SAS drives– Up to 33% more drives in the same footprint– More performance per Watt

Virtual provisioning provides non-disruptive, on-demand thin provisioning

FAST VP provides automatic storage tiering at the sub-LUN level

FAST VP SRDF coordination ensures performance at Recovery Site

FAST VP allocate by Policy

Cascaded storage groups

Simplified configuration and management with Unisphere for VMAX

Capacity efficient snapshot capabilities with TimeFinder VP SNAP

Federated Tiered storage

FLASH

FC

SATA


EMC Virtual Provisioning Overview

Improves storage utilization

Reduces storage provisioning complexity and overhead

Automates processes to easily grow storage

Overprovision storage to last lifetime of application, without providing all the physical storage up front

Add capacity non-disruptively and on demand

Automatically rebalance thin pools to maintain performance

Simplifies storage management with Unisphere for VMAX

ESXi 310 TB

ESXi 210 TB

ESXi 1 10 TB

3 TB4 TB

Physicalallocation

3 TB

CommonStorage Pool


EMC Symmetrix FAST VP – Overview Automatic storage tiering for Virtual

Provisioning thin pools

Analysis and data movement at sub-LUN level:

– Spreads data from a single thin device across multiple pools

– Places very active parts of a LUN on high-performing Flash Drives

– Places less active parts of a LUN on higher-capacity, more cost-effective FC or SATA drives

Moves data at the extent group level (7,680 KB)

Moves data based on user-defined policies and application performance needs

Data movement is automatic and nondisruptive

SATA

FC

Flash

• Radically simplifies storage management

• Optimizes performance• Increases storage

efficiency

Symmetrix VMAX with FAST VP – Getting the right data, to the right place, at the right time


FAST VP SRDF Coordination

FAST VP continually monitors and adjusts data placement at production site

Performance stats captured at both sites and exchanged every hour

Decisions on data placement made on both sites using data from the active site

Symmetrix VMAX with FAST VP and SRDF Co-Ordination– Getting the right data, to the right place, at the right time at both Production

and DR Sites


Cascaded Storage Groups

New feature with 5876 providing the ability to nest multiple storage groups in a single masking view

Simplifies FAST VP configurations in virtual environments

Multiple application within a single masking view managed with its own storage group and FAST policy

Simplified monitoring and management at application level made easier


Solution Architecture Two ESXi servers

configured at each site

Oracle, SAP, and SQL Server deployed on VMs

EMC VMAX 40K storage arrays optimized by FAST VP protected by SRDF/S

8 GBs FC SAN running between hosts and sites

1 GB Ethernet network connection between hosts


Solution HardwareComponent Quantity Configuration

Storage array 2 EMC Symmetrix VMAX 40K, with:• 3 Engines• 384 GB Cache• 32 x 200 GB Flash drives• 126 x 600 GB 10K FC drives• 64 x 450 GB 15K FC drives• 72 x 2TB 7.2 K SATA drives

VMware ESXi servers (Production virtual environment)

2 ESXi Server with:• 8 x Ten-core Intel Xeon E7 CPU @2.4 GHz• 1 TB RAM• 2 x dual Port Brocade 825 8 GB FC HBA

VMware ESXi servers (Disaster recovery virtual environment)

2 ESXi Server with:• 4 x Ten-core CPU Intel Xeon E7CPU @2.4GHz• 128 GB RAM • Dual 1 Gb NICs• Dual 10 Gb CNAs

FC switches 2 Brocade DCX 4S 8GB FC Director Class switch

Ethernet switches 2 1 Gb/s Ethernet switches


Key Technology Components

EMC components: – Symmetrix VMAX 40K with Enginuity 5876– Unisphere for VMAX– Symmetrix Remote Data Facility (SRDF)– Symmetrix FAST VP with SRDF coordination– PowerPath/VE– VMware vSphere 5– VMware Storage Integrator(VSI)

Applications– Oracle Database 11g R2 Enterprise Edition– Microsoft SQL Server 2012– SAP ERP 6.0 EHP 4


Configuration Details


Storage Configuration-Virtual Pools

Thin Pool NameDrive Size/ Technology /RPM

RAID Protection

Number of Drives

TDAT SizeNumber of DATA Device (TDAT)

Pool Capacity

FLASH_3RAID5 200GB Flash RAID5 (3+1) 32 68.8 GB 64 4.2TB

FC10K_RAID1 600GB FC 10K RAID1 126 66 GB 504 32TB

FC15K_RAID1 450GB FC 15K RAID1 64 49.2 GB 256 12.2TB

SATA_6RAID6 2TB SATA 7.2K RAID6 (6+2) 72 240GB 256 60TB


Virtual Pool Use by Application

SAP, Oracle, and MS SQL OLTP share common Flash, FC, and SATA pools

MS SQL DSS application shares a common SATA pool with all applications but is bound to a separate FC pool


Configuring FAST VP

FAST VP is either enabled or disabled

Data Movement should be set to automatic

Relocation Rate controls aggressiveness of FAST

New Feature Allocate- by-Policy simplifies capacity management of thin Provisioned environments

Time windowsCreate time windows to specify when data can be collected for performance analysis and when data movements can be executed.

Recommend to have windows always open so FAST VP can use most recent analysis to optimize data placement.


Enable FAST VP Coordination on Storage Groups With this feature enabled, FAST VP sends device usage statistics from R1 to R2

to ensure that the FAST engine at the standby/failover site has up-to-date metrics on which to base decisions.

Enabled under storage group management in Unisphere:– Check Box: Enable FAST VP RDF Coordination

Coordination should be enabled on storage groups at both source and target VMAX


VMware Configuration


VMware Configuration

vCenterscreenshots

Reduce HBA queuing for vSphere ESXi servers by changing the queue depth

– esxcli system module parameters set -p bfa_lun_queue_depth=64 -m bfa

Virtual Machine boot LUNs configured to use LSI SAS adapter

VMware Paravirtual SCSI (PVSCSI) adapters are used to configure DATA LUNs for high performance


EMC Virtual Storage Integrator and VMAX 40K


Application ConfigurationOracle OLTP

1 Oracle DB instance, 12 vCPUs with 53 GB RAM

1 DB per VM, 2 TB capacity

SwingBench entry workload on 400 users, 60:40 R/W ratio

MSSQL OLTP (TPC-E Like)

2 SQL instances, 16 vCPUs with 32 GB RAM


Mixed workloads to simulate hot, warm applications, 85:15 R/W ratio

MSSQL OLAP (DSS, TPC-H Like)

1 SQL instance, 32 vCPUs with 128 GB RAM


2 concurrent loads, 100% Read

SAP OLTP

3 SAP ERP 6 IDES EHP 4 instances, 16 vCPUs with 32 GB RAM

1 Oracle DB instance at 845 GB capacity

1000 LoadRunner Update users + local client copy simulation, 80:20 R/W ratio


FAST VP PoliciesThe table below details the FAST VP Policies set for our baseline configuration:

Both MSSQL1 and MSSQL2 applications share the same FAST policy

Policies restrict Flash tier to prevent any single application from dominating Flash resources

Storage group FAST policy name Flash FC SATA

MSSQL1_OLTP MSSQL_OLTP 5% 40% 100%

MSSQL2_OLTP MSSQL_OLTP 5% 40% 100%

MSSQL_DSS MSSQL_DSS 0% 100% 100%

Oracle Oracle 15% 35% 50%

SAP SAP 10% 80% 10%


Validation and Testing• Application Performance Validation• Online Policy Tuning• SRDF Coordination• Application Failover with Rapid Ramp-Up


Application Performance Validation


OLTP Application

Server Transactions Per Minute

Average Read Response Time

Oracle 97,846 5.5 ms

MSSQL1 37,920 10 ms

MSSQL 2 139,020 11 ms

DSS/OLAP Application Average Throughput

MSSQL DSS 808 MB/s

ApplicationServer Transactions

Per MinuteAverage Dialogue

Response time

SAP 2894.8 929.93 ms

Build Validation—All Applications Running


FAST VP Responsiveness and Flexibility

At 7:40am SQL OLTP policy adjusted to add additional Flash capability

After 30 minutes performance improvements were seen

SQL txn/sec increased and latency dropped

After 2 hours the SQL performance stabilized

Zero impact observed by other running applications


Validating FAST VP SRDF Coordination

SRDF coordination – Balance at Source

and target– Similar tier usage at

both sites

Solid lines are source devices

Dotted lines are target devices


SRDF Coordination, continued

Device has been balanced across all tiers in a similar distribution on both R1 and R2

[root@solenabler1 ~]# symcfg list -tdev -range 426:426 -bound -detail -v -sid 541

Symmetrix ID: 000195700541

Enabled Capacity (Tracks) : 1826068704Bound Capacity (Tracks) : 1048590

S Y M M E T R I X T H I N D E V I C E S---------------------------------------------------------------------- Pool Pool Total Bound Flags Total Subs Allocated WrittenSym Pool Name ESPT Tracks (%) Tracks (%) Tracks (%)---- ------------ ----- ---------- ----- ---------- --- ---------- ---0426 FC10K_RAID1 F..B 1048590 0 570996 54 1044492 100 FLASH_3RAID5 -.-- - - 352524 34 - - SATA_6RAID6 -.-- - - 120972 12 - -

Total ---------- ----- ---------- --- ---------- ---Tracks 1048590 0 1045620 0 1044754 00

Source Array

Disaster Recovery

Array


Failover Test

Oracle & SAP Running at R1

Oracle & SAP Failed over and running at R2

Application loads were run for extended periods at R1 site and FAST VP balanced storage groups on both arrays

RDF links split to simulate failover

SAP and Oracle were brought up on remote ESXi Server

Performance was monitored before and after failover


Failover Test, continued

Following failover performance at application levels were on par with production

Transactions per minute and response times observed were equal


Summary and Solution Benefits VMAX 40K provides an ideal platform for virtualized critical database

applications, running varied workloads.

Cascaded storage groups enable simplified management of ESX environments with FAST VP.

FAST VP is tunable and responsive. By adjusting FAST policies, performance can be tuned to meet changing business performance needs. Increased performance within 30 minutes with no negative impact to other running workloads.

End-to-end visibility with VMware Storage Integrator from EMC enables simplified management and identification of VMAX devices direct from vCenter

SRDF coordination with FAST VP ensures production level performance at the R2 site in FAST VP environment in the event of a failover when configurations are similar. This delivers the performance and cost benefits of FAST VP at both production and disaster recovery sites.


Questions?

1© Copyright 2012 EMC Corporation. All rights reserved. EMC INFRASTRUCTURE FOR VMWARE CLOUD ENVIRONMENTS EMC Symmetrix VMAX 40K, EMC Symmetrix FAST VP,

Documents

emc corporation

storage overprovision

storage management

provisioning fast vp

emc unisphere

physical storage

storage utilization

storage arrays