1 © Copyright 2014 EMC Corporation. All rights reserved. ScaleIO Convergence. Scalability. Performance. Elasticity.
1© Copyright 2014 EMC Corporation. All rights reserved.
ScaleIO
Convergence. Scalability. Performance.Elasticity.
2© Copyright 2014 EMC Corporation. All rights reserved.
Software-Defined Converged Server SANEMC ScaleIO
Software that creates a server-based SAN from local storage to deliver performance and capacity on demand
Creates virtual pool of storage with varying performance tiers
Media-agnostic: Leverages any HDDs, SSDs, & PCIe flash cards
Server-agnostic: Installed on existing physical & virtual app servers
ScaleIO
3© Copyright 2014 EMC Corporation. All rights reserved.
ScaleIO Turns DAS Into A Server SAN
Performance—massive I/O parallelism
Elastic—add/remove servers & capacity “on-the-fly”
Convergence of storage and compute
Scale-out to thousands of servers
4© Copyright 2014 EMC Corporation. All rights reserved.
Simplify Your data center ArchitectureConvergence
Converge storage and compute resources into a single-layer architecture
Aggregate capacity and I/O performance
Make storage as ubiquitous as CPU & RAM
Consolidate storage and applications onto x86 and ARM hardware
Servers
Network
Storage
ConvergedArchitecture
5© Copyright 2014 EMC Corporation. All rights reserved.
Scalability
Massively scale to thousands of nodes
Add storage devices and servers modularly to increase capacity and performance
Storage growth always automatically aligned with application needs
6© Copyright 2014 EMC Corporation. All rights reserved.
Elasticity
Dynamically add, move, remove storage and compute resources “on the fly” with no downtime
No capacity planning required
Leverage mixed:– Server brands– Configurations– OS platforms (physical & virtual)– Media types
7© Copyright 2014 EMC Corporation. All rights reserved.
Massive I/O Parallelism
I/O processing load shared among all servers
Automatic rebuild & rebalance
Autonomous management of performance hot spots and data layout
Storage tiering
Performance
Eliminate I/O Bottlenecks
8© Copyright 2014 EMC Corporation. All rights reserved.
Before ScaleIOWith ScaleIO
1,000 IOPS 10 TB100 IOPS
1 TB100 IOPS
1 TB100 IOPS
1 TB100 IOPS
1 TB100 IOPS
1 TB100 IOPS
1 TB100 IOPS
1 TB100 IOPS
1 TB100 IOPS
1 TB100 IOPS
1 TB
2,000 IOPS 20 TB
100 IOPS1 TB
100 IOPS1 TB
100 IOPS1 TB
100 IOPS1 TB
100 IOPS1 TB
100 IOPS1 TB
100 IOPS1 TB
100 IOPS1 TB
100 IOPS1 TB
100 IOPS1 TB
9© Copyright 2014 EMC Corporation. All rights reserved.
ScaleIO EnvironmentEliminate the Need for Array, Switching Fabric, and HBAs
FLEXIBILITY IN EXPANSION
10© Copyright 2014 EMC Corporation. All rights reserved.
Add Nodes or Disks Dynamically—System Automatically Migrates and Rebalances Storage
Auto-Rebalance
11© Copyright 2014 EMC Corporation. All rights reserved.
Remove Nodes or Disks Dynamically—System Automatically Migrates and Rebalances Storage
Auto-Rebalance
12© Copyright 2014 EMC Corporation. All rights reserved.
Simple Management & Monitoring Automated installation scripts and easy
configuration
Any IT admin can manage the entire data center stack
Call-home and incident reporting
Self-regulated data layout, performance optimization, and HW/SW failure recovery—no administrative intervention required
13© Copyright 2014 EMC Corporation. All rights reserved.
Bandwidth/ IOPS Limiter for
Quality of Service
For Infrastructure as a ServiceEnterprise Features
Writeable Snapshots for
Backups
Protection Domains for
Isolated Servers and Data Sets
Storage Pools for Tiering
Control Performance, Capacity, and Data Location
Light Data Encryption at
Rest for Security
APP 1
APP 2
APP 3
14© Copyright 2014 EMC Corporation. All rights reserved.
How ScaleIO Lowers Your TCOYour Bottom Line
1. Commodity hardware
2. No dedicated storage components (FC network, HBAs, etc.)
3. Reduced power, cooling, and space
4. No “forklift” upgrades for EOL HW
5. Reduced administrative overhead
6. “Pay as you grow”—linear investments with predictable costs
15© Copyright 2014 EMC Corporation. All rights reserved.
USE CASES
VSI VDI
DATABASES TEST & DEV
16© Copyright 2014 EMC Corporation. All rights reserved.
Virtual Server Infrastructure (VSI)
Large storage capacities
Easy growth
Deliver low $/server
Easy manageability
Any hardware
Any size growth
No capacity planning
Easy growth in capacity and performance
Ease of management
Low TCO
Requirements: Why ScaleIO:
VSI
17© Copyright 2014 EMC Corporation. All rights reserved.
Requirements: Why ScaleIO:
Virtual Desktop Infrastructure (VDI)
Performance at peak times (“boot storms”)
Large storage capacities
Easy growth
Deliver low $/desktop
Parallel processing
Any hardware
Any size growth
No capacity planning
Easy growth in capacity and performance
Ease of management
Low TCO
VDI
18© Copyright 2014 EMC Corporation. All rights reserved.
Databases
High write performance
High availability
Quick recovery
Low cost of storage
Convergence allows for fast writes
Massive parallelism delivers quick recovery
Stable, predictable performance
Low TCO
Requirements: Why ScaleIO:
DATABASES
19© Copyright 2014 EMC Corporation. All rights reserved.
Development & Testing
Medium capacity & performanceLow cost Rapidly changing environment with high deduplication rateRapid hardware changes and repurposing
Rebalancing for frequently changing environmentsEasy scale-out and hardware upgrade with no downtimeLow initial cost allows more investment in computeStable, predictable performanceEasy management
Requirements: Why ScaleIO:
TEST & DEV
20© Copyright 2014 EMC Corporation. All rights reserved.
ARCHITECTURE
21© Copyright 2014 EMC Corporation. All rights reserved.
ETH/IB
ScaleIO Data Client (SDC)
HOST
SDCCScaleIO
Protocol
DAS
Exposes ScaleIO Volumes to Application
22© Copyright 2014 EMC Corporation. All rights reserved.
ScaleIO Data Server (SDS)
SDSS
HOST
ETH/IBScaleIO
Protocol
Owns Local Storage Dedicated to ScaleIO
DAS
23© Copyright 2014 EMC Corporation. All rights reserved.
Configures and monitors the ScaleIO system
Keeps track of storage and data mapping
Monitors capacity, performance, and load balancing
Makes data migration decisions
Metadata Manager (MDM)
24© Copyright 2014 EMC Corporation. All rights reserved.
Non-VMware Environments
• Identical to physical environments
• SDS and SDC sit inside hypervisor
Hypervisor
VM VM VM………
ETH/IB
C
S
Server
25© Copyright 2014 EMC Corporation. All rights reserved.
Hypervisor
VMware Environments
SVM: Dedicated ScaleIO VM in each ESX host containing SDC and SDS
SDS: Accesses storage volumes via VMFS
SDC: Exposes volumes as iSCSI targets to VMFS
Hypervisor: iSCSI initiator, exposing VMFS to VMs
VMVM
Server
SVM
ETH/IB
C
S
VMFSVMFS
SCSI
……
26© Copyright 2014 EMC Corporation. All rights reserved.
ETH/IB
Single Read I/O
C
ETH/IB
S
27© Copyright 2014 EMC Corporation. All rights reserved.
ETH/IB
Single Write I/O
C
ETH/IB
S S
28© Copyright 2014 EMC Corporation. All rights reserved.
Fully Converged Configuration
ETH/IB
S CS S S S S
S S S S S S
S S S S S S
C C C C C C
C C C C C C
C C C C C C
29© Copyright 2014 EMC Corporation. All rights reserved.
Two-Layer Configuration
ETH/IB
S S S S S S
C C C C C C
30© Copyright 2014 EMC Corporation. All rights reserved.
Two-Layer Configuration
S S S S S S
S S S S S S
ETH/IB
C C C C C C
31© Copyright 2014 EMC Corporation. All rights reserved.
Massive Parallelism as SDCs Contact Relevant SDSs Directly
Two-Layer Configuration
ETH/IB
S S S S S S
C C C C C C
32© Copyright 2014 EMC Corporation. All rights reserved.
Massive Parallelism as SDCs Contact Relevant SDSs Directly
Fully Converged Configuration
S CS S S S S
S S S S S S
C C C C C C
C C C C C C
ETH/IB
33© Copyright 2014 EMC Corporation. All rights reserved.
Distributed VolumesSDS 1
SDS 5 SDS 6 SDS 100
SDS 2 SDS 3 SDS 4
Volume 1
Volume 2
…
34© Copyright 2014 EMC Corporation. All rights reserved.
B
AA
Two-Copy “Mesh” Mirroring
B
C
DD
C
EE
35© Copyright 2014 EMC Corporation. All rights reserved.
Data Protection
FFBE EE
BB
F
36© Copyright 2014 EMC Corporation. All rights reserved.
Protection Domains
• Protection Domain: A
logically segregated
grouping of SDSs (nodes
and storage)
• Provides security, data
location, and performance
segregation
37© Copyright 2014 EMC Corporation. All rights reserved.
Pool 1 Pool 3Pool 2
Storage Pools
• Storage pool: A subset of devices in a protection domain created for performance isolation and data segregation
• Enables tiering between device types
• Can be asymmetric
FLASHDISKS
Protection Domain
38© Copyright 2014 EMC Corporation. All rights reserved.
Writeable Snapshots
ScaleIO volumes that can be written, read and copied as snapshots
Instantaneous and thinly provisioned to save space
Organized in trees, known as VTrees
Consistency Group: collection of snapshots created together at the same time
C1
V1
S121
S111 S112
VTree1
V2
S211
VTree2
Consistency Group
39© Copyright 2014 EMC Corporation. All rights reserved.
For Quality of ServiceBandwidth/IOPS Limiter
Current Environment
AVAILABLE
With IOPS Limiter
APP 3APP 2APP 1
41© Copyright 2014 EMC Corporation. All rights reserved.
Why not rescue that capacity and put it to good use?