Top Banner
© 2013 IBM Corporation New Generation of Storage Tiering: Less management, lower investment and increased performance Tony Pearson – IBM Master Inventor and Senior Managing Consultant March 2013
21

New Generation of Storage Tiering

Jan 14, 2015

Download

Documents

Tony Pearson

This session covers storage tiering from server to storage devices to Cloud.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: New Generation of Storage Tiering

© 2013 IBM Corporation

New Generation of Storage Tiering :Less management, lower investment and increased performance

Tony Pearson – IBM Master Inventor and Senior Managing Consultant

March 2013

Page 2: New Generation of Storage Tiering

© 2013 IBM Corporation2

Today’s Challenges, Tomorrow’s Opportunities

Not only ensuring high availability and quality of existing services, but also meeting customer expectations

for real-time, dynamic access to innovative new services.

IMPROVE SERVICE

Not just containing operational cost and complexity, but achieving

breakthrough productivity gains through virtualization, optimization, energy stewardship, and flexible

sourcing.

REDUCE COST

MANAGE RISKNot only addressing today’s security, and compliance challenges, but also preparing for the new risks posed by an even more connected and collaborative world.

Deliver the right information,

to the right people, at the right time …

… with an IT infrastructure in a dynamically changing

environment

Page 3: New Generation of Storage Tiering

© 2013 IBM Corporation3

Four Fundamental Truths – A Basis for Storage Tiering

� All data is not created equal

� Information changes in business value and in service level requirements over time

� IT resources should be allocated according to the value of data

� Information must be managed throughout its entire lifespan … data outlives media

0

20

40

60

80

100

1 w 2 w 3 w 4 w 3 m 6 m 9 m 1 yr 2 yr 5 yr 10 yr

Da

ta V

alu

e

Age of Data

Machine data

Email

EMR

Database

Surveillance Video

Page 4: New Generation of Storage Tiering

© 2013 IBM Corporation4

Storage Tiers – A trade-off between performance and cost

Server

Cache andSolid-State Drives

Hard Disk Drives

Tape

Cloud

FasterPerformance

LowerCost

Technologies allow us to place and move data to the

appropriate storage tier to balance between

performance and cost

Page 5: New Generation of Storage Tiering

© 2013 IBM Corporation5

Automated Sub-LUN Tiering within a Storage Array

Solid-State Drives

Enterprise HDD15K and 10K rpm

Nearline HDD7200 rpm

Problem:

� SSDs are considerably more expensive than traditional disks

� Without optimization tools, clients have been over-provisioning them

� Administrators spend too much time monitoring, reporting, and tuning tiers

Solution:

� Three data relocation functions that enable smart data placement to optimize SSD deployments with minimal costs

– Sub-LUN Automatic Movement– Entire-LUN Manual Relocation– Re-balancing Intra-Tier Extent

Pool

Page 6: New Generation of Storage Tiering

© 2013 IBM Corporation6

IBM Easy Tier®

SSD RAID Array(s)

Enterprise HDD

Nearline HDD

� Extent Pools can have mixed media1. Solid-State Drives (SSD)2. Enterprise HDD (15K and 10K RPM)3. Nearline HDD (7200 RPM)

� Easy Tier measures and manages activity– 24 hour learning period– Every five minutes: up to 8 extents moved

• Hottest Extents moved up to SSD• Coldest Extents moved down to slowest

Disk– New allocations placed initially on fastest HDD

� A small amount of SSD (as little as 3%) can dramatically reduce response times and increase IOPS throughput

� Storage Tier Advisory Tool can estimate benefits of adding SSD before purchase!

Page 7: New Generation of Storage Tiering

© 2013 IBM Corporation7 7

Application

Transactions

Easy Tier

Learning

Easy Tier

In Action

240% from

Original

brokerage

transaction

IBM Easy Tier Application Transaction Improvement

� No change to the database or application

� No work to identify active indexes

� No manual movement of files or volumes

� Just turn it on and let it work!

Page 8: New Generation of Storage Tiering

© 2013 IBM Corporation8

IBM Easy Tier® Cooperative Server Caching

Server Server

SAN

To avoid performance bottlenecks over the SAN, IBM Easy Tier® will be extended to support server-based Flash

• Most active data will be moved from disk system to server SSD

• Global cache statistics maintained in the Disk array

• Applications can provide “hints”

IBM Edge 2012 Demonstration showed POWER7 server with EXP30 SSD and DS8800 Easy Tier, resulting in 5x performance boost for Filenet ECM

IBM has acquired Texas Memory Systems, and plans to offer Easy Tier support for PCiE Flash cards as well

Announcement : http://www-01.ibm.com/common/ssi/cgi -bin/ssialias?subtype=ca&infotype=an&appname=iSource &supplier=877&letternum=ENUSZG12-0163

SSD

EntHDD

NL HDD

Page 9: New Generation of Storage Tiering

© 2013 IBM Corporation9

IBM SmartCloud Virtual Storage Center (VSC)

SSD

EntHDD

NL HDD

SSDEntHDD

NL HDD

NL HDD

SAN

Problem:

� High-end disk arrays are expensive

� Difficult to identify which data should be moved

� Manually re-locating LUNsis manual and disruptive

Solution:

� SmartCloud VSC can manage up to 256 arrays (IBM and non-IBM) per SmartCloudVSC cluster

� Storage Analytics Engine recommends up-tier and down-tier moves based on performance and age of the data

� Move LUNs non-disruptively within and across arrays

Page 10: New Generation of Storage Tiering

© 2013 IBM Corporation10

Hierarchical Storage Management (HSM)

Hard Disk

Drives

Tape

Problem:

� Disk faces challenges for density and has slowed to 20%

� Tape will continue to grow in Density at an average 40% CAGR

� Cost difference – Disk is 20x more expensive than Tape

Solution:

� Migrate or archive data from disk to tape based on age and anticipate access pattern

� Automatically recall data back to disk when accessed by user or application

Page 11: New Generation of Storage Tiering

© 2013 IBM Corporation11

Reduced Costs, Increased Flexibility

� Lower costs primarily from:

– Lower cost of media

– Minimal need for Power & Cooling

� Increased flexibility from ability to:

– Add capacity by simply adding Tape cartridges

– Expand Tape libraries over and around existing equipment in the data center

� Reliability: lower bit-error-rates, read verifications after writes.Tape

$946,405

$7

$3.5

$0

Mill

ions

NL/SATA Disk

$6,365,950

Blended Disk and Tape

$2,255,346

Hardware

Prod + DR Carts

Maintenance

Power & Cooling

Floor space

Utilizing Tape Drastically Reduces TCO10 year TCO example. Assumes 250TB storage, 25% growth/yr

* TCO estimates based on IBM internal studies.

Blended Disk and Tape Storage Solutions

Page 12: New Generation of Storage Tiering

© 2013 IBM Corporation12

Automate Data Placement and Migration

Initial placement Enterprise

SAS

NL-SAS

180 days

30 days

File creation

SONASStorwize V7000 Unified

Optional TSM/HSMServer & Virtual or Physical Tape Pool

Page 13: New Generation of Storage Tiering

© 2013 IBM Corporation13

Linear Tape File System (LTFS)

Device Directory , for the LTO5 tape

Tape

Contents

LTFS Single Drive Edition

Treat tape cartridges like USB memory sticks!

Attach Host to Tape using a standard file System

LTFS Library Edition

Page 14: New Generation of Storage Tiering

© 2013 IBM Corporation14

Hybrid Cloud Storage and the IBM Active Cloud Engine™

Cloud

Hard Disk

Drives

Problem:

� Remote offices need access to corporate data

� Corporate HQ needs access to Remote office data

� Data access across WAN can be slow or difficult to find

Solutions:

� A Cloud Storage Gateway can provide high performance access to most recently accessed data

– IBM SmartCloud Enterprise Object Storage

� IBM Active Cloud Engine provides a global namespace of all your files across all of your locations

– Hub-and-Spoke design allows a central HQ location (Hub) to work with up to 1000 remote offices (Spokes)

Page 15: New Generation of Storage Tiering

© 2013 IBM Corporation15

The Ideal “Hybrid Storage Cloud”

Variety of hostattachment protocolsNFS, CIFS,iSCSI, FCoE

Choices for different Cloud

services providers,

and/or other data center

locations

Highly scalable

CloudStorageGateway

• OxygenCloud• Nirvanix CloudNAS®

• TwinStrata (iSCSI)

• Panzura File System

Page 16: New Generation of Storage Tiering

© 2013 IBM Corporation16

Active Cloud Engine™ -- Hub and Spoke Design

Spoke-1SONAS Read-access to

some filesets

Read-write access to filesets owned by this location

HubSONAS

Spoke-2SONAS

Fileset owned by the Central HubEach Spoke can have a read-only cache copy Periodic prefetch or On-Demand Pull.

1

Fileset owned at Spoke-1 (read/write)Updates are sent to the Central HubRead-only cache copies available to other Spokes.

2

CentralDatacenter

or Cloud

Page 17: New Generation of Storage Tiering

© 2013 IBM Corporation17

The Shifting Roles of Storage

Solid-State Drives (SSD)

Combined with slower SATA disk to reduce energy costs over 15K RPM drives

“Flash & Stash”

Disk replication and Virtual Tape Libraries

Improved by low cost SATA, compression, deduplication

Physical tape, combined with automation

Linear Tape File System (LTFS)

Primary Data

Backup Data

Work TaskProject Folder

Long-term Space Management and

Data Retention

Page 18: New Generation of Storage Tiering

© 2013 IBM Corporation18

Page 19: New Generation of Storage Tiering

© 2013 IBM Corporation19

About the Speaker

Mr. Tony Pearson

Master Inventor,

Senior Managing Consultant

IBM System Storage

Tony Pearson is a Master Inventor and Senior managing consultant for the IBM System Storage™ product line. Tony joined

IBM Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on storage topics covering the entire System Storage product line, Tivoli storage software products, and topics related to Cloud

Computing. He interacts with clients, speaks at conferences and events, and leads client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization products.

Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1

most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume I through V.

Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in

Electrical Engineering, both from the University of Arizona. Tony holds 19 IBM patents for inventions on storage hardware and software products.

9000 S. Rita RoadBldg 9032 Room 1238Tucson, AZ 85744

+1 520-799-4309 (Office)

[email protected]

Tony Pearson

Master Inventor, Senior Managing Consultant

IBM System Storage™

Page 20: New Generation of Storage Tiering

© 2013 IBM Corporation20

Additional ResourcesEmail:[email protected]

Twitter:http://twitter.com/az99Øtony

Blog: http://ibm.co/brAeZØ

Books:http://www.lulu.com/spotlight/99Ø_tony

IBM Expert Network:http://www.slideshare.net/az99Øtony

Page 21: New Generation of Storage Tiering

© 2013 IBM Corporation21

Trademarks and disclaimersAdobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind.

The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Changes may be incorporated in production models.

© IBM Corporation 2013. All rights reserved.

References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml. ZSP03490-USEN-00