Top Banner
Real World Storage Dealing with scale, operational complexity, users and bosses!
32

TECHunplugged London 2016 - Real World Storage

Feb 16, 2017

Download

Technology

Chris Evans
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: TECHunplugged London 2016 - Real World Storage

Real World StorageDealing with scale, operational complexity, users and bosses!

Page 2: TECHunplugged London 2016 - Real World Storage

Warning!

This is a light hearted discussion on my experiences in storage over the last 30 years. As such it contains no technical deep

dives, no incisive comment or corporate analysis. If you’re easily offended, don’t worry, I do my best to make fun of everyone.

Page 3: TECHunplugged London 2016 - Real World Storage

TRUISMSLet’s start by discussing the most obvious statements in storage…

Page 4: TECHunplugged London 2016 - Real World Storage

Truisms

Everyone is expected to do more with less.

We are creating too much data.

Shared storage is dead!

Storage Administration is

dead.

Vendors have the solutions to all of

our problems.

Page 5: TECHunplugged London 2016 - Real World Storage

Same As It Ever WasTHISCHARTISFROM1987…

Page 6: TECHunplugged London 2016 - Real World Storage

FACTSBut what are the real facts about storage and data?

Page 7: TECHunplugged London 2016 - Real World Storage

Facts

Storage prices ($/TB) continue to decline for all media

Data volumes are increasing – but a lot is transient

We have no way to measure the value of data

Storage hardware is super reliable

Page 8: TECHunplugged London 2016 - Real World Storage

The future of storage is about managing the DATA and not the hardware

Page 9: TECHunplugged London 2016 - Real World Storage

TechnologyHow has the technology changed over the past 30 years? Let’s have some fun….

Page 10: TECHunplugged London 2016 - Real World Storage

IBM Mass Storage Subsystem

Page 11: TECHunplugged London 2016 - Real World Storage

IBM 3420 Tape

Page 12: TECHunplugged London 2016 - Real World Storage

IBM 3380 Disk (1987)

•3MB/s transfer rate•$70,000 list ($55,000/GB)•1.26GB capacity per drive• IBM 3380 model K 16ms response time

Page 13: TECHunplugged London 2016 - Real World Storage

Hitachi Disk Drive

Page 14: TECHunplugged London 2016 - Real World Storage

Hard Drive Form Factors

Page 15: TECHunplugged London 2016 - Real World Storage

Hard Drive Heads

IBM0665(around 1985,capacity20-44MB)

ModernHDD(400GBdrive)

Page 16: TECHunplugged London 2016 - Real World Storage

Storage Arrays and Crazy Names

Page 17: TECHunplugged London 2016 - Real World Storage

Flash Memory in 1987!

• 0.3ms access time• 3MB/s transfer• 32-512MB capacity

Page 18: TECHunplugged London 2016 - Real World Storage

Technology Realities

Storage media is truly a commodity

We have too much data to micromanage everything

Storage is cheap – don’t worry about a little wastage

Devicedensitieswillcontinuetoriseexponentially

Page 19: TECHunplugged London 2016 - Real World Storage

PeopleOK, so technology is in a good place; what about the people?

Page 20: TECHunplugged London 2016 - Real World Storage

USERSPERCEPTION: Technically these people are our customers. Without them we have no purpose. Users justify why we design and implement new storage systems.

REALITY: Users get in the way. Without them, we’d have lovely systems that never ran out of storage and always performed perfectly.

Page 21: TECHunplugged London 2016 - Real World Storage

User Types

The Panicker The Daydreamer

The PerfectionistThe Hoarder

Page 22: TECHunplugged London 2016 - Real World Storage

BOSSES• PERCEPTION: Our

managers are more in tune with customer and business needs than we are. They spend endless hours planning and strategizing how we implement best of breed technology.

REALITY: Bosses are a right pain in the a**e. They demand things at short notice, they moan about buying more storage and they expect you to use the technology that got them the best deal, not the stuff you know will work.

Page 23: TECHunplugged London 2016 - Real World Storage

Boss Types

The Tyrant

The Walkover

The Corporate

Micromanager

Page 24: TECHunplugged London 2016 - Real World Storage

COLLEAGUESPERCEPTION: There’s no “I” in TEAM; we all work together for the good of the company, supporting our colleagues to get the job done.

REALITY: No-one is as good at storage management as you; other people don’t adhere to standards, don’t clean up after them and are terrible at maintaining documentation. Given the choice, you’d prefer to do it all yourself.

Page 25: TECHunplugged London 2016 - Real World Storage

Colleague Types

The Idler

The Tinkerer

The Loner

The Sticker

Page 26: TECHunplugged London 2016 - Real World Storage

VENDORSPERCEPTION: As far as the vendor is concerned, it’s all about the customer. Your vendor will go that extra mile to ensure you’re happy and that their product is suited to your requirements.

REALITY: Vendors sell products; whether you need it or not, they will still try and sell it to you. Vendors are in it to make money; remember that when their salesmen come to call.

Page 27: TECHunplugged London 2016 - Real World Storage

Vendor Types

The Backstabber

The MateThe Miser

Page 28: TECHunplugged London 2016 - Real World Storage

Coping Strategies

Keep a little storage for

”emergencies”

Page 29: TECHunplugged London 2016 - Real World Storage

Coping Strategies

Be a little Paranoid!

Page 30: TECHunplugged London 2016 - Real World Storage

Coping Strategies

Never volunteer for the risky jobs

Page 31: TECHunplugged London 2016 - Real World Storage

Lessons Learned

•You will never have enough storage•Document things separately•Be prepared to become a data manager

Page 32: TECHunplugged London 2016 - Real World Storage

Thank You!