Top Banner
Storage with Ceph Scale-Out made easy Martin Gerhard Loschwitz © 2013 hastexo Professional Services GmbH. All rights reserved.
84
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Storage with ceph (osdc 2013)

Storage with Ceph Scale-Out made easy

Martin Gerhard Loschwitz

© 2013 hastexo Professional Services GmbH. All rights reserved.

Page 2: Storage with ceph (osdc 2013)

Who?

Page 3: Storage with ceph (osdc 2013)
Page 4: Storage with ceph (osdc 2013)
Page 5: Storage with ceph (osdc 2013)
Page 6: Storage with ceph (osdc 2013)
Page 7: Storage with ceph (osdc 2013)
Page 8: Storage with ceph (osdc 2013)
Page 9: Storage with ceph (osdc 2013)
Page 10: Storage with ceph (osdc 2013)
Page 11: Storage with ceph (osdc 2013)
Page 12: Storage with ceph (osdc 2013)

Scalable Storage

Page 13: Storage with ceph (osdc 2013)

2 types of Scalability

Page 14: Storage with ceph (osdc 2013)

Scale-Up

Page 15: Storage with ceph (osdc 2013)

Scale-Up before:

Page 16: Storage with ceph (osdc 2013)

Scale-Up afterwards:

Page 17: Storage with ceph (osdc 2013)

Scale-Up quickly comes to its limits

Page 18: Storage with ceph (osdc 2013)

Scale-Out

Page 19: Storage with ceph (osdc 2013)

Scale-Out before:

Page 20: Storage with ceph (osdc 2013)

Scale-Out afterwards:

Page 21: Storage with ceph (osdc 2013)

Scale-Out is hip

Page 22: Storage with ceph (osdc 2013)

Webserver

Page 23: Storage with ceph (osdc 2013)

Databases

Page 24: Storage with ceph (osdc 2013)

Even me!

Page 25: Storage with ceph (osdc 2013)

Storage? Meh.

Page 26: Storage with ceph (osdc 2013)

The Block problem

Page 27: Storage with ceph (osdc 2013)

HDD FS

User Space

Page 28: Storage with ceph (osdc 2013)

Blocks for distributed systems?

Page 29: Storage with ceph (osdc 2013)

I don’t think so, Tim!

Page 30: Storage with ceph (osdc 2013)

Object Stores

Page 31: Storage with ceph (osdc 2013)
Page 32: Storage with ceph (osdc 2013)

User Space

Objects

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

Page 33: Storage with ceph (osdc 2013)

User Space

Objects

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

Page 34: Storage with ceph (osdc 2013)
Page 35: Storage with ceph (osdc 2013)

Originally a PhD thesis

Page 36: Storage with ceph (osdc 2013)
Page 37: Storage with ceph (osdc 2013)

Object Store

Page 38: Storage with ceph (osdc 2013)

RADOS

Page 39: Storage with ceph (osdc 2013)

Redundant Autonomic Distributed Object Store

Page 40: Storage with ceph (osdc 2013)

2 Components

Page 41: Storage with ceph (osdc 2013)

OSDs

Page 42: Storage with ceph (osdc 2013)

MONs

Page 43: Storage with ceph (osdc 2013)

Data Placement

Page 44: Storage with ceph (osdc 2013)
Page 45: Storage with ceph (osdc 2013)

MONs

Page 46: Storage with ceph (osdc 2013)

MONs

Page 47: Storage with ceph (osdc 2013)

MONs

Page 48: Storage with ceph (osdc 2013)

MONs

Page 49: Storage with ceph (osdc 2013)

MONs

Page 50: Storage with ceph (osdc 2013)

MONs

Page 51: Storage with ceph (osdc 2013)

MONs

Page 52: Storage with ceph (osdc 2013)

Parallelization

Page 53: Storage with ceph (osdc 2013)

2 2 1 1

MONs

Page 54: Storage with ceph (osdc 2013)

2 2 1 1

MONs

Page 55: Storage with ceph (osdc 2013)

2 2 1 1 1 2 2 1

MONs

Page 56: Storage with ceph (osdc 2013)

MONs

Page 57: Storage with ceph (osdc 2013)

CRUSH

Page 58: Storage with ceph (osdc 2013)

Controlled Replication Under Scalable Hashing

Page 59: Storage with ceph (osdc 2013)

Rack aware

Page 60: Storage with ceph (osdc 2013)

Clients?

Page 61: Storage with ceph (osdc 2013)

Block Device Driver

Page 62: Storage with ceph (osdc 2013)

RBD (RADOS Block Device)

Page 63: Storage with ceph (osdc 2013)

rbd

Page 64: Storage with ceph (osdc 2013)

Qemu-RBD

Page 65: Storage with ceph (osdc 2013)
Page 66: Storage with ceph (osdc 2013)

ReSTful API

Page 67: Storage with ceph (osdc 2013)

radosgw

Page 68: Storage with ceph (osdc 2013)

Compatible with S3 and Swift

Page 69: Storage with ceph (osdc 2013)

POSIX file system

Page 70: Storage with ceph (osdc 2013)

CephFS

Page 71: Storage with ceph (osdc 2013)

Still Beta!

Page 72: Storage with ceph (osdc 2013)

Need a special client?

Page 73: Storage with ceph (osdc 2013)

librados

Page 74: Storage with ceph (osdc 2013)

Use cases

Page 75: Storage with ceph (osdc 2013)

Gigantic Storage

Page 76: Storage with ceph (osdc 2013)

40TB, 3 replicas = € 21.000

Page 77: Storage with ceph (osdc 2013)

Virtualization

Page 78: Storage with ceph (osdc 2013)

iSCSI Storage

Page 79: Storage with ceph (osdc 2013)

Cloud

Page 80: Storage with ceph (osdc 2013)

OpenStack

Page 81: Storage with ceph (osdc 2013)

live demo

Page 82: Storage with ceph (osdc 2013)

24. May 2013

OpenStack DACH Day 2013

http://openstackdach2013.eventbrite.com

Page 83: Storage with ceph (osdc 2013)

Special thanks goes to:

Sage Weil (Twitter: @liewegas) & crew for Ceph

Inktank (Twitter: @inktank)

for the Ceph logo

Page 84: Storage with ceph (osdc 2013)

goo.gl/S1sYZ (me on Google+)

twitter.com/hastexo

hastexo.com

2 2 1 1 1 2 2 1

MONS