Red Hat Storage Day New York - Whats New in Red Hat Ceph Storage

RED HAT CEPH STORAGE UPDATE

Neil Levine Red Hat October 2016

SECTIONS

RED HAT STORAGE

1.3 REVIEW

2.0 FEATURES

FUTURE

1

2

3

4

RED HAT STORAGE

4

THE RED HAT STORAGE PORTFOLIO

Gluster management

Ceph data service Gluster data service

Ceph management

OP

EN

SO

UR

CE

SO

FTW

AR

E

STA

ND

AR

D

HA

RD

WA

RE

Share-nothing, scale-out architecture provides durability and adapts to changing demands

Self-managing and self-healing features reduce operational overhead

Standards-based interfaces and full APIs ease integration with applications and systems

Supported by the experts at Red Hat

5

HOW STORAGE FITS

PHYSICAL VIRTUAL PRIVATE CLOUD CONTAINERS PUBLIC CLOUD

RED HAT CEPH STORAGE

RBD A reliable, fully distributed block device

with cloud platform integration

RGW A web services gateway for object

storage, compatible with S3 and Swift

APP HOST/VM

LIBRADOS A library allowing apps to directly access RADOS (C, C++, Java, Python, Ruby

RADOS A software-based reliable, autonomous, distributed object store comprised of self-

healing, self-managing, intelligent storage nodes and lightweight monitors

CEPHFS* A distributed file system with POSIX

semantics & scale-out metadata

CLIENT

* CephFS is Tech Preview in RHCS2 7

CEPH ARCHITECTURE

8

RED HAT CEPH STORAGE 1.3

June 2015 1.3.0

Robustness at Scale

Operational Efficiency

Performance

Improvements

Nov 2015 1.3.1

Sept 2016 1.3.3

Satellite 6 support

Update to latest version of Hammer

March 2016 1.3.2

Satellite 5 Support

SELinux

3x small write boost on SSD

9

OPENSTACK USER SURVEY Which OpenStack Block Storage (Cinder) drivers are in use?

SOURCE: OpenStack User Survey, April 2016

62%

22%

12%

10%

9%

6%

5%

4%

3%

3%

2%

2%

7%

10

HYPER-CONVERGED OPENSTACK

HCI NODE 1

Lower TCA & TCO

Fewer SKUs

Resource Management

Easy migration to 2-tier HCI NODE 2

Ceph OSD Ceph OSD

Admin Node

Nova Compute Nova Compute

HCI NODE 3

Ceph OSD

Nova Compute

Controller 1 Controller 2

Ceph MON Ceph MON

OSP Services OSP Services

Controller 3

Ceph MON

OSP Services

2.0

12

RED HAT CEPH STORAGE 2 THEMES

USABILITY OBJECT IMPROVEMENTS PERFORMANCE

13

USABILITY: RED HAT STORAGE CONSOLE

An easy to use interface for managing cluster lifecycles •  Ansible-based deployment tools

for driving granular configuration options from CLI or GUI

•  Monitoring and graphs for troubleshooting with statistical information about components

14

OBJECT STORAGE IMPROVEMENTS

Global object storage clusters with a single namespace •  Enables deployment of clusters

across multiple geographic locations

•  Clusters synchronize, allowing users to read from or write to the closest one

•  Ideal for follow-the-sun, CDN or Disaster Recovery

STORAGE CLUSTER US-EAST STORAGE CLUSTER

US-WEST

15

OBJECT STORAGE IMPROVEMENTS

Support for authentication using Active Directory, LDAP & OpenStack Keystone v3

Greater compatibility with the Amazon S3 and OpenStack Swift object storage APIs

•  AWS v4 signatures, object versioning, bulk deletes

New NFS gateway for import and export of object data (tech preview)

16

PERFORMANCE: BLUESTORE (TECH PREVIEW)

BlueStore is a new Ceph storage backend optimized for modern media •  Replaces FileStore, which was designed

for HDDs

•  Supports flexible media topologies (flash, K/V drives, persistent memory)

•  Eliminates the need for an underlying filesystem or dedicated journal device

•  Provides a 2-3X performance boost

17

OPENSTACK: RBD MIRRORING

Multi-site replication for block devices (RBD Mirroring) •  Replicates virtual block devices

across regions

•  Designed for disaster recovery and archival

•  Integration with Cinder Volume Replication (OSP-10)

STORAGE CLUSTER US-EAST STORAGE CLUSTER

US-WEST

18

OPENSTACK: CEPHFS (TECH PREVIEW)

CephFS is a POSIX-compliant file system for use with OpenStack Manila •  Support for FUSE or kernel clients (RHEL 7.2)

•  Approach: robustness, hardening, then scalability

Nov 2015 Manila tech preview

in OSP7

Aug 2016 CephFS tech preview in

RHCS2/clients

Aug 2016 CephFS Manila tech

preview in OSP9

Nov 2016 Manila production support in OSP10

2017 CephFS production

support

INTERNAL USE ONLY

FUTURE

20

FUTURE

2.1 (Nov 2016) 1

21

FUTURE

2.1 (Nov 2016)

Ceph for Data Lakes and Analytics

1

2

22

FUTURE

2.1 (Nov 2016)


Testing at scale

1

2

3

23

FUTURE

2.1 (Nov 2016)


Testing at scale

3.0

1

2

3

4

24

FUTURE

2.1 (Nov 2016)


Testing at scale

3.0

Containerized Ceph & Containerized OpenStack

1

2

3

4

5

THANKS!

@neilwlevine https://redhat.com/storage

CORE • Bluestore (tech preview) • Performance optimizations

26

ROADMAP SUMMARY RED HAT CEPH STORAGE 2 (today)

Ceph Jewel

MANAGEMENT • Red Hat Storage Console 2 • Lifecycle management • Ansible support

OBJECT • Support for global clusters • AD, LDAP, Keystone v3 • Expanded API compatibility • NFS gateway (tech preview)

BLOCK • Volume Mirroring for DR


27


Ceph Jewel




RED HAT CEPH STORAGE 2.1 (Q4 2016)

OBJECT • Static Websites • Indexless Buckets • Payer Request • Swift Refcore Compliance


28


Ceph Jewel






BLOCK • iSCSI for Windows & RHEL


29


Ceph Jewel







UPSTREAM ACTIVITY (in the future)

OBJECT • Metadata search • Tiering to the public cloud • Object-level encryption • Compression


30


Ceph Jewel









BLOCK • Erasure coding support • Persistent client-side cache • Improved iSCSI support


CORE • Bluestore General Availability • Data checksums • Integrated key management • Improved multi-threading

31


Ceph Jewel











CORE • Bluestore General Availability • Data checksums • Integrated key management • Improved multi-threading

32


Ceph Jewel








FILE • Active/active metadata servers • Snapshots • Hypervisor integration



Red Hat Storage Day New York - Whats New in Red Hat Ceph Storage

Technology