Ceph Day Beijing: Keynote - Ceph Ecosystem Update

Ceph Status && Community Update

Ceph Day Beijing 2015

COMMUNITY

DEV

Hammer

Modules

Orchestration / Deployment

Release Cycle

QUESTIONS

AGENDA

2

COMMUNITY

Focused on being non-disruptive

RHEL / Fedora / CentOS coverage

Maintaining Ubuntu / SUSE coverage

Co-Existing with Gluster

Bi-directional learning is fun!

LIVING IN A POST-ACQUISITION WORLD

4

CEPH DAYS

You’re here!

Turning up the heat

100% Community-focused

Upcoming

Beijing

San Jose

Los Angeles

Chicago

Austin

Melbourne

5

Hosted by Intel in Hillsboro, OR

10-13 Aug

<25 people

Real work!

Performance (Mark Nelson)

RBD focus

RGW features and integration

Spread the word!

Email [email protected]

Copyright © 2013 by Inktank | Private and Confidential

Ceph Hackathon

6

METRICS

7

Bitergia Platform

New Quarterly View

Community-driven

Good growth

Code/Tracker/IRC/Lists

Continuing to evolve

USER COMMITTEE

8

Started after Dumpling

Next chair: Wido den Hollander

Periodic meetings to discuss community matters

Most recently:

Release cadence

Contributor credits

Meetups

RADOS Gateway use cases

Discuss upcoming work

First steps towards broader governance

Google Summer of Code

9

Ceph project’s second year

6 slots, used 4

Last year

Wireshark

Reliability Model

Work published on Ceph wiki

Outreachy too

Get involved!

CentOS Storage SIG

10

Creating a collection of

packages

http://wiki.centos.org/SpecialI

nterestGroup/Storage/Proposal

Easier to deploy CentOS as a

storage node

Early days

Packages for Ceph & Gluster

Get involved!

GOVERNANCE

11

We haven’t forgotten about you!

CEPH DEVELOPER SUMMIT

12

Quarterly developer summit

100% online (Blue Jeans /

IRC)

Infernalis summit completed

Videos on Ceph YouTube

channel

Next up: Jewel (1-2 July)

Blueprints open now

DEVELOPMENT

HAMMER STATUS

14

Released 13 Apr 2015

Major Features:

cephfs: journal scavenger repair tool (John Spray)

crush: new and improved straw2 bucket type (Sage Weil, Christina Anderson, Xiaoxi Chen)

doc: improved guidance for CephFS early adopters (John Spray)

librbd: add per-image object map for improved performance (Jason Dillaman)

librbd: copy-on-read (Min Chen, Li Wang, Yunchuan Wen, Cheng Cheng)

librados: fadvise-style IO hints (Jianpeng Ma)

mds: many many snapshot-related fixes (Yan, Zheng)

mon: new ‘ceph osd df’ command (Mykola Golub)

mon: new ‘ceph pg ls …’ command (Xinxin Shu)

osd: improved performance for high-performance backends

osd: improved recovery behavior (Samuel Just)

osd: improved cache tier behavior with reads (ZhiqiangWang)

rgw: S3-compatible bucket versioning support (Yehuda Sadeh)

rgw: large bucket index sharding (Guang Yang, Yehuda Sadeh)

RDMA “xio” messenger support (Matt Benjamin, Vu

CephFS

15

Lots of hard work!

Dogfooding

Code

Src/mds: 366 commits, 19,417 lines added/removed

Src/client: 131 commits, 4289 lines

Src/tools/cephfs: 41 commits, 4179 lines

Ceph-qa-suite: 4842 added lines of FS-related python

Tracker

108 FS tickets resolved since Firefly (of which 97 were created since Firefly)

83 ticket currently open for FS, of which 35 were created since Firefly

31 feature tickets resolved

librados

16

Many more deployments/apps using direct librados

Native library for accessing RADOS

Librados.so shared library

C, C++, Python, Erlang, Haskell, PHP, Java (JNA)

Direct data path to storage nodes

Speaks native Ceph protocol with cluster

Exposes

Mutable objects

Rich per-object API and data model

Hides

Data distribution, migration, replication, failures

Making your intelligent nodes, intelligent-er!

Allows you to dynamically extend objects in RADOS

Examples

MD5 hash

Image thumbnail service

Log post-processing

Whatever you build!

Uses LUA

Ask Noah!

Copyright © 2013 by Inktank | Private and Confidential

Object Classes

17

DEPLOYMENT / ORCHESTRATION

18

Ceph-deploy in a good place

Chef / Puppet / Ansible / Salt / Juju

Docker is the up-and-comer

THANK YOU!

Patrick McGarryDir Ceph Community

[email protected]

@scuttlemonkey