dodai grizzly

Cluster as a Service: dodai

2012.10.16

Xiaohua GuanNTT DATA INTELLILINK

1

At the beginning

• etherpad http://etherpad.openstack.org/grizzly-dodai

● slideshare

2

Agenda

• dodai

• dodai-deploy

• dodai-compute

• Demo of install as a service

3

What’s dodai

• It’s CaaS(Cluster as a Service)

• dodai = dodai-deploy + dodai-compute

4

CaaS : Cluster as a Service

Server pool

Clusters for each private cloud

Allocate serversfrom server pool

Return serversto server pool

Private cloud - A Private cloud - B Private cloud - CElasticPrivateCloud

5

dodai = dodai-deploy + dodai-compute

6

What’s dodai-deploy?

• A software management tool for distributed environment

• With license Apache2• Please visit

http://github.com/nii-cloud/dodai-deploy

7

History of dodai-deploy

8

What’s the features

• It’s a Framework• It’s Fast• It’s Scalable• It’s Easy to use

9

It’s a Framework

• Provide templates for various softwares– Openstack– Hadoop– SGE– Eucalyptus

• Templates are customizable by user

• Templates can be added by user

10

It’s Fast

• Deploy parallelly in distributed environment– Considering dependencies of components

• nova-api depends on mysql server.

11

0 1 2 3 4 5 6 7 80

10

20

30

40

50

60

70

hadoop installation time

number of data node

time(second)

It’s Scalable

• dodai-deploy server can be scaled such as …

12

It’s easy to use

• Web UI•

• CLI commands– script/cli.rb SERVER RESOURCE ACTION [PARAM1 PARAM2 …]

• REST APIs– Provide REST APIs simulator in WEB UI. Enjoy it.

13

How does dodai-deploy work?

Ruby on Rails

MCollective

puppetdodai-deploy server

dodai-deploy nodes

14

More details

15

What’s new today

• Install as a Service

• Support for Multi-OSes

• Support for Folsom

16

Install as a Service

• Provide installation of softwares as a service

• No longer installation of dodai-deploy server– Global dodai-deploy server

• Add nodes belongs to user

• User defined proposals(templates)

17

Install as a Service

18

Install as a Service

19

Multi-OSes

• Support for CentOS– With same UI, but different set up scripts for dodai-deploy– setup-env.centos/setup.sh …

• Support OpenStack Essex CentOS now

20

Support for Folsom

• Folsom Release– Compute

• Nova• Horizon• Quantum• Cinder

– Glance– Keystone

21

What's the next of dodai-deploy

• Construct a global server to provide "Install as a Service"

• Provide more templates for popular softwares

• Add function to upload the template of new software

22

What’s dodai-compute?

● Bare metal version of nova(diablo)

• With license Apache2

• Please visit

http://github.com/nii-cloud/dodai-compute

23

What’s features?

• Provide the same interface with nova to operate on physical machines.

• Prepare installed machines in resource pool.

• Separate network logically with OpenFlow switch.

24

What’s inside dodai-compute

OpenFlow controllermodified nova

OpenFlow switch

cobbler

25

What’s the next of dodai-compute

• Shorten the time of installation– With kexec to bypass BIOS, shorten the time from

10'15” to 1'30”

• Provide console of physical machine to users– Implement with SOL(Serial on LAN) of IPMI

• Start machine with “Wake on LAN”

26

Demo: Install as a Service

• Construct a multiple compute nodes openstack folsom cloud on EC2– nova-compute node X 3– others X 1

• Steps– 1. register a new user– 2. create instances on EC2 and add as nodes– 3. create a proposal– 4. install– 5. test– 6. use dashboard

27

Summary

• dodai– CaaS

• dodai-deploy– http://github.com/nii/dodai-deploy– Multiple OSes supported (Ubuntu, CentOS)– Install as a Service– Folsom supported

• dodai-compute

– http://github.com/nii/dodai-compute– Bare metal version of nova– Minimize installation time with kexec– Provide console of machine to user with IPMI's SOL

28

29

Questions?

30

Thank you very much!