8/12/2019 Okeanos Project
1/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 1
Public IaaS Cloud @
Nectarios Koziris, GRNET
8/12/2019 Okeanos Project
2/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 2
What is Okeanos?
Okeanos is the Greek word for ocean
Oceans capture, store and deliver energy,
oxygen and life around the planet.
8/12/2019 Okeanos Project
3/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 3
Late 2010: The challenge
Goals
Production-quality IaaS cloud similar to Amazon AWS
Scalability to thousands users/nodes/VMs
Persistent VMs
Commodity components
Everyone can use it
No vendor lock-in
Low admin costs, manageable by a small team
Late 2010: The challenge
8/12/2019 Okeanos Project
4/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 4
Reviewed open source ones
Eucalyptus
Cloudstack
Opennebula
Openstack
..etc..
Stillevolving systems, silo ones (touching every layer)
No turnkey solutions
Late 2010: The available offerings
8/12/2019 Okeanos Project
5/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 5
The okeanos approach
Features: Production-quality IaaScloud
Everything open source:
Persistent VMs
Commodity Hardware No SAN, No exotic network hw
Add plain servers/disks/switches to scale up
Three clicks to start 1 or 10s of VMs, in 15 secs
Simple to operate
Ganeti
byby
Key decision: Decompose the problem into layers
8/12/2019 Okeanos Project
6/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 6
Building a Cloud, cluster by cluster
UI
API
CLOUD
CLUSTER
NODE
HYPERVISOR
SYNNEFOOPENSTACK
OPENSTACKOPENSTACK
SYNNEFO
OPENSTACK
GANETI
LIBVIRT
KVMKVM
8/12/2019 Okeanos Project
7/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 7
A small story: Why Google Ganeti?
No need to reinvent the wheel Scalable, proven software infrastructure
VM cluster management in production is serious business
Built with reliability and redundancy in mind
Combines open components (KVM, LVM, DRBD)
GRNET biggest (worldwide) external contributor to Google Ganeti
(from 2009)
http://code.google.com/p/ganeti
For more, see Running Google on Google by Jeff Bates and Iustin Pop (Google
I/O 2012- https://developers.google.com/io/)
http://code.google.com/p/ganetihttps://developers.google.com/io/https://developers.google.com/io/http://code.google.com/p/ganeti8/12/2019 Okeanos Project
8/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 8
.to scale up to tens of thousands
VMs and users?
8/12/2019 Okeanos Project
9/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 9
[email protected]|20130226
simplicity
8/12/2019 Okeanos Project
10/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 10
[email protected]|20130226
8/12/2019 Okeanos Project
11/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 11
[email protected]|20130226
flexibility
8/12/2019 Okeanos Project
12/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 12
[email protected]|20130226
8/12/2019 Okeanos Project
13/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 13
[email protected]|20130226
okeanos IaaS
Compute
Network
Storage
firewall
8/12/2019 Okeanos Project
14/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 14
1x
2x5x
8x
8/12/2019 Okeanos Project
15/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 15
8/12/2019 Okeanos Project
16/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 16
Compute Network: Cyclades
Thin Compute layer over Ganeti
- Python/Django
- Supports multiple Ganeti clusters, for scaling
- OpenStack Compute API
Networking
- No restrictions on deployment its the Ganeti side
- IPv4/IPv6 public networks, complete isolation among VMs
- Thousands of private networks, private L2 segments over single VLAN
8/12/2019 Okeanos Project
17/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 17
Virtual Machine Actions
My_windows_Desktop
Shutdown
Reboot
Start Console
Shutdown
8/12/2019 Okeanos Project
18/93
8/12/2019 Okeanos Project
19/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 19
[email protected]|20130226
Virtual Networks
Internet
Private Network 1
Private Network 2
Private Network 3
8/12/2019 Okeanos Project
20/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 20
Cyclades
8/12/2019 Okeanos Project
21/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 21
Storage:
Every file is a collection of blocks
Content-based addressing for blocks
Partial file transfers, deduplication, efficient syncing
Independent of storage backend (NFS, RADOS, )
OpenStack Object Storage API plus extensions
An integral part of Synnefo - Single store for Files, VM Images
- Uses common backend with Archipelago
8/12/2019 Okeanos Project
22/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 22
8/12/2019 Okeanos Project
23/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 23
Storage: Archipelago
Unified storage for Files, Images Volumes
Thin layer over the actual storage cluster
Storage backend agnostic
Efficient syncing / sharing of Images as files on Pithos
Zero-copy cloning of volumes from Images
8/12/2019 Okeanos Project
24/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 24
Spawn
Freeze
Images
my own Ubuntu
8/12/2019 Okeanos Project
25/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 25
Clone
Snapshot
Images Storage
Ubuntu + user data
8/12/2019 Okeanos Project
26/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 26
Images Golden Image
8/12/2019 Okeanos Project
27/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 27
See FOSDEM presentation in Brussels, Feb 2013:
INTRODUCING THE SYNNEFO OPEN SOURCE IAAS PLATFORM,
by VANGELIS KOUKIS
GRNETs opensource IaaS platform (Python)
http://www.synnefo.org
8/12/2019 Okeanos Project
28/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 28
Some Numbers (alpha phase-24.2.2012)
2100 users
2941 VMs
10119 Virtual CPUS
8/12/2019 Okeanos Project
29/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 29
5819.76 GBUsed Memory
174273.8 GBUsed Disk
7 Ganeti clusters currently
>100 fat nodes
move to > 10.000 VMs
8/12/2019 Okeanos Project
30/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 30
System OS Images
Windows Server 2012
Windows Server 2008R2
CentOS 6.3
Fedora 17
Ubuntu 12.04 LTS Kubuntu 12.04 LTS
Ubuntu 12.10
Kubuntu 12.10
Debian Desktop Squeeze
Debian Base Squeeze
.more
8/12/2019 Okeanos Project
31/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 31
0
500
1000
1500
2000
2500
3000
Cyclades VMs
VMs
8/12/2019 Okeanos Project
32/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 32
main Datacenter (40 racks)
green architecture PUE
8/12/2019 Okeanos Project
33/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 33
Cloud Facilities (cont.)
Disaster Recovery DC (@procurement stage) Container based solution
Louros river hydroelectric plant area
Up to 320KW
Low PUE (
8/12/2019 Okeanos Project
34/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 34
8/12/2019 Okeanos Project
35/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 35
8/12/2019 Okeanos Project
36/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 36
Design Specs for a Public Cloud
ProviderCommon denominator:
#VM instances (in various VM flavors)
Guaranteed ratios:
VMs/Core, RAM/Core, disks(spindle)/core
/VM?
8/12/2019 Okeanos Project
37/93
Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 37
See more on http://okeanos.grnet.gr
GO http://okeanos.io for a quick tryout!
The project is co-financed by Greece and the European Union
@grnet_gr #okeanos
8/12/2019 Okeanos Project
38/93
8/12/2019 Okeanos Project
39/93
8/12/2019 Okeanos Project
40/93
8/12/2019 Okeanos Project
41/93
8/12/2019 Okeanos Project
42/93
8/12/2019 Okeanos Project
43/93
8/12/2019 Okeanos Project
44/93
8/12/2019 Okeanos Project
45/93
8/12/2019 Okeanos Project
46/93
8/12/2019 Okeanos Project
47/93
8/12/2019 Okeanos Project
48/93
8/12/2019 Okeanos Project
49/93
8/12/2019 Okeanos Project
50/93
8/12/2019 Okeanos Project
51/93
8/12/2019 Okeanos Project
52/93
8/12/2019 Okeanos Project
53/93
8/12/2019 Okeanos Project
54/93
8/12/2019 Okeanos Project
55/93
8/12/2019 Okeanos Project
56/93
8/12/2019 Okeanos Project
57/93
8/12/2019 Okeanos Project
58/93
8/12/2019 Okeanos Project
59/93
8/12/2019 Okeanos Project
60/93
8/12/2019 Okeanos Project
61/93
8/12/2019 Okeanos Project
62/93
8/12/2019 Okeanos Project
63/93
8/12/2019 Okeanos Project
64/93
8/12/2019 Okeanos Project
65/93
8/12/2019 Okeanos Project
66/93
8/12/2019 Okeanos Project
67/93
8/12/2019 Okeanos Project
68/93
8/12/2019 Okeanos Project
69/93
8/12/2019 Okeanos Project
70/93
8/12/2019 Okeanos Project
71/93
8/12/2019 Okeanos Project
72/93
8/12/2019 Okeanos Project
73/93
8/12/2019 Okeanos Project
74/93
8/12/2019 Okeanos Project
75/93
8/12/2019 Okeanos Project
76/93
8/12/2019 Okeanos Project
77/93
8/12/2019 Okeanos Project
78/93
8/12/2019 Okeanos Project
79/93
8/12/2019 Okeanos Project
80/93
8/12/2019 Okeanos Project
81/93
8/12/2019 Okeanos Project
82/93
8/12/2019 Okeanos Project
83/93
8/12/2019 Okeanos Project
84/93
8/12/2019 Okeanos Project
85/93
8/12/2019 Okeanos Project
86/93
8/12/2019 Okeanos Project
87/93
8/12/2019 Okeanos Project
88/93
8/12/2019 Okeanos Project
89/93
8/12/2019 Okeanos Project
90/93
8/12/2019 Okeanos Project
91/93
8/12/2019 Okeanos Project
92/93
8/12/2019 Okeanos Project
93/93