Community Network Cloud Middleware Supervisor Leandro Navarro [email protected] “A Storage Approach” Students Antonio Severien [email protected] Ioanna Tsalochidou [email protected]
Nov 29, 2014
Community Network Cloud Middleware
Supervisor Leandro Navarro [email protected]
“A Storage Approach”
Students Antonio Severien
Ioanna Tsalochidou [email protected]
Outline
• IntroducCon • Cloud Middleware • ObjecCves • OpenStack • Experimental Setup • Results • Future Work • Findings • Summary 06/12/12 2
IntroducCon
• Community Networks Testbed for the Future Internet – Commodity wireless and opCcal links; heterogeneous nodes; different
rouCng protocols; different applicaCons
• Cloud middleware running on “wild-‐area” resources – OpenStack, OpenNebula – Evaluate scalability and “suitability” to provide either; compu.ng or
storage services
06/12/12 3
Cloud Middleware
• Cloud OperaCng System – Controls large pools of compute, networking and storage resources throughout a datacenter
Your ApplicaCons
Cl
Standard Hardware
Cloud OperaCng System
Storage Networking Compute Management
GUI
06/12/12 4
ObjecCves • Observe how the different cloud middlewares behave – On unstable network environment – On scarce hardware resources
• Create a methodology to be used on CONFINE
• Preliminary benchmarking • TesCng – Inject delays on network (Netem) – Measure performance (FileBench)
06/12/12 5
OpenStack Conceptual Architecture
Figure taken from h`p://docs.openstack.org/folsom/openstack-‐compute/admin/content/figures/openstack-‐conceptual-‐arch-‐folsom.jpg 06/12/12 6
OpenStack Logical Architecture
Figure taken from h`p://docs.openstack.org/folsom/openstack-‐compute/admin/content/figures/openstack-‐logical-‐arch-‐folsom.jpg 06/12/12 7
OpenStack Logical Architecture
Figure taken from h`p://docs.openstack.org/folsom/openstack-‐compute/admin/content/figures/openstack-‐logical-‐arch-‐folsom.jpg 06/12/12 8
OpenStack Storage
Storage Services – Block Storage (Cinder) à nova-‐volume (iSCSI/LVM)
• Uses LVM to create and manage volumes, and exports them via iSCSI
– Object Storage (Swif) • Low level of abstracCon • Good for staCc content (e.g., CDN) • HTTP interface with REST API
– File Storage • “none na.ve support” (There is a connector for GlusterFS)
06/12/12 9
Cinder (Nova-‐volume)
Instance
Volume
Instance A volume can be a`ached/detached from running instances
Block Storage Store
06/12/12 10
Cinder (Block Storage)
Block Storage Block Storage Block Storage
Compute
Volume Store
Instance
06/12/12 11
Cinder (Block Storage)
Block Storage Block Storage Block Storage
Compute
Volume Store
Instance
06/12/12 12
Running Compute Node
Figures taken from h`p://docs.openstack.org/folsom/openstack-‐compute/admin/content/images-‐and-‐instances.html
06/12/12 13
Experimental Setup
• FileBench Workload Generator – File system and storage benchmark – Variety of workloads and pre-‐defined workloads for webserver, file server, etc.
– Reports throughput and latency – Uses Workload Model Language (WML)
Cinder Volume Store
Nova Compute & Controller
06/12/12 14
Experimental Setup
1. Off-‐line creaCon of volumes 2. At-‐runCme a`achment of volumes to instances hosted within
the same availability zones 3. Formakng mounted volumes with ext3 file system 4. MounCng the forma`ed volume as a file system within a Linux
instance 5. Subsequent benchmarking…
Steps for experiments:
06/12/12 15
Experiment Results Read Experiments
File Size: 3GB IO Size: 1MB Threads: 1 Caching: disabled
06/12/12 16
Experiment Results Write Experiments
File Size: 3GB IO Size: 1MB Threads: 1 Caching: disabled
06/12/12 17
Future Work
• Use OpenNebula and perform the same experiments • Expand this work to run on a larger scale • Use CONFINE testbed for experiments
06/12/12 18
Future Work (Real Deal)
06/12/12 19
Summary
• Cloud Middleware: nothing but a resource manager • Deployed OpenStack in a micro test-‐environment
• Benchmarking: diverse workloads
• Community Cloud… it is possible, but with restricCons bounded by available resources
06/12/12 20
Findings
• OpenStack – Is evolving – Needs to be more user-‐friendly – Dynamic configuraCon
• Community Cloud – Provide services that require less resources – “Guarantee” stability and availability of resources
06/12/12 21
Acknowledgments
• Thanks to Leandro Navarro • Thanks to Ying for clearing the clouds from the cloud • Thanks to Manos and Mudit for networking assistance
• Thanks to Ioanna for accepCng the challenge • Thanks to the OpenStack community • Thanks to the Linux community
06/12/12 22
References • OpenStack: h`p://www.openstack.org • Ubuntu Cloud: h`p://www.ubuntu.com/cloud • OpenNebula: h`p://opennebula.org/ • DevStack: h`p://devstack.org/ • CONFINE: h`p://confine-‐project.eu/ • FileBench: h`p://sourceforge.net/apps/mediawiki/filebench/ • Netem:
h`p://www.linuxfoundaCon.org/collaborate/workgroups/networking/netem
06/12/12 23