Top Banner
Community Network Cloud Middleware Supervisor Leandro Navarro [email protected] “A Storage Approach” Students Antonio Severien [email protected] Ioanna Tsalochidou [email protected]
24

Community cloud antonioseverien

Nov 29, 2014

Download

Technology

Community networks are a reality and provide and interesting heterogeneous environment for testing projects for the future internet. The CONFINE project aims to create a testbed on such environment, thus this study aims to evaluate the viability of providing cloud services on community networks by experimenting with different cloud middleware.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Community cloud antonioseverien

Community  Network    Cloud  Middleware  

Supervisor  Leandro  Navarro  [email protected]  

   

“A  Storage  Approach”  

Students  Antonio  Severien  

[email protected]    

Ioanna  Tsalochidou  [email protected]    

     

Page 2: Community cloud antonioseverien

Outline  

•  IntroducCon  •  Cloud  Middleware  •  ObjecCves  •  OpenStack  •  Experimental  Setup  •  Results  •  Future  Work  •  Findings  •  Summary  06/12/12   2  

Page 3: Community cloud antonioseverien

IntroducCon  

•  Community  Networks  Testbed  for  the  Future  Internet  –  Commodity  wireless  and  opCcal  links;  heterogeneous  nodes;  different  

rouCng  protocols;  different  applicaCons  

•  Cloud  middleware  running  on  “wild-­‐area”  resources  –   OpenStack,  OpenNebula  –   Evaluate  scalability  and  “suitability”  to  provide  either;  compu.ng  or  

storage  services  

06/12/12   3  

Page 4: Community cloud antonioseverien

Cloud  Middleware  

•  Cloud  OperaCng  System  –  Controls  large  pools  of  compute,  networking  and  storage  resources  throughout  a  datacenter  

Your  ApplicaCons  

Cl  

Standard  Hardware  

Cloud  OperaCng    System  

Storage  Networking  Compute  Management  

GUI  

06/12/12   4  

Page 5: Community cloud antonioseverien

ObjecCves  •  Observe  how  the  different  cloud  middlewares  behave    –  On  unstable  network  environment    –  On  scarce  hardware  resources    

•  Create  a  methodology  to  be  used  on  CONFINE    

•  Preliminary  benchmarking    •  TesCng  –  Inject  delays  on  network  (Netem)  – Measure  performance  (FileBench)  

06/12/12   5  

Page 6: Community cloud antonioseverien

OpenStack  Conceptual  Architecture  

Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐conceptual-­‐arch-­‐folsom.jpg    06/12/12   6  

Page 7: Community cloud antonioseverien

OpenStack  Logical  Architecture  

Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐logical-­‐arch-­‐folsom.jpg    06/12/12   7  

Page 8: Community cloud antonioseverien

OpenStack  Logical  Architecture  

Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐logical-­‐arch-­‐folsom.jpg    06/12/12   8  

Page 9: Community cloud antonioseverien

OpenStack  Storage  

Storage  Services  –  Block  Storage  (Cinder)  à  nova-­‐volume  (iSCSI/LVM)  

•  Uses  LVM  to  create  and  manage  volumes,  and  exports  them  via  iSCSI    

– Object  Storage  (Swif)  •  Low  level  of  abstracCon  •  Good  for  staCc  content  (e.g.,  CDN)  •  HTTP  interface  with  REST  API  

–  File  Storage      •  “none  na.ve  support”  (There  is  a  connector  for  GlusterFS)  

 06/12/12   9  

Page 10: Community cloud antonioseverien

Cinder  (Nova-­‐volume)  

Instance  

Volume  

Instance   A  volume  can  be    a`ached/detached    from  running  instances  

Block  Storage  Store  

06/12/12   10  

Page 11: Community cloud antonioseverien

Cinder  (Block  Storage)  

Block  Storage   Block  Storage   Block  Storage  

Compute  

Volume  Store  

Instance  

06/12/12   11  

Page 12: Community cloud antonioseverien

Cinder  (Block  Storage)  

Block  Storage   Block  Storage   Block  Storage  

Compute  

Volume  Store  

Instance  

06/12/12   12  

Page 13: Community cloud antonioseverien

Running  Compute  Node  

Figures  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/images-­‐and-­‐instances.html    

06/12/12   13  

Page 14: Community cloud antonioseverien

Experimental  Setup  

•  FileBench  Workload  Generator  –  File  system  and  storage  benchmark  –  Variety  of  workloads  and  pre-­‐defined  workloads  for  webserver,  file  server,  etc.  

–  Reports  throughput  and  latency  –  Uses  Workload  Model  Language  (WML)  

Cinder  Volume  Store  

Nova  Compute  &  Controller  

06/12/12   14  

Page 15: Community cloud antonioseverien

Experimental  Setup  

1.  Off-­‐line  creaCon  of  volumes  2.  At-­‐runCme  a`achment  of  volumes  to  instances  hosted  within    

the  same  availability  zones  3.  Formakng  mounted  volumes  with  ext3  file  system  4. MounCng  the  forma`ed  volume  as  a  file  system  within  a  Linux    

instance  5.  Subsequent  benchmarking…  

Steps  for  experiments:  

06/12/12   15  

Page 16: Community cloud antonioseverien

Experiment  Results  Read  Experiments  

 File  Size:  3GB    IO  Size:  1MB      Threads:  1    Caching:  disabled  

   

06/12/12   16  

Page 17: Community cloud antonioseverien

Experiment  Results  Write  Experiments  

 File  Size:  3GB    IO  Size:  1MB      Threads:  1    Caching:  disabled  

06/12/12   17  

Page 18: Community cloud antonioseverien

Future  Work  

•  Use  OpenNebula  and  perform  the  same  experiments  •  Expand  this  work  to  run  on  a  larger  scale  •  Use  CONFINE  testbed  for  experiments  

06/12/12   18  

Page 19: Community cloud antonioseverien

Future  Work  (Real  Deal)  

06/12/12   19  

Page 20: Community cloud antonioseverien

Summary  

•  Cloud  Middleware:  nothing  but  a  resource  manager  •  Deployed  OpenStack  in  a  micro  test-­‐environment  

•  Benchmarking:  diverse  workloads  

•  Community  Cloud…  it  is  possible,  but  with  restricCons  bounded  by  available  resources  

06/12/12   20  

Page 21: Community cloud antonioseverien

Findings  

•  OpenStack  –  Is  evolving  –  Needs  to  be  more  user-­‐friendly  –  Dynamic  configuraCon    

•  Community  Cloud  –  Provide  services  that  require  less  resources  –  “Guarantee”  stability  and  availability  of  resources  

06/12/12   21  

Page 22: Community cloud antonioseverien

Acknowledgments  

•  Thanks  to  Leandro  Navarro  •  Thanks  to  Ying  for  clearing  the  clouds  from  the  cloud  •  Thanks  to  Manos  and  Mudit  for  networking  assistance  

•  Thanks  to  Ioanna  for  accepCng  the  challenge    •  Thanks  to  the  OpenStack  community  •  Thanks  to  the  Linux  community  

06/12/12   22  

Page 23: Community cloud antonioseverien

References  •  OpenStack:  h`p://www.openstack.org  •  Ubuntu  Cloud:  h`p://www.ubuntu.com/cloud    •  OpenNebula:  h`p://opennebula.org/  •  DevStack:  h`p://devstack.org/  •  CONFINE:  h`p://confine-­‐project.eu/  •  FileBench:  h`p://sourceforge.net/apps/mediawiki/filebench/    •  Netem:  

h`p://www.linuxfoundaCon.org/collaborate/workgroups/networking/netem    

06/12/12   23  

Page 24: Community cloud antonioseverien