A Communication Relay Mechanism toward Construction of Virtual Cluster on Orverlay Network PRAGMA14 Working Group 11-12 March 2008 Yasuyuki Kusumoto Osaka.

A Communication Relay Mechanismtoward Construction of Virtual Cluster

on Orverlay Network

PRAGMA14 Working Group 　　　　

11-12 March 2008　　　

Yasuyuki Kusumoto

Osaka University, Cyber media Center

Motivation of this studyIt is difficult to unify resources on Grid and

provide a single optimum computational system with a userHeterogeneous computational environmentDisability on network connectivity, such as NAT, FW

Requirement for virtual clusterHomogeneous computational machines

⇒virtualization technology (Xen)End to end communication among nodes of virtual

clusters⇒orverlay network(P2P framework: PIAX)

・・・

・・・

siteA

siteCsiteB

os:solarislibrary:2.0.1

os:redhatlibrary:1.0.0

・・・

os:debianlibrary:1.1.2

Grid resources

FirewallNAT

Heterogeneous

Disconnectivity

Virtual cluster on overlay network(P2P)

Our approach for virtual clusterGathering computational machines on overlay networkDeployment of virtual machines on gathered machinesProviding a private network among virtual machines

goalproviding a customizable computational environment

with a user

virtual cluster

・・・

・・・

Grid resources ・・・

Overlay network

virtualization virtualization

virtual cluster

Virtual network Virtual network

A communication relay mechanism

Private network communication among virtual machinesEnd-to-end communication with IP regardless of

NAT,FW⇒Virtual private network over a P2P environment

Relaying VPN communication on orverlay networkThis mechanism:

delivers VPN packets on overlay network regardless of NAT, FW

allows virtual machines to communicate with IP each other

Overlay network

relay relay relay relay relay

Communicationrelay mechanism

Virtual machine A

Virtual machine B

Virtual machine C

Virtual machine D

Virtual machine E

The communication relay mechanism architecture

OrverlayNetworkVPN

workerApp masterApp

VirtualNICIP:10.8.0.a

VirtualNICIP:10.8.0.b

vpnclient vpnserver

PIAX PIAX

ID communication

IP communication

TunnelAgent

TunnelAgent

hostA(worker) hostB(master)

forward vpn packets by using

logical ID communication

End-to-end communication with IP

Performance evaluation of the proposed mechanism

Communication throughputmaster-worker communication

(bandwidth:100Mbps)Execution of distributed computation

applicationsDock

cpu utilization: big network utilization: smallHimeno Benchmark cpu utilization: big network utilization: big

communicationthroughput[Mbps]

App:Dockexaction time[sec]

App:HimenoBenchscore[Mflops]

Physical cluster 93.3 773 737

Virtual cluster 8.8(-90.3%) 779(-0.6%) 205(-72%)

SummaryThe proposed mechanism

provides virtual private network across multiple organizationsrealizes a virtual cluster on a P2P environment

Future worksImprovement of communication throughput

VPN hole-punching on overlay networkOn-demand construction of virtual clusters

Automatic deployment of virtual machines by utilizing data transfer functions of P2P

Collecting resources broadly by using the resource powerful searching ability of PIAX

fin

SummaryThe proposed mechanism

provides virtual private network across multiple organizationsrealizes a virtual cluster on a P2P environment

Future worksImprovement of communication throughputOn-demand construction of virtual clustersAutomatic deployment of virtual machines by

utilizing data transfer functions of P2P

Virtual cluster

Virtual cluster on overlay network(P2P)

Advantages of P2PScalability of computational resourcesResource DiscoveryNetwork connectivity(solves problem of NAT, Firewall)

GoalTo provide a customizable computational environment

(virtual cluster) with a user

virtual clustervirtual cluster

・・・

・・・

Resources of grid ・・・

Overlay network

virtualization virtualization

Requirements for communication among virtual cluster nodes

virtualization virtualization

virtualization

Virtual Cluster

Virtual Private Network

Overlay network

Private network communication among virtual machinesEnd-to-end communication with IP regardless of

NAT,FW⇒Virtual private network over a P2P environment

A communication relay mechanism

relays VPN communication on orverlay networkThis mechanism:

delivers VPN packets on overlay network regardless of NAT, FW

allows virtual machines to communicate with IP each other

Overlay network

relay relay relay relay relay

Communicationrelay mechanism

Virtual machine A

Virtual machine B

Virtual machine C

Virtual machine D

Virtual machine E

Motivation for study

Virtual cluster on orverlay network(P2P)Scalability of computational resourcesDiscovery for resources

Virtual machine (Xen)

Virtual cluster on overlay network

siteA・・・

siteB・・・

siteC・・・

Virtualization Virtualization

Virtualization

virtual clustervirtual cluster

Necessity for new communication mechanism

Virtual Private Network

Virtual Cluster

User’s job

Performance of proposed system

Communication throughputExecution of application

Dock :CPU-intensive application()

Physical cluster Virtyal cluster0

100

200

300

400

500

600

700

800

900

Exec

ute

time[

s]

Physical cluster Virtyal cluster0

10

20

30

40

50

60

70

80

90

100

thro

ughp

ut[M

bps]

・・・

siteCsiteA

・・・

siteB

・・・

Virtualization

Virtualization

Virtualization

Virtual Private Network

Virtual Cluster

User’s job

overlay network

PIAX

virtualmachine

Xen

Summary and Future work Summary

Proposed system enable computers on orverlay network to communicate using IP address

Realization for Construction of virtual cluster utilizing our proposed communication system 　

Future work

Improvement of communication throughputOn-demand construction of virtual cluster

n overlay network1/2

・・・

siteA siteCsiteB

・・・ ・・・

Virtualization Virtualization Virtualization

Virtual Private Network

Virtual Cluster

User’s job

overlay network

PIAX

virtualmachine

Xen

Virtual cluster on overlay network

siteA・・・

siteB・・・

siteC・・・

Virtualization Virtualization

Virtualization virtualmachine

Xen

overlay network

PIAX

virtual cluster

Necessity for new communication mechanism

Virtual Private Network

Virtual Cluster

User’s job

Necessity for new communication mechanism

User’s job

virtualization virtualization

virtualization

Virtual Private Network

Virtual Cluster

Overlay network

Necessity for new communication mechanism

Virtual Private Network

Virtual Cluster

virtualizationvirtualization

virtualization

Overlay network

User’s job

Virtual cluster on overlay network(P2P)

Integration of virtual machines on wide area distributed environment(P2P) Scalability of computational resourcesDiscovery for resources

Goal

virtual clustervirtual cluster

・・・

・・・

Resources of grid ・・・

Overlay network

virtualization virtualization

virtualization

Virtual network

Virtual network

・・・

・・・

Grid resources ・・・

overlay network

virtual resource

virtual cluster

virtual resource

virtual cluster