Top Banner
Xen past, present and future Stefano Stabellini
37

ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Oct 29, 2018

Download

Documents

duongtram
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xen

pa

st, p

rese

nt a

nd

fu

ture

Ste

fan

o S

tab

ell

ini

Page 2: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xe

n a

rch

itectu

re:

PV

do

main

s

Page 3: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xe

n a

rch

: d

river

do

main

s

Page 4: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xen

: ad

van

tag

es

- sm

all

su

rfa

ce

of atta

ck

- is

ola

tio

n

- re

sili

en

ce

- sp

ecia

lized

alg

orith

ms (

sch

ed

ule

r)

Page 5: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xe

n a

nd

th

e L

inu

x k

ern

el

Xen

wa

s in

itia

lly a

un

ivers

ity r

esea

rch

pro

ject

invasiv

e c

ha

ng

es to th

e k

ern

el to

ru

n L

inu

x a

s a

P

V g

ue

st

eve

n m

ore

ch

ang

es to

ru

n L

inux a

s d

om

0

Page 6: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xe

n a

nd

th

e L

inu

x k

ern

el

Xe

n s

up

po

rt in

th

e L

inu

x k

ern

el n

ot u

pstr

ea

m

Gre

at m

ain

tance

effo

rt o

n d

istr

ibu

tio

ns

Ris

k o

f d

istr

ibutio

ns d

rop

pin

g X

en

su

ppo

rt

Page 7: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xe

n a

nd

th

e L

inu

x k

ern

el

- P

V s

up

po

rt w

en

t in

Lin

ux 2

.6.2

6

- b

asic

Do

m0

su

pp

ort

wen

t in

Lin

ux 2

.6.3

7

- N

etb

ack w

en

t in

Lin

ux 2

.6.3

9

- B

lkba

ck w

en

t in

Lin

ux 3

.0.0

A s

ing

le 3

.0.0

Lin

ux k

ern

el im

ag

e b

oo

ts o

n n

ative,

on

Xe

n a

s d

om

U, a

s d

om

0 a

nd P

V o

n H

VM

gue

st

Page 8: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xe

n a

nd

Lin

ux d

istr

ibu

tio

ns

2010

- F

ed

ora

an

d U

bun

tu d

rop

pe

d X

en

sup

po

rt fro

m

th

eir L

inux k

ern

els

- D

eb

ian

, S

use

, G

ento

o s

till

pro

vid

e X

en

kern

els

- X

en

Se

rver

we

nt O

pe

n S

ou

rce w

ith

XC

P

Pre

sent

- F

ed

ora

an

d U

bun

tu a

re a

dd

ing

Xe

n s

up

port

b

ack in

ke

rne

l in

the

ne

xt re

lea

se

s

Page 9: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xen

arc

hit

ectu

re:

HV

M d

om

ain

s

Page 10: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xe

n a

rch

itectu

re:

stu

bd

om

s

Page 11: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Xen

an

d Q

em

u

- in

itia

lly fo

rked

in

20

05

- u

pd

ate

d o

nce

eve

ry fe

w r

ele

ases

- X

en

su

pp

ort

we

nt in

up

str

ea

m Q

em

u a

t th

e

b

eg

inn

ing

of 2

011

- U

pstr

ea

m Q

em

u is g

oin

g to b

e u

se

d a

s d

evic

e

m

ode

l w

ith

Xe

n 4

.2

Page 12: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Ne

w d

ev

elo

pm

en

ts:

Lib

xen

lig

ht

Mu

ltip

le to

ols

tacks:

- X

en

d, X

api, X

en

VM

, Lib

Virt, …

- co

de

dup

licatio

ns, in

effic

ien

cie

s, b

ug

s, w

aste

d

effo

rts

Xen

d:

- d

ifficu

lt to

un

de

rsta

nd

, m

od

ify a

nd e

xte

nd

- sig

nific

an

t m

em

ory

fo

otp

rint

Page 13: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Lib

xen

lig

ht

Wh

at is

Lib

xe

nlig

ht:

- a

sm

all

low

er

leve

l lib

rary

in C

- sim

ple

to u

nd

ers

tan

d

- e

asy to m

od

ify a

nd

exte

nd

Goa

ls:

- p

rovid

e a

sim

ple

an

d r

obu

st A

PI fo

r to

ols

tacks

- cre

ate

a c

om

mon

cod

eb

ase

to

do

Xe

n

o

pera

tio

ns

Page 14: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

XL

- th

e u

nit te

stin

g to

ol fo

r lib

xen

ligh

t

- fe

atu

re c

om

ple

te

- a

min

ima

l to

ols

tack

- co

mp

atib

le w

ith

xm

Do

mo

re w

ith

le

ss!

Page 15: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

XL

: d

esig

n p

rin

cip

les

- sm

alle

st p

ossib

le to

ols

tack o

n to

p o

f lib

xe

nlig

ht

- sta

tele

ss C

LI →

XL

→ lib

xe

nlig

ht →

EX

IT

Page 16: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

XL

vs. X

en

d

XL: p

ros

- ve

ry s

ma

ll a

nd e

asy to

re

ad

- w

ell

teste

d

- co

mp

atib

le w

ith

xm

Xen

d: p

ros

- p

rovid

e X

ML

RP

C in

terf

ace

- p

rovid

e ”

ma

nag

ed

do

ma

ins”

Page 17: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Lib

xe

nlig

ht:

th

e n

ew

wo

rld

Page 18: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Lin

ux P

V o

n H

VM

pa

ravirtu

aliz

ed

inte

rface

s in

HV

M g

ue

sts

Page 19: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Lin

ux a

s a

gu

ests

: p

rob

lem

s

Lin

ux P

V g

ue

sts

ha

ve

lim

itatio

ns:

- d

ifficu

lt “

diffe

rent”

to

in

sta

ll

- lim

ite

d s

et of virtu

al h

ard

wa

re

Lin

ux H

VM

gu

ests

:

- in

sta

ll th

e s

am

e w

ay a

s n

ative

- ve

ry s

low

Page 20: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Lin

ux

PV

on

HV

M:

the s

olu

tio

n

- in

sta

ll th

e s

am

e w

ay a

s n

ative

- P

C-lik

e h

ard

wa

re

- a

ccess to fa

st p

ara

virtu

aliz

ed

de

vic

es

- e

xp

loit n

este

d p

ag

ing

Page 21: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Lin

ux P

V o

n H

VM

: in

itia

l fe

ats

Initia

l ve

rsio

n in

Lin

ux 2

.6.3

6:

- in

trod

uce th

e x

en

pla

tform

de

vic

e d

rive

r

- a

dd

su

pp

ort

fo

r H

VM

hyp

erc

alls

, xe

nb

us a

nd

g

ran

t ta

ble

- e

na

ble

s b

lkfr

on

t, n

etf

ron

t an

d P

V t

ime

rs

- a

dd

su

pp

ort

to

PV

su

spe

nd

/re

su

me

- th

e v

ec

tor

callb

ack

me

ch

anis

m

Page 22: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Old

sty

le e

ven

t in

jecti

on

Page 23: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Rec

eiv

ing

an

in

terr

up

t

do_

IRQ ha

nd

le_

faste

oi_

irq

ha

nd

le_irq

_e

ve

nt

xe

n_

evtc

hn

_d

o_

up

ca

ll

ac

k_

ap

ic_

leve

l←

>=

3 V

ME

XIT

Page 24: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Th

e n

ew

vecto

r callb

ack

Page 25: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Re

ce

ivin

g a

vecto

r callb

ack

xe

n_

evtc

hn

_d

o_

upca

ll

Page 26: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Lin

ux

PV

on

HV

M:

new

er

feats

Late

r e

nh

ance

me

nts

(2

.6.3

7+

):

- b

allo

on

ing

- P

V s

pin

locks

- P

V IP

Is

- In

terr

up

t re

ma

pp

ing

onto

even

t ch

an

nels

- M

SI re

ma

ppin

g o

nto

eve

nt ch

an

ne

ls

Page 27: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Inte

rru

pt

rem

ap

pin

g

Page 28: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

MS

I re

map

pin

g

Page 29: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

PV

sp

ectr

um

HV

M g

uests

Cla

ssic

PV

on H

VM

Enhanced

PV

on H

VM

Hybrid P

V

on H

VM

P

V g

uests

Bo

ot

se

quen

ce

em

ula

ted

em

ula

ted

em

ula

ted

para

virtu

aliz

ed

Mem

ory

hard

ware

hard

ware

hard

ware

para

virtu

aliz

ed

Inte

rrupts

em

ula

ted

em

ula

ted

para

virtu

aliz

ed

para

virtu

aliz

ed

Tim

ers

em

ula

ted

em

ula

ted

para

virtu

aliz

ed

para

virtu

aliz

ed

Sp

inlo

cks

em

ula

ted

em

ula

ted

para

virtu

aliz

ed

para

virtu

aliz

ed

Dis

kem

ula

ted

para

virtu

aliz

ed

para

virtu

aliz

ed

para

virtu

aliz

ed

Netw

ork

em

ula

ted

para

virtu

aliz

ed

para

virtu

aliz

ed

para

virtu

aliz

ed

Privile

ged

opera

tio

ns

hard

ware

hard

ware

hard

ware

para

virtu

aliz

ed

Page 30: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Be

nch

mark

s:

the s

etu

p

Ha

rdw

are

se

tup

:

Dell

Pow

erE

dg

e R

710

CP

U: du

al In

tel X

eon E

5520 q

uad

core

CP

Us @

2.2

7G

Hz

RA

M: 22G

B

So

ftw

are

se

tup:

Xen

4.1

, 64 b

itD

om

0 L

inux 2

.6.3

2,

64 b

itD

om

U L

inux 3

.0 r

c4, 8

GB

of m

em

ory

, 8

vcpus

Page 31: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

PC

I p

as

sth

rou

gh

: b

en

ch

mark

PC

I p

assth

roug

h o

f a

n I

nte

l G

igab

it N

ICC

PU

usa

ge

: th

e lo

we

r th

e b

ette

r:

inte

rru

pt re

ma

pp

ing

no

in

terr

up

t re

ma

pp

ing

0

20

40

60

80

10

0

12

0

14

0

16

0

18

0

20

0

CP

U u

sa

ge

do

mU

CP

U u

sa

ge

do

m0

Page 32: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Kern

ben

ch

Results:

perc

enta

ge

of n

ative, th

e low

er

the

bett

er

PV

on

HV

M 6

4 b

itP

V o

n H

VM

32

bit

HV

M 6

4 b

itH

VM

32

bit

PV

64

bit

PV

32

bit

90

95

10

0

10

5

11

0

11

5

12

0

12

5

13

0

13

5

14

0

Page 33: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

PB

ZIP

2

Resu

lts: pe

rce

nta

ge

of n

ative

, th

e lo

we

r th

e b

ette

r

PV

on

HV

M 6

4 b

itP

V 6

4 b

itP

V o

n H

VM

32

bit

PV

32

bit

10

0

11

0

12

0

13

0

14

0

15

0

16

0

Page 34: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

SP

EC

jbb

2005

PV

64

bit

PV

on

HV

M 6

4 b

it0

10

20

30

40

50

60

70

80

90

10

0Re

sults:

perc

enta

ge o

f n

ative,

the

hig

he

r th

e b

ett

er

Page 35: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Iperf

tcp

Resu

lts: gb

it/s

ec,

the h

ighe

r th

e b

ett

er

PV

64

bit

PV

on

HV

M 6

4 b

itP

V o

n H

VM

32

bit

PV

32

bit

HV

M 6

4 b

itH

VM

32

bit

012345678

Page 36: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Co

nclu

sio

ns

PV

on

HV

M g

ue

sts

are

ve

ry c

lose

to

PV

gu

ests

in

be

nch

ma

rks th

at fa

vo

r P

V M

MU

s

PV

on

HV

M g

ue

sts

are

fa

r ah

ea

d o

f P

V g

ue

sts

in

be

nch

ma

rks th

at fa

vo

r n

este

d p

ag

ing

Page 37: ure - UCSB Computer Science Departmentrich/class/cs293b-cloud/papers/xen... · ing s s els ls. g. g. m s ssic M nced M M s nce ed ed ed ed ry are are are ed s ed ed zed ed rs ed ed

Qu

esti

on

s?