CS533 Modeling and Performance Evaluation of Network and Computer Systems

1

CS533Modeling and Performance Evaluation of Network and

Computer Systems

Group Work

2

Index of Central Tendency

• What Index of Central Tendency should be used to report?– Response time (symmetrical pdf)– Number of packets per day (symmetrical pdf)– Number of packets per second (skewed pdf)– Frequency of keywords in a language

• How would you summarize an average PC configuration?– CPU type– Memory size– Disk size– Number of peripherals

(Jain, 12.8 and 12.9)

3

Indices of Central Tendency and Dispersion

•CPU times (in ms) for 11 workloads0.74, 0.43, 0.24, 2.24, 262.08, 8960,

4720, 19740, 7360, 22440, 28560– What index of central tendency to use?– What index of dispersion to use?

•Disk I/O’s22, 33, 14, 15, 42, 28, 33, 45, 23, 34, 39,

21, 36, 23, 34, 36, 25, 9, 11, 19, 35, 26, 16, 23, 34, 24, 38, 15, 13, 35, 28

– What index of central tendency to use?– What index of dispersion to use?

(Jain, 12.10+12.13, 12.11+12.14)

4

Clustering (1 of 2)

Program Name Function CPU I/OTKB Linker 14 2735MAC Assembler 13

253COBOL Compiler 8 27BASIC Compiler 6 27Pascal Compiler 6 12EDT Editor 4 91SOS Editor 1 33

(Jain, 6.2, p.91)

5

Clustering (2 of 2)

Program Name Function CPU I/OTKB Linker 1 1MAC Assembler .92 .09COBOL Compiler .54 .01BASIC Compiler .38 .01Pascal Compiler .38 .00EDT Editor .23 .03SOS Editor .00 .01

(Normalized, no outliers)

6

Graphics Charts with Mistakes (1 of 7)

0

100

200

300

400

500

Time

cp

find

findgrep

grep

ls

mab

rcp

rm

(Geoff Kuenning, 1998)

7

Graphics Charts with Mistakes (2 of 7)

0

5

10

15

20

25

30

35

40

45

1 2 3 4

10

100

1000

Throughput

Response Time

(Geoff Kuenning, 1998)

8

Graphics Charts with Mistakes (3 of 7)

0

2

4

6

8

10

12

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9

w

(Geoff Kuenning, 1998)

9

Graphics Charts with Mistakes (4 of 7)

65

70

75

80

85

90

95

1st Qtr 2nd Qtr 3rd Qtr 4th Qtr

(Geoff Kuenning, 1998)

10

Graphics Charts with Mistakes (5 of 7)

0

2000

4000

6000

8000

10000

12000

1 2 3 4

(Geoff Kuenning, 1998)

11

Graphics Charts with Mistakes (6 of 7)

0

20

40

60

1st Qtr 2nd Qtr 3rd Qtr 4th Qtr

Sales ($)

Units Shipped

(Geoff Kuenning, 1998)

12

Graphics Charts with Mistakes (7 of 7)

Women in the Workforce

1960 1980

(Geoff Kuenning, 1998)

13

Sam

ple

Bad G

raph (

1 o

f 3

)

http://www6.tomshardware.com/graphic/20031229/vga-charts-09.html

(Mark Bertolina)

14

Sample Bad Graph (2 of 3)

(Luba Sakharuk)

15

Sample Bad Graph (3 of 3)

(Luba Sakharuk)

16http://ricardo.ecn.wfu.edu/SCS/Gallery/

Minard's depiction of the fate of Napoleon's army

(Eric Tsung)

Sample Good Graph (1 of 3)

17(Eric Tsung)

Sample Good Graph (2 of 3)

William Playfair’s (1759-1823) Balance of Trade.

18Florence Nightingale's Coxcomb

(Eric Tsung)

Sam

ple

Good G

raph (

3 o

f 3

)

19http://www.math.yorku.ca/SCS/Gallery/lie-factor.html

Lie factor of 14.8, 783%/53%Now the ugly!

(Eric Tsung)

20

(Lie factor of 2.8, Area is what we see.)

(Eric Tsung)

21

(Stretched axis)

(Eric Tsung)

22

Bad Graph

(Edwin Mercado)

23

(Edwin Mercado)

http://www.bsos.umd.edu/hesp/newman/Newman_classes/Newman724/graphing6.pdf

24

(Edwin Mercado)

25

(Edwin Mercado)

26

(Glenn McGuire)

HINT Results - INT

27

HINT Results - FLOAT

(Glenn McGuire)

28

HINT - Platforms Tested

•Mac – HINT exec. from

executables/serial/G3/hint_bin.sea.1.1.hqx/Hint_PPC_Double/Integer

– OS X version 10.2.8, OS 9.3 Emulation– PowerPC G4, 700 MHz, 512 MB Memory

•Linux– Compiled from source/serial/unix– Linux Redhat 9.0, cc 3.2.2– Intel Pentium 4, 1.8 GHz, 256 MB Memory,

256k L2 Cache (Eric Tsung)

29

netQUIPs

0.0E+00

5.0E+06

1.0E+07

1.5E+07

2.0E+07

2.5E+07

3.0E+07

3.5E+07

double linuxgcc 3.2.2

integer linuxgcc 3.2.2

double mac9 emulator

integer mac9 emulator

ne

tQU

IPs

(Eric Tsung)

30

Quips vs. Time Graphs

1.00E+05

1.00E+06

1.00E+07

1.E-07 1.E-06 1.E-05 1.E-04 1.E-03 1.E-02 1.E-01 1.E+00 1.E+01 1.E+02time (seconds)

Qu

ips

linux double (27.9 M NetQuips)linux integer (26.3 M NetQuips)mac9 integer (32.4 M NetQuips)mac9 double (23.2 M NetQuips)

(Eric Tsung)

31

Quips vs. Time Graph

(Yatin Manjrekar)