Top Banner
1 CS533 Modeling and Performance Evaluation of Network and Computer Systems Group Work
31

CS533 Modeling and Performance Evaluation of Network and Computer Systems

Feb 01, 2016

Download

Documents

kamin

CS533 Modeling and Performance Evaluation of Network and Computer Systems. Group Work. Index of Central Tendency. What Index of Central Tendency should be used to report? Response time (symmetrical pdf) Number of packets per day (symmetrical pdf) Number of packets per second (skewed pdf) - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: CS533 Modeling and Performance Evaluation of Network and Computer Systems

1

CS533Modeling and Performance Evaluation of Network and

Computer Systems

Group Work

Page 2: CS533 Modeling and Performance Evaluation of Network and Computer Systems

2

Index of Central Tendency

• What Index of Central Tendency should be used to report?– Response time (symmetrical pdf)– Number of packets per day (symmetrical pdf)– Number of packets per second (skewed pdf)– Frequency of keywords in a language

• How would you summarize an average PC configuration?– CPU type– Memory size– Disk size– Number of peripherals

(Jain, 12.8 and 12.9)

Page 3: CS533 Modeling and Performance Evaluation of Network and Computer Systems

3

Indices of Central Tendency and Dispersion

•CPU times (in ms) for 11 workloads0.74, 0.43, 0.24, 2.24, 262.08, 8960,

4720, 19740, 7360, 22440, 28560– What index of central tendency to use?– What index of dispersion to use?

•Disk I/O’s22, 33, 14, 15, 42, 28, 33, 45, 23, 34, 39,

21, 36, 23, 34, 36, 25, 9, 11, 19, 35, 26, 16, 23, 34, 24, 38, 15, 13, 35, 28

– What index of central tendency to use?– What index of dispersion to use?

(Jain, 12.10+12.13, 12.11+12.14)

Page 4: CS533 Modeling and Performance Evaluation of Network and Computer Systems

4

Clustering (1 of 2)

Program Name Function CPU I/OTKB Linker 14 2735MAC Assembler 13

253COBOL Compiler 8 27BASIC Compiler 6 27Pascal Compiler 6 12EDT Editor 4 91SOS Editor 1 33

(Jain, 6.2, p.91)

Page 5: CS533 Modeling and Performance Evaluation of Network and Computer Systems

5

Clustering (2 of 2)

Program Name Function CPU I/OTKB Linker 1 1MAC Assembler .92 .09COBOL Compiler .54 .01BASIC Compiler .38 .01Pascal Compiler .38 .00EDT Editor .23 .03SOS Editor .00 .01

(Normalized, no outliers)

Page 6: CS533 Modeling and Performance Evaluation of Network and Computer Systems

6

Graphics Charts with Mistakes (1 of 7)

0

100

200

300

400

500

Time

cp

find

findgrep

grep

ls

mab

rcp

rm

(Geoff Kuenning, 1998)

Page 7: CS533 Modeling and Performance Evaluation of Network and Computer Systems

7

Graphics Charts with Mistakes (2 of 7)

0

5

10

15

20

25

30

35

40

45

1 2 3 4

10

100

1000

Throughput

Response Time

(Geoff Kuenning, 1998)

Page 8: CS533 Modeling and Performance Evaluation of Network and Computer Systems

8

Graphics Charts with Mistakes (3 of 7)

0

2

4

6

8

10

12

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9

w

(Geoff Kuenning, 1998)

Page 9: CS533 Modeling and Performance Evaluation of Network and Computer Systems

9

Graphics Charts with Mistakes (4 of 7)

65

70

75

80

85

90

95

1st Qtr 2nd Qtr 3rd Qtr 4th Qtr

(Geoff Kuenning, 1998)

Page 10: CS533 Modeling and Performance Evaluation of Network and Computer Systems

10

Graphics Charts with Mistakes (5 of 7)

0

2000

4000

6000

8000

10000

12000

1 2 3 4

(Geoff Kuenning, 1998)

Page 11: CS533 Modeling and Performance Evaluation of Network and Computer Systems

11

Graphics Charts with Mistakes (6 of 7)

0

20

40

60

1st Qtr 2nd Qtr 3rd Qtr 4th Qtr

Sales ($)

Units Shipped

(Geoff Kuenning, 1998)

Page 12: CS533 Modeling and Performance Evaluation of Network and Computer Systems

12

Graphics Charts with Mistakes (7 of 7)

Women in the Workforce

1960 1980

(Geoff Kuenning, 1998)

Page 13: CS533 Modeling and Performance Evaluation of Network and Computer Systems

13

Sam

ple

Bad G

raph (

1 o

f 3

)

http://www6.tomshardware.com/graphic/20031229/vga-charts-09.html

(Mark Bertolina)

Page 14: CS533 Modeling and Performance Evaluation of Network and Computer Systems

14

Sample Bad Graph (2 of 3)

(Luba Sakharuk)

Page 15: CS533 Modeling and Performance Evaluation of Network and Computer Systems

15

Sample Bad Graph (3 of 3)

(Luba Sakharuk)

Page 16: CS533 Modeling and Performance Evaluation of Network and Computer Systems

16http://ricardo.ecn.wfu.edu/SCS/Gallery/

Minard's depiction of the fate of Napoleon's army

(Eric Tsung)

Sample Good Graph (1 of 3)

Page 17: CS533 Modeling and Performance Evaluation of Network and Computer Systems

17(Eric Tsung)

Sample Good Graph (2 of 3)

William Playfair’s (1759-1823) Balance of Trade.

Page 18: CS533 Modeling and Performance Evaluation of Network and Computer Systems

18Florence Nightingale's Coxcomb

(Eric Tsung)

Sam

ple

Good G

raph (

3 o

f 3

)

Page 19: CS533 Modeling and Performance Evaluation of Network and Computer Systems

19http://www.math.yorku.ca/SCS/Gallery/lie-factor.html

Lie factor of 14.8, 783%/53%Now the ugly!

(Eric Tsung)

Page 20: CS533 Modeling and Performance Evaluation of Network and Computer Systems

20

(Lie factor of 2.8, Area is what we see.)

(Eric Tsung)

Page 21: CS533 Modeling and Performance Evaluation of Network and Computer Systems

21

(Stretched axis)

(Eric Tsung)

Page 22: CS533 Modeling and Performance Evaluation of Network and Computer Systems

22

Bad Graph

(Edwin Mercado)

Page 23: CS533 Modeling and Performance Evaluation of Network and Computer Systems

23

(Edwin Mercado)

http://www.bsos.umd.edu/hesp/newman/Newman_classes/Newman724/graphing6.pdf

Page 24: CS533 Modeling and Performance Evaluation of Network and Computer Systems

24

(Edwin Mercado)

Page 25: CS533 Modeling and Performance Evaluation of Network and Computer Systems

25

(Edwin Mercado)

Page 26: CS533 Modeling and Performance Evaluation of Network and Computer Systems

26

(Glenn McGuire)

HINT Results - INT

Page 27: CS533 Modeling and Performance Evaluation of Network and Computer Systems

27

HINT Results - FLOAT

(Glenn McGuire)

Page 28: CS533 Modeling and Performance Evaluation of Network and Computer Systems

28

HINT - Platforms Tested

•Mac – HINT exec. from

executables/serial/G3/hint_bin.sea.1.1.hqx/Hint_PPC_Double/Integer

– OS X version 10.2.8, OS 9.3 Emulation– PowerPC G4, 700 MHz, 512 MB Memory

•Linux– Compiled from source/serial/unix– Linux Redhat 9.0, cc 3.2.2– Intel Pentium 4, 1.8 GHz, 256 MB Memory,

256k L2 Cache (Eric Tsung)

Page 29: CS533 Modeling and Performance Evaluation of Network and Computer Systems

29

netQUIPs

0.0E+00

5.0E+06

1.0E+07

1.5E+07

2.0E+07

2.5E+07

3.0E+07

3.5E+07

double linuxgcc 3.2.2

integer linuxgcc 3.2.2

double mac9 emulator

integer mac9 emulator

ne

tQU

IPs

(Eric Tsung)

Page 30: CS533 Modeling and Performance Evaluation of Network and Computer Systems

30

Quips vs. Time Graphs

1.00E+05

1.00E+06

1.00E+07

1.E-07 1.E-06 1.E-05 1.E-04 1.E-03 1.E-02 1.E-01 1.E+00 1.E+01 1.E+02time (seconds)

Qu

ips

linux double (27.9 M NetQuips)linux integer (26.3 M NetQuips)mac9 integer (32.4 M NetQuips)mac9 double (23.2 M NetQuips)

(Eric Tsung)

Page 31: CS533 Modeling and Performance Evaluation of Network and Computer Systems

31

Quips vs. Time Graph

(Yatin Manjrekar)