1 CS533 Modeling and Performance Evaluation of Network and Computer Systems Group Work
Feb 01, 2016
1
CS533Modeling and Performance Evaluation of Network and
Computer Systems
Group Work
2
Index of Central Tendency
• What Index of Central Tendency should be used to report?– Response time (symmetrical pdf)– Number of packets per day (symmetrical pdf)– Number of packets per second (skewed pdf)– Frequency of keywords in a language
• How would you summarize an average PC configuration?– CPU type– Memory size– Disk size– Number of peripherals
(Jain, 12.8 and 12.9)
3
Indices of Central Tendency and Dispersion
•CPU times (in ms) for 11 workloads0.74, 0.43, 0.24, 2.24, 262.08, 8960,
4720, 19740, 7360, 22440, 28560– What index of central tendency to use?– What index of dispersion to use?
•Disk I/O’s22, 33, 14, 15, 42, 28, 33, 45, 23, 34, 39,
21, 36, 23, 34, 36, 25, 9, 11, 19, 35, 26, 16, 23, 34, 24, 38, 15, 13, 35, 28
– What index of central tendency to use?– What index of dispersion to use?
(Jain, 12.10+12.13, 12.11+12.14)
4
Clustering (1 of 2)
Program Name Function CPU I/OTKB Linker 14 2735MAC Assembler 13
253COBOL Compiler 8 27BASIC Compiler 6 27Pascal Compiler 6 12EDT Editor 4 91SOS Editor 1 33
(Jain, 6.2, p.91)
5
Clustering (2 of 2)
Program Name Function CPU I/OTKB Linker 1 1MAC Assembler .92 .09COBOL Compiler .54 .01BASIC Compiler .38 .01Pascal Compiler .38 .00EDT Editor .23 .03SOS Editor .00 .01
(Normalized, no outliers)
6
Graphics Charts with Mistakes (1 of 7)
0
100
200
300
400
500
Time
cp
find
findgrep
grep
ls
mab
rcp
rm
(Geoff Kuenning, 1998)
7
Graphics Charts with Mistakes (2 of 7)
0
5
10
15
20
25
30
35
40
45
1 2 3 4
10
100
1000
Throughput
Response Time
(Geoff Kuenning, 1998)
8
Graphics Charts with Mistakes (3 of 7)
0
2
4
6
8
10
12
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9
w
(Geoff Kuenning, 1998)
9
Graphics Charts with Mistakes (4 of 7)
65
70
75
80
85
90
95
1st Qtr 2nd Qtr 3rd Qtr 4th Qtr
(Geoff Kuenning, 1998)
10
Graphics Charts with Mistakes (5 of 7)
0
2000
4000
6000
8000
10000
12000
1 2 3 4
(Geoff Kuenning, 1998)
11
Graphics Charts with Mistakes (6 of 7)
0
20
40
60
1st Qtr 2nd Qtr 3rd Qtr 4th Qtr
Sales ($)
Units Shipped
(Geoff Kuenning, 1998)
12
Graphics Charts with Mistakes (7 of 7)
Women in the Workforce
1960 1980
(Geoff Kuenning, 1998)
13
Sam
ple
Bad G
raph (
1 o
f 3
)
http://www6.tomshardware.com/graphic/20031229/vga-charts-09.html
(Mark Bertolina)
14
Sample Bad Graph (2 of 3)
(Luba Sakharuk)
15
Sample Bad Graph (3 of 3)
(Luba Sakharuk)
16http://ricardo.ecn.wfu.edu/SCS/Gallery/
Minard's depiction of the fate of Napoleon's army
(Eric Tsung)
Sample Good Graph (1 of 3)
17(Eric Tsung)
Sample Good Graph (2 of 3)
William Playfair’s (1759-1823) Balance of Trade.
18Florence Nightingale's Coxcomb
(Eric Tsung)
Sam
ple
Good G
raph (
3 o
f 3
)
19http://www.math.yorku.ca/SCS/Gallery/lie-factor.html
Lie factor of 14.8, 783%/53%Now the ugly!
(Eric Tsung)
20
(Lie factor of 2.8, Area is what we see.)
(Eric Tsung)
21
(Stretched axis)
(Eric Tsung)
22
Bad Graph
(Edwin Mercado)
23
(Edwin Mercado)
http://www.bsos.umd.edu/hesp/newman/Newman_classes/Newman724/graphing6.pdf
24
(Edwin Mercado)
25
(Edwin Mercado)
26
(Glenn McGuire)
HINT Results - INT
27
HINT Results - FLOAT
(Glenn McGuire)
28
HINT - Platforms Tested
•Mac – HINT exec. from
executables/serial/G3/hint_bin.sea.1.1.hqx/Hint_PPC_Double/Integer
– OS X version 10.2.8, OS 9.3 Emulation– PowerPC G4, 700 MHz, 512 MB Memory
•Linux– Compiled from source/serial/unix– Linux Redhat 9.0, cc 3.2.2– Intel Pentium 4, 1.8 GHz, 256 MB Memory,
256k L2 Cache (Eric Tsung)
29
netQUIPs
0.0E+00
5.0E+06
1.0E+07
1.5E+07
2.0E+07
2.5E+07
3.0E+07
3.5E+07
double linuxgcc 3.2.2
integer linuxgcc 3.2.2
double mac9 emulator
integer mac9 emulator
ne
tQU
IPs
(Eric Tsung)
30
Quips vs. Time Graphs
1.00E+05
1.00E+06
1.00E+07
1.E-07 1.E-06 1.E-05 1.E-04 1.E-03 1.E-02 1.E-01 1.E+00 1.E+01 1.E+02time (seconds)
Qu
ips
linux double (27.9 M NetQuips)linux integer (26.3 M NetQuips)mac9 integer (32.4 M NetQuips)mac9 double (23.2 M NetQuips)
(Eric Tsung)
31
Quips vs. Time Graph
(Yatin Manjrekar)