CHEP KOREN-NOC Iperf TestRTT: ~2msBDP=0.002*1000Mbps=0.25MBMax
throughput: 920MbpsThroughput of five streams: 916Mbps
KORENKNUKOREN-NOC1 GCHEP1 GGigabitEthernet3/1 -- KOREN
Chart1
256 KB345
512 KB682
1 MB918
2 MB921
3 MB922
4 MB921
TCP Window Size
Achievable bandwidth in Mbps
KNU-> KOREN-NOC (Single Stream)
KNU->SNU
KNU (sul.knu.ac.kr)->SNU(147.46.222.194)
sul.knu.ac.kr
OS: Linux 7.3
eth0: Intel(R) PRO/1000 Network Connection
e1000: eth0 NIC Link is Up 1000 Mbps Full Duplex
CPU: Dual AMD Athlon(tm) MP 2000+, 1.7GHz
147.46.222.194
OS: Linux 8.0
eth0: Intel(R) PRO/1000 Network Connection
e1000: eth0 NIC Link is Up 1000 Mbps Full Duplex
CPU: Dual Pentium III(Coppermine), 551MHz each
Date:
Mon Feb 9, 15~18, 2004
Traceroute:
[root@sul pathrate_2.3.0]# /usr/sbin/traceroute
147.46.222.194
traceroute to 147.46.222.194 (147.46.222.194), 30 hops max, 38
byte packets
1 ns_rtr1.kyungpook.ac.kr (155.230.20.5) 0.301 ms 0.186 ms 0.166
ms
2 155.230.253.9 (155.230.253.9) 0.225 ms 0.181 ms 0.162 ms
3 203.255.252.234 (203.255.252.234) 0.353 ms 0.270 ms 0.238
ms
4 192.168.55.2 (192.168.55.2) 1.917 ms 1.961 ms 1.887 ms
5 sgp-tgp.kr.apan.net (203.255.248.161) 4.447 ms 4.461 ms 4.370
ms
6 snu-sgp.kr.apan.net (203.255.248.229) 5.358 ms 5.357 ms 5.328
ms
7 147.46.222.194 (147.46.222.194) 4.937 ms 4.904 ms 4.953 ms
Path Capacity Measurement Using Pathrate:
[knu@hep7 pathrate_2.3.0]$ ./pathrate_rcv -s sul.knu.ac.kr
pathrate run from sul.knu.ac.kr to hep7 on Mon Feb 9 16:41:12
2004
--> Average round-trip time: 4.9ms
--> Capacity Resolution: 20 Mbps
-- Phase I: Detect possible capacity modes --
-> Train length: 2 - Packet size: 600B -> 0% completed
-> Train length: 3 - Packet size: 898B -> 2% completed
-> Train length: 4 - Packet size: 1196B -> 5%
completed
-> Train length: 5 - Packet size: 1488B -> 7%
completed
-> Train length: 6 - Packet size: 1488B -> 10%
completed
-> Train length: 7 - Packet size: 1488B -> 12%
completed
-> Train length: 8 - Packet size: 1488B -> 15%
completed
-> Train length: 9 - Packet size: 1488B -> 17%
completed
-> Train length: 10 - Packet size: 1488B -> 20%
completed
-> Train length: 11 - Packet size: 1488B -> 22%
completed
-> Train length: 12 - Packet size: 1488B -> 25%
completed
Aborting Phase I measurements..
Too many ignored measurements
Phase II will report lower bound on path capacity.
-- Phase II: Estimate Asymptotic Dispersion Rate (ADR) --
-- Number of trains: 500 - Train length: 48 - Packet size:
1488B
-- Local modes : In Phase II --
* Mode: 641 Mbps to 661 Mbps - 61 measurements
Modal bell: 94 measurements - low : 612 Mbps - high : 661
Mbps
-------------------------------------------------
Final capacity estimate : 634 Mbps to 654 Mbps
-------------------------------------------------
Bandwidth Delay Product computation for suggested TCP window
size:
BDP = 4.9ms * 1000Mbps =0.6125MB=627KB
I could use 634~654Mbps found from pathrate instead of 1000Mbps
but it won't make much difference.
With about 600KB TCP window size, however, I could not get good
result.
Right below, about 2Mbyte Window size returns good result. So I
chose 2Mbyte TCP window size for test.
Single TCP stream tests with variation of Window Size:
Window SizeBandwidth(Mbps)
600KB254
1M489
2M644
3M495
4M588
5M559
Test Results (2Mbyte of TCP window size, Duration of each test:
~20 Sec)
TCP StreamsBandwidth(Mbps)
1631
2539
3602
4628
5650
6666
7672
8684
9689
10693
20707
30655
40697
50696
60683
70689
80677
90680
100667
UDP Stream TESTs
Specified bandwidth(Mbps)Jitter(ms)Loss Rate(%)
4000.0370.14
4500.0210.14
5000.0190.23
5500.0760.34
6000.0191.7
6500.0413.3
7000.025
7500.0213
80015.419
8500.01726
9000.01726
9500.02227
10000.02627
NOTE: Iperf can generate constant UDP bit rate corresponding to
the bandwidth specified.
UDP Stream Test Instances are shown below.
400
Note: -b option specifies the bandwidth to send streams at.
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 400m -p
30000
[ 5] local 155.230.20.20 port 32918 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 483 MBytes 406 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 483 MBytes 405 Mbits/sec 0.037 ms 474/344825
(0.14%)
[ 5] Sent 344825 datagrams
450
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 450m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32919 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 539 MBytes 452 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 538 MBytes 452 Mbits/sec 0.021 ms 531/384575
(0.14%)
[ 5] Sent 384575 datagrams
500
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 500m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32919 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 609 MBytes 511 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 608 MBytes 510 Mbits/sec 0.019 ms 1013/434763
(0.23%)
[ 5] Sent 434763 datagrams
550
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 550m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32920 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 668 MBytes 560 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 665 MBytes 558 Mbits/sec 0.076 ms 1638/476155
(0.34%)
[ 5] Sent 476155 datagrams
600
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 600m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32920 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 738 MBytes 619 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 725 MBytes 608 Mbits/sec 0.019 ms 9085/526191
(1.7%)
[ 5] Sent 526191 datagrams
650
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 650m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32921 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 779 MBytes 653 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 753 MBytes 632 Mbits/sec 0.041 ms 18141/555453
(3.3%)
[ 5] Sent 555453 datagrams
700
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 700m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32921 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 875 MBytes 734 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 832 MBytes 698 Mbits/sec 0.020 ms 31146/624502
(5%)
[ 5] Sent 624502 datagrams
750
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 750m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32921 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 934 MBytes 783 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 816 MBytes 684 Mbits/sec 0.020 ms 84287/666205
(13%)
[ 5] Sent 666205 datagrams
800
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 800m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32921 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1000 MBytes 839 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.2 sec 806 MBytes 660 Mbits/sec 15.493 ms
138417/713243 (19%)
[ 5] Sent 713243 datagrams
850
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 850m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32922 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.05 GBytes 903 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 798 MBytes 669 Mbits/sec 0.017 ms
198107/767508 (26%)
[ 5] Sent 767508 datagrams
900
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 900m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32923 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.05 GBytes 903 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 801 MBytes 672 Mbits/sec 0.017 ms
196024/767644 (26%)
[ 5] Sent 767644 datagrams
950
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 950m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32924 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.06 GBytes 912 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 796 MBytes 668 Mbits/sec 0.022 ms
207276/775404 (27%)
[ 5] Sent 775404 datagrams
1000
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 1000m -p
30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32925 connected with
147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.07 GBytes 918 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 798 MBytes 669 Mbits/sec 0.026 ms
211502/780871 (27%)
[ 5] Sent 780871 datagrams
SNU->KNU
SNU(147.46.222.194) -> KNU(sul.knu.ac.kr)
Date
Tue Feb 10, 9~11, 2004
Traceroute:
[knu@hep7 Iperf]$ /usr/sbin/traceroute sul.knu.ac.kr
traceroute to sul.knu.ac.kr (155.230.20.20), 30 hops max, 38
byte packets
1 147.46.222.193 (147.46.222.193) 1.003 ms 0.869 ms 0.838 ms
2 sgp-snu.kr.apan.net (203.255.248.230) 0.716 ms 0.627 ms 0.610
ms
3 tgp-sgp.kr.apan.net (203.255.248.162) 3.255 ms 3.225 ms 3.113
ms
4 192.168.55.1 (192.168.55.1) 4.913 ms 4.779 ms 4.843 ms
5 203.255.252.233 (203.255.252.233) 4.990 ms 5.028 ms 4.982
ms
6 155.230.253.10 (155.230.253.10) 4.974 ms 4.992 ms 4.961 ms
7 sul.kyungpook.ac.kr (155.230.20.20) 4.964 ms 4.909 ms 4.961
ms
Path Capacity Measurement Using Pathrate:
[root@sul pathrate_2.3.0]# ./pathrate_rcv -s 147.46.222.194
pathrate run from 147.46.222.194 to sul.knu.ac.kr on Tue Feb 10
08:58:5
3 2004
--> Average round-trip time: 4.9ms
--> Capacity Resolution: 20 Mbps
-- Phase I: Detect possible capacity modes --
-> Train length: 2 - Packet size: 600B -> 0% completed
-> Train length: 3 - Packet size: 898B -> 2% completed
-> Train length: 4 - Packet size: 1196B -> 5%
completed
-> Train length: 4 - Packet size: 1219B -> 7%
completed
-> Train length: 4 - Packet size: 1242B -> 10%
completed
-> Train length: 4 - Packet size: 1265B -> 12%
completed
-> Train length: 5 - Packet size: 1488B -> 15%
completed
-> Train length: 5 - Packet size: 1488B -> 17%
completed
-> Train length: 5 - Packet size: 1488B -> 20%
completed
-> Train length: 5 - Packet size: 1488B -> 22%
completed
-> Train length: 5 - Packet size: 1488B -> 25%
completed
-> Train length: 5 - Packet size: 1488B -> 27%
completed
-> Train length: 5 - Packet size: 1488B -> 30%
completed
-> Train length: 5 - Packet size: 1488B -> 32%
completed
-> Train length: 5 - Packet size: 1488B -> 35%
completed
-> Train length: 5 - Packet size: 1488B -> 37%
completed
-> Train length: 5 - Packet size: 1488B -> 40%
completed
-> Train length: 5 - Packet size: 1488B -> 42%
completed
-> Train length: 5 - Packet size: 1488B -> 45%
completed
-> Train length: 5 - Packet size: 1488B -> 47%
completed
-> Train length: 5 - Packet size: 1488B -> 50%
completed
-> Train length: 5 - Packet size: 1488B -> 52%
completed
-> Train length: 5 - Packet size: 1488B -> 55%
completed
-> Train length: 5 - Packet size: 1488B -> 57%
completed
-> Train length: 5 - Packet size: 1488B -> 60%
completed
-> Train length: 5 - Packet size: 1488B -> 62%
completed
-> Train length: 5 - Packet size: 1488B -> 65%
completed
-> Train length: 5 - Packet size: 1488B -> 67%
completed
-> Train length: 5 - Packet size: 1488B -> 70%
completed
-> Train length: 5 - Packet size: 1488B -> 72%
completed
-> Train length: 5 - Packet size: 1488B -> 75%
completed
-> Train length: 5 - Packet size: 1488B -> 77%
completed
-> Train length: 5 - Packet size: 1488B -> 80%
completed
-> Train length: 5 - Packet size: 1488B -> 82%
completed
-> Train length: 5 - Packet size: 1488B -> 85%
completed
-> Train length: 5 - Packet size: 1488B -> 87%
completed
-> Train length: 5 - Packet size: 1488B -> 90%
completed
-> Train length: 5 - Packet size: 1488B -> 92%
completed
-> Train length: 5 - Packet size: 1488B -> 95%
completed
-> Train length: 5 - Packet size: 1488B -> 97%
completed
-- Local modes : In Phase I --
* Mode: 731 Mbps to 745 Mbps - 56 measurements
Modal bell: 168 measurements - low : 697 Mbps - high : 781
Mbps
* Mode: 952 Mbps to 972 Mbps - 49 measurements
Modal bell: 188 measurements - low : 882 Mbps - high : 1045
Mbps
* Mode: 794 Mbps to 807 Mbps - 38 measurements
Modal bell: 80 measurements - low : 794 Mbps - high : 852
Mbps
* Mode: 671 Mbps to 690 Mbps - 35 measurements
Modal bell: 102 measurements - low : 635 Mbps - high : 718
Mbps
* Mode: 1287 Mbps to 1305 Mbps - 33 measurements
Modal bell: 206 measurements - low : 1190 Mbps - high : 1446
Mbps
* Mode: 1134 Mbps to 1134 Mbps - 23 measurements
Modal bell: 24 measurements - low : 1134 Mbps - high : 1146
Mbps
* Mode: 866 Mbps to 870 Mbps - 21 measurements
Modal bell: 21 measurements - low : 866 Mbps - high : 870
Mbps
-- Phase II: Estimate Asymptotic Dispersion Rate (ADR) --
-- Number of trains: 500 - Train length: 48 - Packet size:
1488B
-- Local modes : In Phase II --
* Mode: 825 Mbps to 845 Mbps - 187 measurements
Modal bell: 483 measurements - low : 787 Mbps - high : 904
Mbps
-------------------------------------------------
Final capacity estimate : 825 Mbps to 845 Mbps
-------------------------------------------------
Test Results (2Mbyte of TCP window size, Duration of each test:
~20 Sec)
TCP StreamsBandwidth(Mbps)
1587
2640
3638
4637
5637
6605
7619
8589
9586
10586
20619
30625
40618
50579
60619
70553
80599
90410
100545
UDP Stream TESTS
Specified bandwidth(Mbps)Jitter(ms)Loss Rate(%)
4000.0180.039
4500.0160
5000.0330.0051
5500.0250.0067
6000.0170.0083
6500.0170
7000.0220.0071
7500.0170.009
8000.0240.0054
8500.020.006
9000.00320
9500.0320
10000.0140.011
Note: Here, after 600, results are Meaningless, because it seems
that SNU machine
cannot generate more than 600Mbps UDP streams. See below.
Note: -b option specifies bandwidth to send streams at.
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 400m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 483 MBytes 405 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 483 MBytes 405 Mbits/sec 0.018 ms 136/344667
(0.039%)
[ 5] 0.0-10.0 sec 444 datagrams received out-of-order
[ 5] Sent 344667 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 450m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 537 MBytes 450 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 537 MBytes 450 Mbits/sec 0.016 ms 0/382920
(0%)
[ 5] 0.0-10.0 sec 508 datagrams received out-of-order
[ 5] Sent 382920 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 500m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 607 MBytes 509 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 607 MBytes 509 Mbits/sec 0.033 ms 22/432919
(0.0051%)
[ 5] 0.0-10.0 sec 685 datagrams received out-of-order
[ 5] Sent 432919 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 550m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 650 MBytes 545 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 650 MBytes 546 Mbits/sec 0.025 ms 31/463862
(0.0067%)
[ 5] 0.0-10.0 sec 846 datagrams received out-of-order
[ 5] Sent 463862 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 600m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 661 MBytes 554 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 661 MBytes 555 Mbits/sec 0.017 ms 39/471464
(0.0083%)
[ 5] 0.0-10.0 sec 788 datagrams received out-of-order
[ 5] Sent 471464 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 650m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 667 MBytes 560 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 667 MBytes 560 Mbits/sec 0.017 ms 0/476138
(0%)
[ 5] 0.0-10.0 sec 823 datagrams received out-of-order
[ 5] Sent 476138 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 700m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 691 MBytes 580 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 691 MBytes 580 Mbits/sec 0.022 ms 35/492819
(0.0071%)
[ 5] 0.0-10.0 sec 973 datagrams received out-of-order
[ 5] Sent 492819 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 750m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 697 MBytes 585 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 697 MBytes 585 Mbits/sec 0.017 ms 45/497534
(0.009%)
[ 5] 0.0-10.0 sec 908 datagrams received out-of-order
[ 5] Sent 497534 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 800m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec 0.024 ms 27/498533
(0.0054%)
[ 5] 0.0-10.0 sec 908 datagrams received out-of-order
[ 5] Sent 498533 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 850m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec 0.020 ms 33/498545
(0.0066%)
[ 5] 0.0-10.0 sec 869 datagrams received out-of-order
[ 5] Sent 498545 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 900m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 699 MBytes 587 Mbits/sec 0.032 ms 0/498651
(0%)
[ 5] 0.0-10.0 sec 923 datagrams received out-of-order
[ 5] Sent 498651 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 1000m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20
port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 699 MBytes 587 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 699 MBytes 587 Mbits/sec 0.014 ms 57/498781
(0.011%)
[ 5] 0.0-10.0 sec 944 datagrams received out-of-order
[ 5] Sent 498781 datagrams
SNU->KOREN_NOC
SNU(147.46.222.194)->KTcluster2
Single Stream TCP tests with 2MB, 4MB TCP window sizes.
[knu@hep7 Iperf]$ ./iperf -c 203.255.252.12 -w 1m -t 20
------------------------------------------------------------
Client connecting to 203.255.252.12, TCP port 5001
TCP window size: 2.00 MByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1910 connected with
203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-20.0 sec 1.51 GBytes 648 Mbits/sec
[knu@hep7 Iperf]$ ./iperf -c 203.255.252.12 -w 2m -t 20
------------------------------------------------------------
Client connecting to 203.255.252.12, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1911 connected with
203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-20.0 sec 1.51 GBytes 648 Mbits/sec
KNU(sul.knu.ac.kr)->KTcluster2
Single Stream TCP tests with 2MB, 4MB TCP window sizes.
[root@sul Iperf]# ./iperf -c 203.255.252.12 -w 1m -t 20
------------------------------------------------------------
Client connecting to 203.255.252.12, TCP port 5001
TCP window size: 2.00 MByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 60834 connected with
203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-20.0 sec 2.13 GBytes 916 Mbits/sec
[root@sul Iperf]# ./iperf -c 203.255.252.12 -w 2m -t 20
------------------------------------------------------------
Client connecting to 203.255.252.12, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 60815 connected with
203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-20.0 sec 2.15 GBytes 922 Mbits/sec
UDP Stream TEST from KNU to KT
Specified Bandwidth(Mbps)Jitter(ms)Loss Rate(%)
9000.0160.014
10000.0290.022
[root@sul Iperf]# ./iperf -c 203.255.252.12 -u -b 900m
------------------------------------------------------------
Client connecting to 203.255.252.12, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32927 connected with
203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.05 GBytes 902 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 1.05 GBytes 902 Mbits/sec 0.016 ms 107/767275
(0.014%)
[ 5] Sent 767275 datagrams
[root@sul Iperf]# ./iperf -c 203.255.252.12 -u -b 1000m
------------------------------------------------------------
Client connecting to 203.255.252.12, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32928 connected with
203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.07 GBytes 920 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 1.07 GBytes 920 Mbits/sec 0.029 ms 171/782253
(0.022%)
[ 5] Sent 782253 datagrams
KNU->KOREN_NOC
KNU(sul.knu.ac.kr)->KT window size test with single TCP
stream.
Window SizeBandwidth achieved(Mbps)
256 KB345
512 KB682
1 MB918
2 MB921
3 MB922
4 MB921
KNU->KOREN_NOC
TCP
(Achievable bandwidth in Mbps)
-> NOC (Single Stream)
Chart1
A182
B162
C180
D218
E174
TCP Stream
Achievable Bandwidth in Mbps
KNU->KOREN-NOC (5 Parallel TCP Streams)
Dec19
1219 Achievable Bandwidth TEST from CHEP16 to NKCHEP3
Physical Capacity (pathrate, netest)
pathrate-> 292ms(RTT), Capacity: 98Mbps
netest-> 291.4ms(RTT), Capacity: 155.520Mbs
No. of TCP streamsAchievable bandwidth with TCP window of
4MB
13.09(Mbps)
23.45
34.89
47.86
57.32
611.7
79.75
812.2
911.9
1015.5
1111.6
1218
1319.8
1417.5
1520.8
1621.7
1717.6
1828.1
1924.6
2024.3
2119.3
2224.2
2328.1
2428.1
2529.7
2627.7
2733.6
2833.1
2932
3032.9
3135.4
3233.8
3334.8
3432.9
3536.7
3628.7
3721.5
3840.7
3942
4042.9
4142.5
4247.3
4342.9
4447.3
4548.3
4638.5
4736.8
4844.7
4954.8
5049.7
5145
5250
5346.6
5448.3
5544.9
5649.5
5751
5849.2
5950.6
6049.3
6146.5
6249.9
6347.8
6444.9
6553.5
6651.3
6754.4
6849.3
6955.1
7053.2
7153.9
7251.7
7348.8
7452.1
7550.6
7658.1
7753.6
7855.6
7947
8054.4
8155.9
8256.1
8354.1
8459.6
8553.1
8660.5
8763.4
8862.2
8953.6
9057.2
9160.5
9264.4
9359.3
9460.5
9564.3
9662.8
9761.3
9858
9959.2
10058.7
Dec19
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
No. of TCP Streams
Bandwidth(Mbps)
1219 CHEP16->NKCHEP3
Dec20
1220 Achievable Bandwidth TEST from CHEP16 to NKCHEP3
Physical Capacity (pathrate, netest)
pathrate-> 281.2ms(RTT), Capacity: 96Mbps to 99 Mbps
netest->281.6ms(RTT), Capacity: 100Mbps,
No. of TCPAchievable bandwidth (window:4MB)Achievable
bandwidth(window:128KB)
131.61
233.52.25
3233.41
424.14.54
537.99.1
630.611
733.612.7
835.914.4
929.816.3
1032.26.84
1134.17.79
1236.99.75
137.4211.3
1414.211.6
1532.214.5
1636.515.6
1738.616.5
1832.317.3
1929.318.4
2012.318.1
2123TCP window size of 128KB performs poorly with small number
of TCP Streams.
2231.4
2336.6
2429.7
2538.8
2632
2732.4
2831.4
2930.1
3031.724.5
3135.7
3227.2
338.4
3423.4
3538
3637.6
3736
3834.4
3933.1
4039.131.8
4138.2
4236.3
4328.1
4432.5
4541.1
4644.1
4743.9
4837.6
4935.1
5039.942.8
5140.1
5244
5342.6
5443.7
5543.9
5641.5
5745.5
584246.6
5939.9
6035.6
6146.3
6243.3
6340.2
6445.6
6539.6
6641.2
6740.6
6841.8
6943
7044.821.9
7141.5
7238.2
7342.7
7442.9
7546.9
7643.4
7742.9
7840.8
7940.5
8040.246.7
8140.1
8243.6
8343.3
8447.1
8544.9
8650.3
8752.2
8849.4
8949.7
9047.450.7
9150.1
9248.4
9347.5
9447.5
9547.6
9650.7
9750.8
9848.8
9947.7
10054.446.9
Dec20
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
4MB
128KB
No. of TCP Streams
Bandwidth(Mbps)
1220 CHEP16->NKCHEP3
Dec21
1221 Achivable Bandwidth TEST from CHEP16 to NKCHEP3
Physical Capacity (pathrate, netest)
pathrate-> 281.3ms(RTT), Capacity: 97Mbps to 99 Mbps
netest->281.9ms(RTT), Capacity: 100Mbps
No. of TCPAchievable bandwidth with 4MB of TCP window
132.6
231.9
346
442.6
543.5
649.5
742.1
831.6
932.3
1029.8
1133.9
1236.9
1339.9
1442.3
1540.6
1632.4
1739.5
1842.1
1944.1
2046.3
2147.6
2229.6
2328.4
2441.3
2534.8
2646.3
2735.6
2838.4
2935.7
3039.9
3146.8
3237.1
3339.7
3438.6
3535.8
3633.3
3739.1
3841.2
3936.1
4041.3
4142.9
4240.8
4344
4442.7
4544.2
4645.1
4745.9
4846.1
4937.5
5043
5150.9
5252.4
5337.3
5447.6
5547.7
5645.5
5746.1
5847.2
5941.1
6039
6150.5
6249.4
6344.1
6448
6548.1
6653.3
6746.7
6849.3
6951
7049.8
7143.6
7250.5
7344.2
7449.2
7549.3
7648.6
7750.3
7851.7
7952.6
8050.8
8154.6
8253.7
8351.9
8450.1
8550.6
8653.5
8750
8855.6
8947.9
9050.1
9153.6
9249.2
9354.7
9454
9551.5
9651.3
9753.9
9852.1
9956
10049.5
Dec21
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
No. of TCP Streams
Bandwidth(Mbps)
1221 CHEP16->NKCHEP3
Dec22
12 22
TCP (CHEP16->NKCHEP3)
With TCP Window Size of 4MByte
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55837 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 140 MBytes 38.6 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55838 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.4 sec 147 MBytes 40.5 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55839 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 120 MBytes 32.9 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55840 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.4 sec 138 MBytes 38.1 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55841 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 138 MBytes 38.1 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55842 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 136 MBytes 37.4 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55843 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 139 MBytes 38.1 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55844 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.4 sec 138 MBytes 38.2 Mbits/sec
With TCP Window size of 128 KB
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 65535 -t
30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 128 KByte (WARNING: requested 64.0 KByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55850 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 7.33 MBytes 2.01 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 65535 -t
30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 128 KByte (WARNING: requested 64.0 KByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55851 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 7.30 MBytes 2.01 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 65535 -t
30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 128 KByte (WARNING: requested 64.0 KByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55852 connected with
131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.3 sec 7.29 MBytes 2.02 Mbits/sec
chep16->KT
CHEP16->KTCLUSTER1
This test shows that single TCP stream bandwidth roughly equals
the sum of the bandwidths of multiple TCP streams
when TCP window size is optimal and there is no network
deficiencies.
Single Stream TCP
[root@chep16 Iperf]# ./iperf -c ktcluster1.koren21.net -w 2m -t
30
------------------------------------------------------------
Client connecting to ktcluster1.koren21.net, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55910 connected with
203.255.252.11 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.0 sec 3.23 GBytes 925 Mbits/sec
5 TCP Streams
[root@chep16 Iperf]# ./iperf -c ktcluster1.koren21.net -w 2m -P
5
------------------------------------------------------------
Client connecting to ktcluster1.koren21.net, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 9] local 155.230.20.242 port 55915 connected with
203.255.252.11 port 5001
[ 7] local 155.230.20.242 port 55913 connected with
203.255.252.11 port 5001
[ 8] local 155.230.20.242 port 55914 connected with
203.255.252.11 port 5001
[ 5] local 155.230.20.242 port 55911 connected with
203.255.252.11 port 5001
[ 6] local 155.230.20.242 port 55912 connected with
203.255.252.11 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.1 sec 220 MBytes 182 Mbits/sec
[ 7] 0.0-10.1 sec 195 MBytes 162 Mbits/sec
[ 6] 0.0-10.1 sec 218 MBytes 180 Mbits/sec
[ 9] 0.0-10.1 sec 261 MBytes 218 Mbits/sec
[ 8] 0.0-10.1 sec 208 MBytes 174 Mbits/sec
[SUM] 0.0-10.2 sec 1.08 GBytes 906 Mbits/sec
A182
B162
C180
D218
E174
chep16->KT
A182
B162
C180
D218
E174
(Achievable Bandwidth in Mbps)
-> NOC (5 )
BDP
Bandwidth Delay Product:
BDP roughly determines the optimal TCP window size which should
be adjusted both at local and at remote machines.
Default TCP window size of Linux is 65535 bytes which is too
small for High Bandwidth WAN.
BDP can be computed as follows:
The bottleneck link between chep16 and nkchep3 is 100Mbps.
RTT is 291ms currently.
Therefore BDP is 100Mbps* 291ms = 3.6375Mbytes.
So TCP window size should be at least 4Mbytes.
Conclusion
CONCLUSION AND SOME OBSERVATIONS:
1. Dec19 test is a little bit strange compared to Dec20, Dec21
and Dec22 because the single stream bandwidth was
less than 5MB. I think this is due to previous practice
multi-stream tests before the actual measurements.
Single stream test which follows multi-stream tests right away
usually gives low achivable bandwidth.
It seems that we need to wait for TCP to refresh. Or network
might have been less stable at that time.
2. Physical Capacity from chep16 to nkchep3 is 95~100Mbps.
3. Achievable bandwidth from chep16 to nkchep3 with single TCP
stream is 30~40Mbps on the condition that
optimal TCP window size is used, which can be roughly computed
by Bandwidth Delay Product.
4. With multiple parallel TCP streams, usually 50~70 Mbps can be
achieved from chep16 to nkchep3.
5. On a good network, single TCP stream bandwidth = sum of
bandwidths achieved by multiple TCP streams
6. Single TCP stream is more vulnerable than multiple parallel
TCP streams to network unstability due to algorithms
such as congestion avoidance and slow-start implemented in
TCP.
With multiple parallel streams, this effect is minimized and the
rate of recovery from packet loss is increased.
See Reference [7].
7. Parallel applications such as bbftp will be helpful in
securing more bandwidth, hence speeding up data transfer over
WAN.
8. With default TCP window size of 65535 bytes in Linux, a
single TCP stream can achieve less than 5Mbps.
Note: Linux kernel usually doubles the requested window size. If
you request 65535 bytes, it will give 128KB for window size.
9. TCP Extensions specified in RFC 1323 must be turned on to
utilize high band networks ( >100Mbps ).
/proc/sys/net/ipv4/tcp_window_scaling - to allow window larger
than 65K bytes
/proc/sys/net/ipv4/tcp_sack - selective acknowledgement
/proc/sys/net/ipv4/tcp_timestamps - single TCP Timestamps
Options
/proc/sys/net/ipv4/ip_no_pmtu_disc - path MTU discovery
/proc/sys/net/core/rmem_default - default receive window
/proc/sys/net/core/rmem_max - maximum receive window
/proc/sys/net/core/wmem_default - default send window
/proc/sys/net/core/wmem_max - maximum send window
/proc/sys/net/ipv4/tcp_rmem - memory reserved for TCP rcv
buffers
/proc/sys/net/ipv4/tcp_wmem - memory reserved for TCP snd
buffers
Below are some examples of chep16 TCP parameters.
[root@chep16 Iperf]# more /proc/sys/net/core/rmem_default
65535
[root@chep16 Iperf]# more /proc/sys/net/core/wmem_max
8388608
[root@chep16 Iperf]# more /proc/sys/net/ipv4/tcp_wmem
4096 87380 4194304
References
1. http://dast.nlanr.net/Projects/Iperf/
2. http://www-didc.lbl.gov/NMWG/NM-WG-tools.html
3. http://www-didc.lbl.gov/NCS/netest/
4. http://www.psc.edu/networking/perf_tune.html
5. Netest: A Tool to Measure the Maximum Burst Size, Available
Bandwidth and Achievable Bandwidth Throughput
Guojun Jin, Brian Tierney, Lawrence Berkeley National
Laboratory
6. http://www.internet2.edu/~shalunov/writing/tcp-perf.html
7. The End-to-End Performance Effects of Parallel TCP Sockets on
a Lossy Wide-Area Network
Thomas J. Hacker, Brian D. Athey, University of Michigan
Multi-Stream Tests between CHEP Caltech Duration: 10min each
over KOREN-TransPAC path (1Gbps), (Stream* Window ) Caltech (June
23)
Sheet1
[root@cluster90 ipv4]# traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte
packets
1 ns_rtr1 (155.230.20.5) 0.527 ms 0.177 ms 0.151 ms
2 155.230.253.9 (155.230.253.9) 0.235 ms 0.187 ms 0.232 ms
3 203.255.252.234 (203.255.252.234) 0.549 ms 0.312 ms 0.273
ms
4 192.168.88.2 (192.168.88.2) 1.823 ms 1.758 ms 1.772 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.955 ms
6.973 ms 7.
117 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 45.545 ms
44.409 ms 65.
299 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.780 ms 25.851 ms
25.649 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.313 ms
129.377 ms 129.
272 ms
9 snvang-losang.abilene.ucaid.edu (198.32.8.95) 139.394 ms
139.411 ms 139.4
20 ms
10 dnvrng-snvang.abilene.ucaid.edu (198.32.8.2) 164.068 ms
164.110 ms 164.00
7 ms
11 kscyng-dnvrng.abilene.ucaid.edu (198.32.8.14) 174.620 ms
174.723 ms 182.1
80 ms
12 iplsng-kscyng.abilene.ucaid.edu (198.32.8.80) 183.899 ms
183.827 ms 197.4
68 ms
13 chinng-iplsng.abilene.ucaid.edu (198.32.8.76) 187.729 ms
187.849 ms 187.6
47 ms
14 r04chi-v-187.caltech.datatag.org (192.91.236.198) 187.769 ms
187.898 ms 1
87.773 ms
15 w01gva-ge-0.cern.datatag.org (192.91.239.1) 438.666 ms
313.109 ms 312.979
ms
[kihwan@w01gva Iperf]$ /usr/sbin/traceroute
cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max,
38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 125.546 ms
125.523 ms 12
5.508 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.668 ms 125.662 ms
125.676 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.587 ms
129.637 ms 138.1
27 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 187.181 ms
138.687 ms 138.8
34 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.312 ms
149.329 ms 149.3
30 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.043 ms
174.031 ms 198.55
3 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.041 ms
184.037 ms 184.0
42 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.810 ms
287.759 ms 287.
759 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.576 ms 307.133
ms 307.056
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226)
306.479 ms 306.437
ms 306.431 ms
11 203.181.249.161 (203.181.249.161) 311.452 ms 311.436 ms
311.497 ms
12 192.168.88.1 (192.168.88.1) 312.899 ms 312.910 ms 312.904
ms
13 203.255.252.233 (203.255.252.233) 313.323 ms 313.268 ms
313.223 ms
14 155.230.253.10 (155.230.253.10) 313.183 ms 313.140 ms 313.243
ms
15 cluster90.knu.ac.kr (155.230.20.120) 313.136 ms 313.205 ms
313.165 ms
BDP=313*1Gbps=39MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
125.7
232
330.9
428.5
528.4
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB173
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
Single Streamwindow with 60MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Caltech
[kihwan@cluster90 Iperf]$ /usr/sbin/traceroute
socrates.cacr.caltech.edu
traceroute to socrates.cacr.caltech.edu (131.215.144.227), 30
hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.208 ms 0.153 ms 0.164 ms
2 155.230.253.9 (155.230.253.9) 0.238 ms 0.202 ms 0.183 ms
3 203.255.252.234 (203.255.252.234) 0.405 ms 0.336 ms 0.284
ms
4 192.168.88.2 (192.168.88.2) 1.827 ms 1.799 ms 1.765 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.984 ms
6.983 ms 6.937 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 44.594 ms
45.327 ms 44.263 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.671 ms 25.703 ms
25.631 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.312 ms
129.317 ms 129.437 ms
9 hpr-lax-gsr1--abilene-LA-10ge.cenic.net (137.164.25.2) 129.450
ms 129.677 ms 129.404 ms
10 lax-hpr.losnettos-hpr.cenic.net (137.164.27.246) 129.911 ms
129.824 ms 129.996 ms
11 Booth-RSM.ilan.caltech.edu (131.215.254.253) 130.053 ms
129.926 ms 129.722 ms
12 CACR-ITS-BMR.caltech.edu (131.215.5.147) 129.833 ms 129.949
ms 129.936 ms
13 socrates.cacr.caltech.edu (131.215.144.227) 129.776 ms
129.604 ms 129.610 ms
[kihwan@socrates kihwan]$ /usr/sbin/traceroute
cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max,
38 byte packets
1 defaultroute (131.215.144.254) 0.184 ms 0.131 ms 0.125 ms
2 ITS-CACR-BMR.caltech.edu (131.215.5.145) 0.180 ms 0.156 ms
0.160 ms
3 SFL-border.ilan.caltech.edu (131.215.254.252) 0.186 ms 0.181
ms 0.165 ms
4 lax-hpr.losnettos-hpr.cenic.net (137.164.27.241) 0.907 ms
0.746 ms 0.618 ms
5 abilene-LA--hpr-lax-gsr1-10ge.cenic.net (137.164.25.3) 0.755
ms 0.606 ms 0.633 ms
6 tpr2-transpac-la.jp.apan.net (203.181.248.130) 104.360 ms
104.522 ms 104.355 ms
7 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 123.369 ms 123.375
ms 124.634 ms
8 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226)
123.054 ms 123.187 ms 123.047 ms
9 203.181.249.161 (203.181.249.161) 128.043 ms 128.120 ms
128.011 ms
10 * * *
11 203.255.252.233 (203.255.252.233) 129.787 ms 129.830 ms
130.009 ms
12 155.230.253.10 (155.230.253.10) 129.717 ms 129.681 ms 129.744
ms
13 cluster90.knu.ac.kr (155.230.20.120) 129.892 ms 129.656 ms
129.797 ms
Using FAST over TransPAC with 1Gbps capacity
day 1Reno(for graphing)
Single Streamwindow with 20MbyteBandwidth
166.9110
2109146
370.776.8
46981.7
571.1102
Multi StreamWindow(stream*window < 100MB)BandwidthReno(for
graphing)
102MB267414
201MB364532
301MB431630
401MB525668
501MB557690
601MB639750
701MB678768
801MB680755
901MB697783
1001MB701742
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1110
2146
376.8
481.7
5102
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB414
201MB532
301MB630
401MB668
501MB690
601MB750
701MB768
801MB755
901MB783
1001MB742
Caltech
00
00
00
00
00
00
00
00
00
00
FAST
TCP Reno
No. of Streams
Bandwidth(Mbps)
KNU->Caltech (Parallel Streams)
Geneva
To w01gva from cluster90
[kihwan@w01gva kihwan]$ /usr/sbin/traceroute
cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max,
38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 251.110 ms
125.512 ms 12
5.511 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.657 ms 125.658 ms
125.654 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.471 ms
129.531 ms 172.7
75 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 138.677 ms
138.667 ms 139.1
03 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.309 ms
149.290 ms 149.2
89 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.042 ms
174.034 ms 174.03
2 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.903 ms
184.037 ms 184.0
07 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.780 ms
287.780 ms 287.
793 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.379 ms 306.703
ms 306.605
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226)
306.439 ms 306.441
ms 306.449 ms
11 203.181.249.161 (203.181.249.161) 311.466 ms 311.488 ms
311.401 ms
12 192.168.88.1 (192.168.88.1) 312.921 ms 312.915 ms 312.906
ms
13 203.255.252.233 (203.255.252.233) 350.098 ms 343.048 ms
342.980 ms
14 155.230.253.10 (155.230.253.10) 343.086 ms 342.983 ms 342.947
ms
15 cluster90.knu.ac.kr (155.230.20.120) 343.202 ms 342.919 ms
343.020 ms
[root@cluster90 Iperf]# /usr/sbin/traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte
packets
1 ns_rtr1 (155.230.20.5) 0.255 ms 0.177 ms 0.147 ms
2 155.230.253.9 (155.230.253.9) 0.217 ms 0.194 ms 0.193 ms
3 203.250.174.45 (203.250.174.45) 0.215 ms 0.204 ms 0.176 ms
4 rubyl3-daegul3.kreonet.net (134.75.5.9) 2.579 ms 2.523 ms
2.520 ms
5 baramgsr.kreonet.net (134.75.20.1) 2.695 ms 2.633 ms 2.624
ms
6 startapgsr.kreonet.net (134.75.20.70) 2.548 ms 2.469 ms 2.471
ms
7 134.75.108.46 (134.75.108.46) 254.147 ms 217.544 ms 217.514
ms
8 r04chi-v-187.caltech.datatag.org (192.91.236.198) 217.663 ms
217.738 ms 217.547 ms
9 w01gva-ge-0.cern.datatag.org (192.91.239.1) 342.812 ms 342.850
ms 342.860 ms
340ms* 622Mbps = 26MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB
201MB
301MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
142.5
243.6
343.5
443.4
543.1
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB122
201MB126
301MB130
401MB129
501MB132
601MB132
701MB132
801MB
901MB
1001MB
MBD051D9514.xls
Chart1
66.9110
109146
70.776.8
6981.7
71.1102
FAST(2.4.22)
TCP Reno(2.4.26)
No. of Trial
Bandwidth(Mbps)
KNU-> Caltech(Single Stream)
Sheet1
[root@cluster90 ipv4]# traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte
packets
1 ns_rtr1 (155.230.20.5) 0.527 ms 0.177 ms 0.151 ms
2 155.230.253.9 (155.230.253.9) 0.235 ms 0.187 ms 0.232 ms
3 203.255.252.234 (203.255.252.234) 0.549 ms 0.312 ms 0.273
ms
4 192.168.88.2 (192.168.88.2) 1.823 ms 1.758 ms 1.772 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.955 ms
6.973 ms 7.
117 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 45.545 ms
44.409 ms 65.
299 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.780 ms 25.851 ms
25.649 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.313 ms
129.377 ms 129.
272 ms
9 snvang-losang.abilene.ucaid.edu (198.32.8.95) 139.394 ms
139.411 ms 139.4
20 ms
10 dnvrng-snvang.abilene.ucaid.edu (198.32.8.2) 164.068 ms
164.110 ms 164.00
7 ms
11 kscyng-dnvrng.abilene.ucaid.edu (198.32.8.14) 174.620 ms
174.723 ms 182.1
80 ms
12 iplsng-kscyng.abilene.ucaid.edu (198.32.8.80) 183.899 ms
183.827 ms 197.4
68 ms
13 chinng-iplsng.abilene.ucaid.edu (198.32.8.76) 187.729 ms
187.849 ms 187.6
47 ms
14 r04chi-v-187.caltech.datatag.org (192.91.236.198) 187.769 ms
187.898 ms 1
87.773 ms
15 w01gva-ge-0.cern.datatag.org (192.91.239.1) 438.666 ms
313.109 ms 312.979
ms
[kihwan@w01gva Iperf]$ /usr/sbin/traceroute
cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max,
38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 125.546 ms
125.523 ms 12
5.508 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.668 ms 125.662 ms
125.676 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.587 ms
129.637 ms 138.1
27 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 187.181 ms
138.687 ms 138.8
34 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.312 ms
149.329 ms 149.3
30 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.043 ms
174.031 ms 198.55
3 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.041 ms
184.037 ms 184.0
42 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.810 ms
287.759 ms 287.
759 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.576 ms 307.133
ms 307.056
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226)
306.479 ms 306.437
ms 306.431 ms
11 203.181.249.161 (203.181.249.161) 311.452 ms 311.436 ms
311.497 ms
12 192.168.88.1 (192.168.88.1) 312.899 ms 312.910 ms 312.904
ms
13 203.255.252.233 (203.255.252.233) 313.323 ms 313.268 ms
313.223 ms
14 155.230.253.10 (155.230.253.10) 313.183 ms 313.140 ms 313.243
ms
15 cluster90.knu.ac.kr (155.230.20.120) 313.136 ms 313.205 ms
313.165 ms
BDP=313*1Gbps=39MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
125.7
232
330.9
428.5
528.4
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB173
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
Single Streamwindow with 60MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Caltech
[kihwan@cluster90 Iperf]$ /usr/sbin/traceroute
socrates.cacr.caltech.edu
traceroute to socrates.cacr.caltech.edu (131.215.144.227), 30
hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.208 ms 0.153 ms 0.164 ms
2 155.230.253.9 (155.230.253.9) 0.238 ms 0.202 ms 0.183 ms
3 203.255.252.234 (203.255.252.234) 0.405 ms 0.336 ms 0.284
ms
4 192.168.88.2 (192.168.88.2) 1.827 ms 1.799 ms 1.765 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.984 ms
6.983 ms 6.937 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 44.594 ms
45.327 ms 44.263 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.671 ms 25.703 ms
25.631 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.312 ms
129.317 ms 129.437 ms
9 hpr-lax-gsr1--abilene-LA-10ge.cenic.net (137.164.25.2) 129.450
ms 129.677 ms 129.404 ms
10 lax-hpr.losnettos-hpr.cenic.net (137.164.27.246) 129.911 ms
129.824 ms 129.996 ms
11 Booth-RSM.ilan.caltech.edu (131.215.254.253) 130.053 ms
129.926 ms 129.722 ms
12 CACR-ITS-BMR.caltech.edu (131.215.5.147) 129.833 ms 129.949
ms 129.936 ms
13 socrates.cacr.caltech.edu (131.215.144.227) 129.776 ms
129.604 ms 129.610 ms
[kihwan@socrates kihwan]$ /usr/sbin/traceroute
cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max,
38 byte packets
1 defaultroute (131.215.144.254) 0.184 ms 0.131 ms 0.125 ms
2 ITS-CACR-BMR.caltech.edu (131.215.5.145) 0.180 ms 0.156 ms
0.160 ms
3 SFL-border.ilan.caltech.edu (131.215.254.252) 0.186 ms 0.181
ms 0.165 ms
4 lax-hpr.losnettos-hpr.cenic.net (137.164.27.241) 0.907 ms
0.746 ms 0.618 ms
5 abilene-LA--hpr-lax-gsr1-10ge.cenic.net (137.164.25.3) 0.755
ms 0.606 ms 0.633 ms
6 tpr2-transpac-la.jp.apan.net (203.181.248.130) 104.360 ms
104.522 ms 104.355 ms
7 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 123.369 ms 123.375
ms 124.634 ms
8 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226)
123.054 ms 123.187 ms 123.047 ms
9 203.181.249.161 (203.181.249.161) 128.043 ms 128.120 ms
128.011 ms
10 * * *
11 203.255.252.233 (203.255.252.233) 129.787 ms 129.830 ms
130.009 ms
12 155.230.253.10 (155.230.253.10) 129.717 ms 129.681 ms 129.744
ms
13 cluster90.knu.ac.kr (155.230.20.120) 129.892 ms 129.656 ms
129.797 ms
Using FAST over TransPAC with 1Gbps capacity
day 1Reno(for graphing)
Single Streamwindow with 20MbyteBandwidth
166.9110
2109146
370.776.8
46981.7
571.1102
Multi StreamWindow(stream*window < 100MB)BandwidthReno(for
graphing)
102MB267414
201MB364532
301MB431630
401MB525668
501MB557690
601MB639750
701MB678768
801MB680755
901MB697783
1001MB701742
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1110
2146
376.8
481.7
5102
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB414
201MB532
301MB630
401MB668
501MB690
601MB750
701MB768
801MB755
901MB783
1001MB742
Caltech
00
00
00
00
00
FAST(2.4.22)
TCP Reno(2.4.26)
No. of Trial
Bandwidth(Mbps)
KNU-> Caltech(Single Stream)
Geneva
00
00
00
00
00
00
00
00
00
00
FAST
TCP Reno
No. of Streams
Bandwidth(Mbps)
KNU->Caltech (Parallel Streams)
To w01gva from cluster90
[kihwan@w01gva kihwan]$ /usr/sbin/traceroute
cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max,
38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 251.110 ms
125.512 ms 12
5.511 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.657 ms 125.658 ms
125.654 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.471 ms
129.531 ms 172.7
75 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 138.677 ms
138.667 ms 139.1
03 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.309 ms
149.290 ms 149.2
89 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.042 ms
174.034 ms 174.03
2 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.903 ms
184.037 ms 184.0
07 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.780 ms
287.780 ms 287.
793 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.379 ms 306.703
ms 306.605
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226)
306.439 ms 306.441
ms 306.449 ms
11 203.181.249.161 (203.181.249.161) 311.466 ms 311.488 ms
311.401 ms
12 192.168.88.1 (192.168.88.1) 312.921 ms 312.915 ms 312.906
ms
13 203.255.252.233 (203.255.252.233) 350.098 ms 343.048 ms
342.980 ms
14 155.230.253.10 (155.230.253.10) 343.086 ms 342.983 ms 342.947
ms
15 cluster90.knu.ac.kr (155.230.20.120) 343.202 ms 342.919 ms
343.020 ms
[root@cluster90 Iperf]# /usr/sbin/traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte
packets
1 ns_rtr1 (155.230.20.5) 0.255 ms 0.177 ms 0.147 ms
2 155.230.253.9 (155.230.253.9) 0.217 ms 0.194 ms 0.193 ms
3 203.250.174.45 (203.250.174.45) 0.215 ms 0.204 ms 0.176 ms
4 rubyl3-daegul3.kreonet.net (134.75.5.9) 2.579 ms 2.523 ms
2.520 ms
5 baramgsr.kreonet.net (134.75.20.1) 2.695 ms 2.633 ms 2.624
ms
6 startapgsr.kreonet.net (134.75.20.70) 2.548 ms 2.469 ms 2.471
ms
7 134.75.108.46 (134.75.108.46) 254.147 ms 217.544 ms 217.514
ms
8 r04chi-v-187.caltech.datatag.org (192.91.236.198) 217.663 ms
217.738 ms 217.547 ms
9 w01gva-ge-0.cern.datatag.org (192.91.239.1) 342.812 ms 342.850
ms 342.860 ms
340ms* 622Mbps = 26MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB
201MB
301MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
142.5
243.6
343.5
443.4
543.1
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB122
201MB126
301MB130
401MB129
501MB132
601MB132
701MB132
801MB
901MB
1001MB