Top Banner

Click here to load reader

WI-FI PERFORMANCE BENCHMARK TESTING: Aruba · PDF fileDell with Intel 6300 chipset (47) Dell with Intel 4905 chipset (10) Tablets iPad 2 Bonjour services Apple TV 2 Test tools Performance

Mar 30, 2019

ReportDownload

Documents

lenguyet

WI-FI PERFORMANCE BENCHMARK TESTING: Aruba Networks AP-135 and Cisco AP3602i Conducted at Aruba Proof of Concept (PoC) Lab June 2012

Wi-Fi Performance Benchmark Testing: Aruba Networks AP-135 and Cisco AP3602i

Aruba Networks, Inc. 2

Statement of test result confidence Aruba makes every attempt to optimize all vendors for performance and follow best

practices for configuration as published by the vendor. Aruba makes every attempt to make a fair and apples-to-apples comparison, including AP

mounting position, client location, transmit power, channel and the latest shipping firmware. Aruba ensures the test bed environment to be free of any interference sources. Also, the

802.11 Wi-Fi channels configured are ensured to be consistent when testing 2.4 GHz and 5 GHz bands for all vendors.

Aruba believes the test results are both repeatable and reproducible in similar testing environments.

Wi-Fi Performance Benchmark Testing: Aruba Networks AP-135 and Cisco AP3602i

Aruba Networks, Inc. 3

Table of Contents Executive Summary..................................................................................................................4 Test Enviroment ........................................................................................................................5

Test Bed Setup ................................................................................................................................... 5 Real World Test Scenarios.......................................................................................................7

1. Rate vs. Range ................................................................................................................................ 7 2. Client Density Test for 2Mbps and 5Mbps Multicast HD Video Stream .................................. 10 3. iPad Client Density Test for 1Mbps TCP HD Video Stream with AirPlay ................................ 11 4. Video Performance with Mixed Clients and Background Traffic ............................................. 12 5. Battery Test: Impact on Battery Life of Mobile Devices While Downloading Large Files..... 15

What Do The Tests Reveal?...................................................................................................15 Appendix..................................................................................................................................16

Wi-Fi Performance Benchmark Testing: Aruba Networks AP-135 and Cisco AP3602i

Aruba Networks, Inc. 4

Executive Summary The Aruba Networks proof-of-concept lab is a clean RF environment dedicated to showcasing complex networking solutions in a real world setup. Aruba customers, partners and prospects rely on the lab to validate interoperability with other vendors products as well as test uncommon deployment scenarios. The lab is also fully equipped to conduct feature and performance benchmark testing for customer evaluations. This report focuses on performance and functionality testing to compare and benchmark Wi-Fi solutions using Aruba AP-135 access point and the Cisco AP3602i access point. The results from the tests are summarized in Table 1 below and explained in detail in the report. Table 1 Test Results Summary

TestCase Aruba Cisco

ArubaAdvantage

Download 219 194 13%

Upload 224 202 11%

Verticalorientationoftablet 16 8 50%

TCPthroughput

BeamformingCiscoClientLinkOn/ClientLinkOff)

N/A 66/71 N/A

Maxnumberoflaptops2MbpsVideo

51 44 16%

Maxnumberoflaptops5Mbpsvideo 39 31 25%

Videodensity

MaxnumberofiPads1Mbpsvideo 21 16 31%WiFiclientdensity

Videoperformancewithmixedclientstypes

Pass Fail N/A

BatteryDrain Percentagebatterdrain 6% 6% N/A The test results indicate a significant variation in performance between Aruba and Cisco Wi-Fi products. Customers are advised to exercise their own judgment before making a vendor decision for their Wi-Fi network. The rest of the document provides comprehensive details of the test cases, test bed setup, observations and results collected. Detailed configuration for both vendors is also included in the appendix for easy reference.

Wi-Fi Performance Benchmark Testing: Aruba Networks AP-135 and Cisco AP3602i

Aruba Networks, Inc. 5

Test Environment Table 2 Devices under test Vendor Device Firmwareversion

AP135 AOS6.1.3.2Aruba

MobilityController3600 AOS6.1.3.2

3602i 7.2.103.0Cisco

5508controller 7.2.103.0

The following table shows the detailed information on various network components that were part of the infrastructure used for performance tests. Table 3 Test equipment used

Item Component Specifications Details

1 WiFidevices Laptops MacBookPro(13) DellwithIntel6300chipset(47) DellwithIntel4905chipset(10)

Tablets iPad2

Bonjourservices AppleTV

2 Testtools PerformanceEvaluationSoftware

IxChariot VLCmediaserver AirVideoserver

3 Switch Type ArubaMobilityAccessSwitchS350048P

4 APmountingtype Type Ceiling

Test Bed Setup Figure 1 below shows the logical network topology of the test bed. All networking components were connected at Layer 2 using the Aruba S3500 Mobility Access Switch. The switch performed DHCP services providing IP addresses to devices connected to either the Cisco or Aruba setup.

Wi-Fi Performance Benchmark Testing: Aruba Networks AP-135 and Cisco AP3602i

Aruba Networks, Inc. 6

Figure 1: Test Bed Setup The controller configuration is included in the appendix for reference.

Wi-Fi Performance Benchmark Testing: Aruba Networks AP-135 and Cisco AP3602i

Aruba Networks, Inc. 7

Real World Test Scenarios Based on customer demand, the following real-world scenarios were tested in the proof-of-concept lab for benchmarking.

1. TCP throughput Determine the maximum throughput for the device at varying distances from the Access Point (AP)

2. Video density Determine maximum number of laptops and iPads without compromising HD video quality for varying video rates 2 Mbps multicast live HD video stream 5 Mbps multicast live HD video stream 1 Mbps unicast live HD video stream over iPad

3. Wi-Fi client density Determine video performance with a wide mix of clients supporting speeds from 11 Mbps to 450 Mbps Mixed traffic, mixed client density test

4. Battery drain test Determine impact on battery life while downloading large files Test both a Laptop and an iPad

1. TCP throughput The throughput tests were performed to understand how the distance of a client from the AP affects the clients performance. It is expected that the performance of the client will degrade as it moves away from the access point. MIMO effects also impact the throughput along with the channel model for the specific environment used for the test. In the actual test, a single client was tested for maximum throughput at three different non-line of site (NOS) locations: 30 feet, 70 feet and 120 feet from the AP. This was done to measure the benefits of ClientLink 2.0, if any, and compare the benefits of 4x4 MIMO vs. 3x3 MIMO at difficult-to-reach locations. TCP download traffic was used to highlight ability of the AP to transmit effectively to the client, and upload traffic was used to highlight the receive sensitivity of the AP. Additionally, client orientation was tested with a tablet (iPad), and the benefit of ClientLink 2.0 was isolated when enabled and disabled for Cisco. Table 4 TCP throughput test setup

ClientsusedfortestingAppleMacBookPro(1)

(3x3:3,450Mbps)

Toolsusedfortesting IxiaChariot,throughputscript

APoperationmode5GHzradio,same40MHzwidechannelusedforArubaandCisco

Wi-Fi Performance Benchmark Testing: Aruba Networks AP-135 and Cisco AP3602i

Aruba Networks, Inc. 8

Chart 1 TCP download

Chart 2 TCP upload

0

50

100

150

200

250

30 feet (NOS) 70 feet (NOS) 120 feet (NOS)

TCP Download

AP-135 Cisco 3602i w CL 2.0

0

50

100

150

200

250

30 feet (NOS) 70 feet (NOS) 120 feet (NOS)

TCP Upload

AP-135 Cisco 3602i w CL 2.0

13% Better

11% Better

Cisco cant connect

Cisco cant connect

Wi-Fi Performance Benchmark Testing: Aruba Networks AP-135 and Cisco AP3602i

Aruba Networks, Inc. 9

Chart 3 Tablet performance by orientation

Chart 4 Cisco ClientLink 2.0 / Beamforming on and off

TCP throughput results summary The tests demonstrate that the Aruba AP-135 performs better than the Cisco AP3602i. The AP-135 with 3x3 MIMO has a superior design and outperforms the pricier Cisco AP3600. Also Ciscos proprietary ClientLink 2.0 beamforming technology and 4x4 MIMO add little to no value for mobile clients, and in fact the Mac Book Pro laptop is unable to connect to the AP3602i at distances greater than 100 feet. The testing also showed that ClientLink 2.0 causes the throughput for the iPad to drop by 67% when orientation is changed from horizontal to vertical, and the throughput at 70 for a Macbook Pro was better when ClientLink 2.0 was disabled.

05

1015202530

Download Performance

Tablet (iPad) Orientation

AP 135 iPad Horizontal AP 135 iPad VerticalCisco 3602i iPad Horizonal Cisco 3602i iPad Vertical

507090

110130150170190210

30 feet (NOS) 70 feet (NOS) 120 feet (NOS)

Cisco vs. Cisco ClientLink (On vs. Off)

Cisco 3602i w

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.