B99990A Drive Test - s3.amazonaws.coms3.amazonaws.com/ss-infoshare/ranadvisor/B9990-90002_voice_mos... · The E6474A Drive Test solution is designed to allow benchmarking and qualification

B99990A Drive Test Voice Quality Test (VQT)

Release 20.1

Getting Started Guide

Viavi Solutions1-844-GO-VIAVIwww.viavisolutions.com

B99990A Drive TestVoice Quality Test (VQT)

Getting Started Guide

http://www.viavisolutions.com

http://www.viavisolutions.com

http://www.acterna.com

Voice MOS Test Getting Started Guide

Notices© Viavi Solutions Inc. 2016No part of this manual may be reproduced in any form or by any means (including electronic storage and retrieval or translation into a foreign language) without prior agreement and written consent from Viavi Solutions Inc. (”Viavi”) as governed by United States and international copyright laws.

Manual Part NumberB9990-90002

EditionMarch 2016E6474A Release 20.1 or later7 Lochside View EH12 9DH, Scotland, UK

WarrantyThe material contained in this document is provided “as is,” and is subject to being changed, without notice, in future editions. Further, to the maximum extent permitted by applicable law, Viavi Solutions Inc. (”Viavi”) disclaims all warranties, either express or implied, with regard to this manual and any information contained herein, including but not limited to the implied warranties of merchantability and fitness for a particular purpose. Viavi shall not be liable for errors or for incidental or consequential damages in connection with the furnishing, use, or performance of this document or of any information contained herein. Should Viavi and the user have a separate written agreement with warranty terms covering the material in this document that conflict with these terms, the warranty terms in the separate agreement shall control.

Technology Licenses The hardware and/or software described in this document are furnished under a license and may be used or copied only in accordance with the terms of such license.

Restricted Rights LegendIf software is for use in the performance of a U.S. Government prime contract or subcontract, Software is delivered and licensed as “Commercial computer software” as defined in DFAR 252.227-7014 (June 1995), or as a “commercial item” as defined in FAR 2.101(a) or as “Restricted

computer software” as defined in FAR 52.227-19 (June 1987) or any equivalent agency regulation or contract clause. Use, duplication or disclosure of Software is subject to Viavi standard commercial license terms, and non-DOD Departments and Agencies of the U.S. Government will receive no greater than Restricted Rights as defined in FAR 52.227-19(c)(1-2) (June 1987). U.S. Government users will receive no greater than Limited Rights as defined in FAR 52.227-14 (June 1987) or DFAR 252.227-7015 (b)(2) (November 1995), as applicable in any technical data.

Safety NoticesA CAUTION notice denotes a hazard. It calls attention to an operating procedure, practice, or the like that, if not correctly performed or adhered to, could result in damage to the product or loss of important data. Do not proceed beyond a CAUTION notice until the indicated conditions are fully understood and met.

A WARNING notice denotes a hazard. It calls attention to an operating procedure, practice, or the like that, if not correctly performed or adhered to, could result in personal injury or death. Do not proceed beyond a WARNING notice until the indicated conditions are fully understood and met.

AcknowledgmentsMicrosoft ® is a U.S. registered trademark of Microsoft Corporation.Windows ® and MS Windows ® are U.S. registered trademarks of Microsoft Corporation.MAYA44 USB ® and AUDIOTRAK ® are registered trademarks of Ego Systems, Inc.MOTU 24I/O™ is a trademark of MOTU, Inc.

Final Voice MOS Test Getting Started Guide Release 20.1March 2016 Document Num. B9990-90002 Page i

Contents

Contents i

Introduction 1

Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1

System Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1

Minimum PC Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

Commercial phone requirement to support VQT. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

Setup and Operation Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

License Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

License Requirement for Mobile System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

License Requirement for Office System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

Technical assistance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

Chapter 1 Setting Up 5

Setting up the Voice Quality Test Office System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

Installing the Voice Quality Test Office application . . . . . . . . . . . . . . . . . . . . . . . . . . 6

Uninstalling the Voice Quality Test Office application . . . . . . . . . . . . . . . . . . . . . . . 7

Setting up the hardware for Office System. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

Setting up the Voice Quality Test Mobile System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Installing the E6474A Wireless Network Measurements application . . . . . . . . . . 9

Installing the Voice Quality Test Mobile application . . . . . . . . . . . . . . . . . . . . . . . . 10

Setting up the hardware for Mobile System. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11Setting up the MAYA44USB/USBPLUS for phones that support 3.5mm audio port 11Setting up the MAYA44USB/USBPLUS Control Panel . . . . . . . . . . . . . . . . . . . . . . . . . .13Setting Up MOTU 24I/O with PCIe Card Bundle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13Setting Up the MOTU 24I/O PCI Audio Console. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15

Contents

Final Voice MOS Test Getting Started Guide Release 20.1Page ii Document Num. B9990-90002 March 2016

Configuring Software for Android Phones only . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16Installing and Configuring Caffeine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16Installing and Configuring Headset Toggle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Chapter 2 Measuring Voice Quality 19

Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Confirm your License Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

About Voice Quality Test (VQT) Office Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Part 1: Preparing VQT Office Utility for Central Office measurements . . . . . . . . . . . 21How to enable auto-run after a reboot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

Part 2: Preparing E6474A for Mobile Measurements (MOS and Delay Measurements)24Additional information and settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27

Part 3: Calibration of Signal level using MAYA44USB/USBPLUS . . . . . . . . . . . . . . . . . 28

Part 4: Measurement results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

Chapter 3 Measuring Voice Quality Without External Hardware 33

Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Supported Phones. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Prerequisites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Confirm Your License Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

On-Device Voice Quality Operation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Preparing E6474A for Mobile Measurements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

Chapter 4 Troubleshooting 39

Frequently Asked Questions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39Can a customized speech file be used to perform measurements? . . . . . . . . . . . . . 39What to do when there is an error message related to the reference speech? . . . 39How to test which is the ear port and mic port of the E6473B-88x cable?. . . . . . . 39Why is the equipment in the central office not picking up calls? . . . . . . . . . . . . . . .40Why is the file, mos_score.txt, not available after data collection? . . . . . . . . . . . . .40Continuous Synchronization Time-out error when I start Voice MOS testing . . . .40

Contact Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

Appendix A POLQA Agreement 43

Index 45

Final Voice MOS Test Getting Started Guide Release 20.1March 2016 Document Num. B9990-90002 Page 1

Introduction

The E6474A Drive Test solution is designed to allow benchmarking and qualification of voice quality over a cellular network using one of the following setups:• Mobile to Mobile (using either MAYA44USB/USBPLUS or MOTU 24IO)• Mobile (using either MAYA44USB/USBPLUS or MOTU 24IO) to PSTN

The information in this guide contains important details about setting up the system to run measurements.

FeaturesThe Voice Quality Test system supports the following features:• Scalable system capable of measuring up to four channels when using MAYA44USB/USBPLUS and eight

channels when using MOTU 24I/O• Calls initiated and ended by independent channels• Measurement of downlink and uplink MOS (Mean Opinion Score)• Mobile-originated calls (MOC)• Mobile terminated calls (MTC)• Mobile-to-Mobile voice quality testing (M2M)• Mobile-to-PSTN voice quality testing• Easily configured call duration• Supports ITU-T’s P862/P862.1 PESQ/LQO algorithm and ITU P.862.3 POLQA algorithm for Voice MOS

measurement - This feature measures a processed Speech Reference file against the recorded audio signal.

• Time-stamped MOS results• Measurement of One Way Audio Delay - This feature measures the one-way audio propagation delay

between the source and destination handsets on VoLTE, UMTS, GSM and CDMA networks.

System ComponentsThe VQT Mobile Software solution consists of the following system components:• B9990A-200 Mobile Waveform Software, single phone PESQ

IntroductionSetup and Operation Overview

Final Voice MOS Test Getting Started Guide Release 20.1Page 2 Document Num. B9990-90002 March 2016

• B9990A-300 Mobile Waveform Software, multi-phone PESQ upgrade• B9990A-230 Mobile Waveform Software, POLQA Base for up to 2 channels• B9990A-231 Mobile Waveform Software, POLQA Quad upgrade from 2 to 4 channels• B9990A-232 Mobile Waveform Software, POLQA Hexa upgrade from 4 to 6 channels• B9990A-233 Mobile Waveform Software, POLQA Octa upgrade from 6 to 8 channels• B9990A-400 Office Unit Voice Quality Test• PCs (desktop or notebook) for system control and data mining. One is required in the central office and

another in the mobile van.• E6473B-885 - The E6473B-885 cable supports 3.5mm audio port. It has 3 RCAs representing two ears,

and one mic. You can use either of the ear RCAs.

Refer to “Frequently Asked Questions" on page 39 to verify which is ear and which is mic RCA.

The Central Office VQT solution consists of the following system components:

• B9990A-400 Office Unit Voice Quality Test, PESQ with 4 PSTN line• B9990A-430 Office Unit Voice Quality Test, PESQ with 8 PSTN line• B9990A-440 Office Unit Voice Quality Test, POLQA with 8 PSTN line• B9990A-441 Office Unit Voice Quality Test, POLQA upgrade from PESQ to add POLQA capability

Minimum PC SpecificationsRefer to the E6474A User’s Guide (E6474-90090) for details on the minimum and recommended PC specifications.

Commercial phone requirement to support VQT• Modem port - The modem port should be able to accept following AT commands - ATD to dial a call, ATS0

for auto answering, AT+CLCC to poll the phone call operation status after test starts, AT+CHUP to terminate phone call when call duration is reached, or when drive test stops.

• 3.5 mm audio jack for the audio cable. The phone should be able to go into the headset mode using an audio cable.

Setup and Operation OverviewThe setup and operation of the measurement system may differ slightly for each usage scenario. In general, the setup and operation consist of these stages:• Hardware connections• Software installation• Measurement configurations • Measurement executions & results viewing

NOTEPCs are supplied for the office option.

IntroductionLicense Requirements


License Requirements

License Requirement for Mobile SystemNote: The licenses listed in the tables are for enabling the Voice Quality measurements to work with the E6474A application.

The table below shows the license requirement for devices supporting PESQ algorithm.

The table below shows license requirement for devices supporting POLQA algorithm. To support seven or eight devices for POLQA algorithm, you will need all the licenses to support six devices and also Voice Quality POLQA Octa license.

License Requirement for Office SystemThe following licenses are needed to enable the Voice Quality measurements to work with the Voice Quality Test Office application:

• POLQA for Central Office license for one or more telephony lines running POLQA. • Single Phone VQT license for one or more telephony lines running PESQ.

Technical assistanceIf you require technical assistance, call 1-844-GO-VIAVI (1.844.468.4284).

For the latest TAC information, go to http://www.viavisolutions.com/en/services-and-support/support/technical-assistance.

License 1 device 2 or more devices (max 8)

Single Phone VQT license Yes Yes

Multiple Phone VQT license No Yes

Multiple Phone Support license No Yes

License one device

two devices

three devices

four devices

five devices

six devices

sevendevices

eight devices

Voice Quality POLQA Base license Yes Yes Yes Yes Yes Yes Yes Yes

Voice Quality POLQA Quad license No No Yes Yes Yes Yes Yes Yes

Voice Quality POLQA Hexa license No No No No Yes Yes Yes Yes

Voice Quality POLQA Octa license No No No No No No Yes Yes

Multiple Phone Support license No Yes Yes Yes Yes Yes Yes Yes

IntroductionTechnical assistance



1

Chapter 1 Setting Up

This chapter describes the setup of the hardware and software in the Mobile Voice MOS Test Software system. It provides configuration information for two audio acquisition tools--the MAYA44USB/USBPLUS hub and the MOTU 24I/O with PCIe card bundle.

This chapter includes the following sections:

• “Setting up the Voice Quality Test Office System" on page 5• “Setting up the Voice Quality Test Mobile System" on page 8

Setting up the Voice Quality Test Office SystemNote: You may skip this section and see “Setting up the Voice Quality Test Mobile System" on page 8 to test mobile to mobile voice quality.

The Voice Quality Test Office system is used to test the voice quality through PSTN. In order to setup system, you need the following software and hardware components

Software

The Voice Quality Test installation package. This contains the telephony card driver.

NOTE:The Voice Quality Test Office license uses the E6474A License Manager. The applica-tion checks for the Single Phone VQT license for PESQ and POLQA for Central Office license for POLQA. The Waveform Analyzer checks for either Single Phone VQT or VQT POLQA Base or POLQA for Central Office license.

Chapter 1 Setting UpSetting up the Voice Quality Test Office System


Hardware • PC with a PCI slot• Telephony card• RJ14 to RJ11 splitters • RJ11 Phone cables

The Voice Quality Test Office software is installed and pre-configured on your PC. By default, the system is supplied with the following Windows® login and password:

Login: JDSU

Password: jdsu1234

The PC is supplied with a fully configured and working PCI audio card. When your PC starts, the operating system checks all the hardware and drivers.

You can use the following procedure if the application or the driver has to be reinstalled. Contact your local Wizard sales representative if you have any problems with the system.

Installing the Voice Quality Test Office applicationThe Voice Quality Test software solution consists of the Waveform Analyzer software and Voice Quality Test Office Utility applications.You need to set up the license key to install the office application. See the “License Requirements" on page 3.

To install the Voice Quality Test Software solution:

Do This Notes

1 Download the installer from the FTP site provided by Wizard or run the installer from the DVD shipped by Wizard .

2 Run setup.exe. You will see E6474A Voice Quality Test installation wizard.

The following installation dialog box appears (see below).

Chapter 1 Setting UpSetting up the Voice Quality Test Office System


Uninstalling the Voice Quality Test Office application1 Click Start > Settings > Control Panel > Add or Remove Programs.2 Select E6474A Voice Quality Test.3 Click Remove.4 Click Yes to confirm removal.

Setting up the hardware for Office SystemThe diagram below shows the Voice Quality Test Office equipment with a single telephony card that supports 4 channels. The Voice Quality Test Office equipment can support either 4 channels or 8 channels.

To set up the equipment:

• Connect the PC’s RJ14 ports to the PSTN via RJ14 to RJ11 splitter as shown in the diagram.

3 Step through the installation screens until you see the option for Mobile or Office installation.


4 Select Office to Install Voice Quality Test software. Follow the installation instructions. Use the default directories.

NOTE:Only the analog phone line should be used. The system does not work with digital telephone lines.

Write down the phone number of each line.

Chapter 1 Setting UpSetting up the Voice Quality Test Mobile System


Figure 1 Voice Quality Test Office configuration

Setting up the Voice Quality Test Mobile SystemThe Voice Quality Test Mobile system is used to test the voice quality for mobile commu-nication using MAYA44USB/USBPLUS or MOTU 24I/O. In order to setup the Voice Quality Test Mobile system, you need the following software and hardware components.

Software• The Voice Quality Test Mobile installation package. This contains the MAYA44USB/USBPLUS driver when

you select the Mobile option.• E6474A Wireless Network Measurement application. • Headset Toggle app. See “Installing and Configuring Headset Toggle" on page 17.

Hardware • MAYA44USB/USBPLUS or MOTU24I/O (Supports only MOS measurements but not mouth to ear delay

feature)• Ground Loop Isolator, Model# AP3054, for MAYA44USB/USBPLUS• E6473B-885 - The E6473B-885 cable has a 3.5mm audio port. It supports the OMTP standard. It has 3

RCAs representing two ears, and one mic. You can use either of the ear RCAs.Note: Refer to “Frequently Asked Questions" on page 39 to verify which is ear and which is mic RCA.

NOTE:

The office PC supplied by Wizard is configured with a Windows operating system.

PSTN

PC fitted with audio card

RJ14 to RJ11x2

RJ14 to RJ11x2

Analog phone lines x 4



• Phone - For MOS measurements, you can have either one or two or any number of devices that is supported by a MAYA or MOTU device. For the mouth to ear delay measurement feature, you need at least 2 phones, connected to a single system.The Caller shall act as master and controls all aspects of the measurement during the voice call. The Callee is a passive slave that does not need to do anything during the voice call. The master controls the audio playback and record operation for both the phones.

Supported Phones - Refer to the Supported Phones Capabilities in the E6474A Supported Phone & Device List for the devices supporting the voice quality test and for the prerequisites.

The figure below shows the OMTP standard audio jack.

The figure below shows the CTIA standard audio jack.

Installing the E6474A Wireless Network Measurements applicationTo use the MAYA44USB/USBPLUS for testing mobiles, you need to install the E6474A Wireless Network Measurement application. Refer to the E6474A Drive Test User’s Guide for information on installation and configuration.



Installing the Voice Quality Test Mobile applicationYou need to install the software and set up the license key for the client PCs. See “MOTU 24I/O PCI Audio Console Configuration" on page 16. Each PC requires a separate copy of the Voice Quality Test Mobile application.

To install the application:

Do This Notes

1 Download the installer from the FTP site provided by Wizard or run the installer from the DVD shipped by Wizard .

2 Run setup.exe. You will see E6474A Voice Quality Test installation wizard.


3 Select the Mobile installation option. The following installation dialog appears (see below).

4 Follow the installation instructions. Use the default directories



Setting up the hardware for Mobile SystemThis section gives directions for both the MAYA44USB/USBPLUS and the MOTU 24I/O with PCIe card bundle.

MAYA44USB/USBPLUS is a portable audio interface with a USB connection that provides 4 analog input and 4 analog output channels plus a stereo digital output and amplified headphone output.

By default, Wizard sells VQT with the MAYA44USB/USBPLUS, which allows support for four phones. If you want to have support for eight phones as well as the auto-calibration feature, you need to purchase the MOTU 24I/O.

Setting up the MAYA44USB/USBPLUS for phones that support 3.5mm audio port

Hardware and Software Components

• PC with Windows 7 OS and E6474A application installed• MAYA44USB/USBPLUS• Ground Loop Isolator, Model# AP3054

Note: You must include the Ground Loop Isolator when connecting the MAYA44USB/USBPLUS. Using this device in the connection gives you better noise immunity during testing, and provides more accurate test results.

• E6473B-885 cable - The cable supports 3.5mm audio port. It has 3 RCAs representing two ears, and one mic RCA. You can use either of the ear RCAs.

Refer to “Frequently Asked Questions" on page 39 to verify which is ear and which is mic RCA.

To set up a phone with MAYA44USB/USBPLUS:

1 Connect the MAYA44USB/USBPLUS to the PC using the USB cable.Note: When you install the Voice Quality Test Mobile application, the driver for MAYA44USB/USBPLUS is also installed.

2 Connect the phone to the PC using the E6473B-885 cable.3 Connect the ear RCA of the E6473B-885 cable to the ear jack of the Ground Loop Isolator and the mic

RCA of the E6473B-885 cable to mic jack of the Ground Loop Isolator. 4 Connect the ear plug of the Ground Loop Isolator to the Channel 1 Input of the MAYA44USB/USBPLUS

and mic plug of the Ground Loop Isolator to the Channel 1 output of the MAYA44USB/USBPLUS.Note: If you are using multiple devices, you can repeat the connection for other channels.Refer to “Frequently Asked Questions" on page 39 to verify which is ear and which is mic RCA.



Figure 2 Typical one-phone configuration with MAYA44USB/USBPLUS and Ground Loop Isolator

If you are using a MAYA44USB and an USB Isolator, refer to the below setup diagram.

Figure 3 One Phone Configuration with MAYA44USB and USB Isolator



Setting up the MAYA44USB/USBPLUS Control Panel

The MAYA44USB/USBPLUS Control Panel needs to be configured to provide the cali-brated audio support for mobile voice quality testing. The following settings should be made before any voice Quality tests are run.

1 Select Start > All Programs > Viavi Solutions > E6474A > Utilities > MAYA44USB/USBPLUS Control Panel.

2 Select the Config menu and set as follows • Latency: 512• BufferNumber: 2• SampleRate: 48000 Hz

Figure 4 MAYA44USB Control Panel

Setting Up MOTU 24I/O with PCIe Card Bundle

Note: MOTU 24I/O is an alternative to MAYA44USB/USBPLUS. MAYA44USB/USBPLUS supports four phones. If you want to have support for eight phones as well as the auto-calibration feature, you must use MOTU 24I/O.

MOTU 24I/O connects to a PCI express card (known as PCIe-424) using audio wire. Analog audio is sent between the handset and MOTU 24I/O.

The following are the main benefits of using MOTU24I/O:

• MOTU 24I/O supports up to 8 channels or devices• MOTU 24I/O allows the automatic adjustment of amplitude to match speech reference wave file. In other

words, it supports auto-calibration.

Hardware Components

The hardware pieces in Figure 5 on page 14 make up the minimum configuration to support testing with one handset. Currently, the MOTU 24I/O may support up to eight handsets for voice quality measurement.



Figure 5 Required Hardware for MOTU 24I/O with PCIe Card Bundle

The Rolls Promatch MB15b is an audio isolator (see Figure 5 on page 14) that works with Samsung and Nokia handsets.

See the table below for the minimum hardware configuration.

If you are using the MOTU 24I/O with the PCIe card bundle to acquire audio, perform the following steps. See Figure on page 15 for setup.

1 Install the hardware and drivers according to the directions in pages 24-32 of the MOTU PCI-4 24 User’s Guide for Windows, available at the MOTU website at http://www.motu.com/techsupport/manuals. See Figure 5 on page 14 for the hardware pieces required to use MOTU 24I/O as an audio acquisition tool with the Mobile Voice MOS Test Software system.Note: Ensure that the audio wire cable from MOTU 24I/O device is connected to the port near the serial port on the PCIe card of your PC.

2 Connect the 1/4" TRS male patch cable to the analog input and output of the Channel 2 of the MOTU 24I/O. If you are using additional phones then insert the 1/4" TRS male patch cable to the analog input and output of even channel numbers i.e. Channels 4, 6, 8, etc. of the MOTU 24I/O.

3 Connect the plug (male) end of the XLR plug 1/4" TRS cable to the +4 dB IN (Left) of the Rolls Promatch MB15b and the TRS portion to the Audio Out, Channel 1 of the MOTU 24I/O. If you are using an additional

Hardware Quantity/ device

Quantity for 2 devices





Quantity for 7devices


MOTU 24I/O with PCIe card bundle

1 1 1 1 1 1 1 1

¼” TRS male patch cable 1 2 3 4 5 6 7 8

XLR plug to ¼” TRS cable 1 2 3 4 5 6 7 8

XLR jack to ¼” TRS cable 1 2 3 4 5 6 7 8

Rolls Promatch MB15b 1 1 2 2 3 3 4 4

Headset to RCA cable 1 2 3 4 5 6 7 8

Audio Wire Cable 1 1 1 1 1 1 1 1

Power Cable 1 1 1 1 1 1 1 1



phone then connect the plug (male) end to the +4 dB IN (Right) of the Rolls Promatch MB15b and TRS Portion to the Audio Out, Channel 3 of the MOTU 24I/O.

4 Connect the jack (female) end of the XLR plug 1/4" TRS cable to the +4 dB OUT (Left) of the Rolls Promatch MB15b and the TRS portion to the Audio IN, Channel 1 of the MOTU 24I/O. If you are using an additional device then connect the jack (female) end of XLR to the +4 dB OUT (Right) of the Rolls Promatch MB15b and TRS portion to the Audio IN, Channel 3 of the MOTU 24I/O.

5 Connect the ear RCA of the E6473B-88x cable to the -10 dB RCA In at the top of the Rolls Promatch MB15b, connect the mic RCA to the -10 dB RCA Out at the top and connect the phone audio connector of the E6473B-88x cable to the phone. If you are using an additional device, connect the ear RCA of the E6473B-88x cable to the -10 dB RCA In at the bottom of the Rolls Promatch MB15b, connect the mic RCA to the -10 dB RCA Out at the bottom and connect the phone audio connector of the E6473B-88x cable to the phone.

6 Connect the phone to the PC using a phone USB cable.7 After configuring the hardware connections, configure E6474A software as described in “Part 2: Preparing

E6474A for Mobile Measurements (MOS and Delay Measurements)" on page 24.

Figure 6 Setting Up Motu 24 I/O

Setting Up the MOTU 24I/O PCI Audio Console

Follow the steps below:

1 Select Start > MOTU > MOTU PCI Audio Console.2 Enter information for MOTU 24I/O as described in the table below. See Figure 7 on page 16.

Field Name Value

Sample Rate 48000

Samples per Buffer 2048

Clock Source PCI-424: Internal

Configure Interface 24IO



Figure 7 MOTU 24I/O PCI Audio Console Configuration

Configuring Software for Android Phones only

Installing and Configuring Caffeine

It is highly recommended to install caffeine, to prevent the phone from sleeping and allowing it to dial any time.

Enable Routing Check Enable Routing to expand the window where you can enable or disable individual inputs and outputs. If you are not sure, keep them all enabled. See Quick Reference: PCI Audio Console Window on page 15 of PCI-424_User_Guide_Win.pdf. You can download this document from the MOTU website at: http://www.motu.com/techsupport/manuals

Bank A Analog

Field Name Value



• Go to the Google Play website and install Caffeine (Syntaxa Inc.). After installing the application, configure the settings as displayed below:

Figure 8 Configure Caffeine setting

Installing and Configuring Headset Toggle

You must install the Headset Toggle app on your mobile device to route the phone call audio to the audio capturing devices like MAYA44USB/USBPLUS and MOTU24I/O. See Supported Phones in “Setting up the Voice Quality Test Mobile System" on page 8 to identify which device needs the Headset Toggle application.Note: If you have installed SoundAbout PRO or any third party app to force audio through the headset, you must uninstall the app first before installing the Wizard Headset Toggle application.

1 Go to the C:\program files (x86)\Agilent Technologies\E6474A-X\Utilities directory.2 Copy Headset-Toggle.apk to your device storage card.3 Run the apk and click Install when prompted.

After installing the application, configure the Headset Toggle settings as shown below:

1 Go to the device Apps.2 Select Headset Toggle.



3 Enable Force Using Headset.

Note: After the test, you can disable the setting to use the phone in the normal mode.

4 [Optional] Turn ON the Auto Answer setting if you want the device to auto answer the incoming call. By default, it is turned Off. This option is selected if you select Phone Settings in the Call Control test, Answering Method properties in the E6474A application.


2

Chapter 2 Measuring Voice Quality

This chapter describes how to measure voice quality using the Voice Quality Test software and has the following sections:

• “Part 1: Preparing VQT Office Utility for Central Office measurements" on page 21• “Part 2: Preparing E6474A for Mobile Measurements (MOS and Delay Measurements)" on page 24• “Part 3: Calibration of Signal level using MAYA44USB/USBPLUS" on page 28• “Part 4: Measurement results" on page 30

OverviewThe measurement of mobile network voice quality makes use of two separate sets of equipment.

• Voice Quality Test Mobile equipment.• Voice Quality Test Office equipment.

Based on individual requirements, you need to configure parameters on both systems using the Voice Quality Test (VQT) Office Utility, Voice Quality Test Mobile System prior to running measurements. See “Setting Up" on page 5.

Once the system has been set up, the central office subsystem will be in the slave/stand-by mode, and the mobile subsystem will be the master controlling the execution of measurements.

Wizard recommends that you review the section “Part 4: Measurement results in this chapter before you start measurements.

Before using the software, ensure that you have the necessary licenses listed in “License Requirements" on page 3.

Chapter 2 Measuring Voice QualityOverview


Confirm your License OptionsTo check your license options:

Select Start > Viavi Solutions > E6474A > Utilities > License Manager.

The License Manager screen appears listing the detected license options. If you do not see any license options in this screen, check that you have a valid license key properly attached to your system or software licenses from a software license server.

About Voice Quality Test (VQT) Office Utility The VQT Office Utility allows you to configure parameters or start testing at the central office (server) part of the system.

Note: Skip this section if you are testing the voice quality using Mobile to Mobile.

Figure 9 Mobile Voice MOS Test Software Office Utility

Synchronization Timeout

Specify location of MOS results and archiving measurements

Browse for reference speech file

Configurable channel name(To enable post-process merge with trace data)

Begin/Terminate measurement

Save parameters for future use, VQT tasklist will be created as well

Chapter 2 Measuring Voice QualityPart 1: Preparing VQT Office Utility for Central Office measurements


Part 1: Preparing VQT Office Utility for Central Office measurements

Figure 10 VQT sample uplink parameters1 To start Wizard Voice Quality Office Test utility, select Start > All Programs > Viavi Solutions > Voice Qual-

ity Test Office.2 Activate the desired test channel by selecting its corresponding check box.

3 Select the reference speech file. It is recommended to use speech material located under the folder, C:\Program Files\Agilent Technologies\E6474A-X\Data\Wav. Select from the desired PESQ or POLQA speech material.

If you want to user your own custom wave file, it should be 16 bit PCM mono, at a sampling rate (8000 Hz for PESQ or 8000/16000/48000 Hz for POLQA) defined in the Call Control test property, and between 6 to 10 seconds in duration.

4 Select PESQ or POLQA algorithm.5 Enter a sync time out period. The application will timeout if there is no sync between the recorded audio

and the referenced speech within the mentioned time e.g. 20 sec. If the recorded file is not able to sync,

NOTE:

When the Channel LED is green, then the telephony line is connected. When the Channel LED is red, then the telephony line is unplugged or faulty. When the Channel LED flashes green, then the telephony line is connected and a call is in progress.



then the application renames the recorded wave file to a diagnostic file name. But if it is able to sync with the reference file, then the application appends a MOS value to the recorded file name.

6 Define a output folder for each channel. Each folder will store the recorded speech and MOS result file for the individual channel.

7 Select the Options button to edit the impedance settings and to delete the audio files that exceed the MOS threshold. Check with your local phone-line provider to verify the line impedance used.

Figure 11 Setting the line impedance8 Click Save Settings to save the changes.9 Click START TEST. When you click START TEST, the application gets ready to detect the incoming calls

and perform measurements during the call. These measurements are saved in the output folder defined in the Voice Quality Test Office Utility dialog box.

10At any point of time, or upon completion of measurement, click STOP TEST to stop the measurement.

How to enable auto-run after a reboot

The Voice Quality Test Office Utility may be configured as a startup program when your Windows operating system starts and logs you in. If measurements are to be made auto-matically after a reboot of your PC, the operating system needs to have the auto-login enabled.

The following procedure outlines this process:

1 Enable the “Execute upon program startup” option in the Options dialog box. Select Options button to open this dialog box.

2 Close the dialog box and save the settings.3 Configure your PC to perform an auto-login:

Select Start > Run and type “CONTROL USERPASSWORDS2”. This opens the User Accounts dialog box.

NOTE:

Wizard highly recommends that you use the default 20 secs time-out between each measurement.

NOTE:

Do not use a directory name with space.



Figure 12 Open User Accounts dialog boxSelect the “JDSU” account and uncheck “User must enter a user name and password to use this com-

puter” option.

Figure 13 Set password requirementWhen prompted, type the default password “JDSU” that is be used for auto-logon.

Figure 14 Confirm password

NOTE:

To revert to the normal Windows logon procedure, enable the “User must enter a user name and password to use this computer” option.

Chapter 2 Measuring Voice QualityPart 2: Preparing E6474A for Mobile Measurements (MOS and Delay Measurements)


Part 2: Preparing E6474A for Mobile Measurements (MOS and Delay Measurements)

1 Run the E6474A application. (Refer to the E6474A Drive Test User’s Guide and online help for more infor-mation).

2 Add the device to the hardware panel and configure the trace port based on the device.3 Add a parallel sequence node in the Sequencer Panel. (refer to Figure 15).

Figure 15 Parallel Sequence example4 Add the device to the parallel sequence.5 Add a call control test under the device.6 If you are testing from mobile to office, configure the call control test properties for the mobile device initiat-

ing the call as described in step 7. If you are testing from mobile to mobile, configure the call control test properties for both the initiator and the receiver as described in step 7.

7 Check that the sequence nodes and tests are configured with these properties. Refer to the Online Help for details about the Call Control Test properties.

• Call Control Test - Call Initiator (see Figure 16).

Figure 16 Call Control Test Properties - Initiator - Auto Dial

Inter call idle time (seconds) = 40This is the time between each measurement session/call to be initiated by the application. 40 seconds is a safe duration to ensure that the office unit recovers from an abnormal call, and is ready to



make measurements again.Dial or Answer = Auto DialAnswering Phone: If you want the terminator to end the call, select the answering phone from the list. Immediate Dial = YESCall Duration = 200 or above

It is recommended to establish a call with the minimum 200 seconds when running the Voice Quality Test. This allows several MOS to be collected and obtain meaningful measurement results for each call session.

Continuous Call = NOCall Setup = 20Call Number: Enter an appropriate call numberCOM Port: Select the correct call COM port based on the device.Voice Quality Test = Select Voice MOS Test to configure MOS measurements (see Figure 17 on page 25).

If you are configuring Delay Measurements, select Mouth to Ear Delay (see Figure 18 on page 26) .

Figure 17 Voice Quality Test: Voice MOS TestVoice Quality Test Device = Select MAYA44USB/USB+ or MOTU PCI.Voice MOS Sampling Rate [Hz] - Select one of the following:• 8000 - If you are testing on a traditional network (i.e. non-Wideband), select 8000 as the sampling rate.• 16000 or 48000 - If you are testing on a HD Voice or VOLTE network (AMR Wideband), select either

16000 or 48000 as the sampling rate depending on the network capability.Speech Reference File - Select the speech reference file based on the Voice MOS Sampling Rate.• 8000 Hz is referred as NB in the speech reference file name• 16000 Hz is referred as WB in the speech reference file name, and• 48000 Hz is referred as SWB in the speech reference file nameChannel - Select the audio channel for the MAYA44USB/USBPLUS or MOTU 24I/O. This property is appli-

cable for MOS measurements.• MAYA44USB/USBPLUS can be channel 1 to 4• MOTU24I/O can be channel 1 to 8

Note: You must select channel number 2 to connect to the second phone. The channel number 2 in the application corresponds to channel number 3 in the hardware device, since each pair of channel corresponds to a single bus on the MOTU device.



Figure 18 Voice Quality Test: Mouth to Ear Delay Mobile Originated Channel - This property is applicable when you select Mouth to Ear Delay Test as Yes.

Enter the desired channel number. For example, if you have connected the Caller phone to channel 2 on the audio hardware device, enter Mobile Originated Channel as 2.

Mobile Terminated Channel - This property is applicable when you select Mouth to Ear Delay Test as Yes. Enter the desired channel number. For example, if you have connected the Callee phone to chan-nel 3 on the audio hardware device, enter Mobile Terminated Channel as 3.

Dialing method -Select a method to control the Mobile Originated call. If the Call Control test is set to CSFB (Circuit Switched Fallback) then the system checks if the originating mobile is in LTE mode before it is allowed to dial. Note: This method is applicable only for Qualcomm devices.

• 3GPP ATD: AT commands are used to control the phone to originate a call or hang up a call. • Keypad Emulation: Qualcomm keypad press emulation commands are sent to the phone to originate a

call or hang up a call. This method works on most of the feature phones with a physical keypad but does not work on most of the smart phones.

• QC Call Origination Request: Qualcomm trace commands are sent to the phone to originate a call or hang up a call.

• ADB: ADB (Android Debug Bridge) commands are sent to the phone to originate a call or hang up a call. This method works on the supported Android smart phones. If you are testing using the Samsung Galaxy SIII (SGH i9305), do not use this method. Refer to the 18.1 Release Notes for the proper method.

Set the other properties for the Voice Quality Test according to your network and test requirements.

• Call Control Test - Call Receiver (refer to Figure 19)

Figure 19 Call Control Test Properties - Receiver - Auto Answer

Dial or Answer = Auto Answer



Voice Quality Test = Select Voice MOS Test to configure MOS measurements. If you are configuring Delay Measurements, select Mouth to Ear Delay.

Voice Quality Test Device = Select MAYA44USB/USBPLUS or MOTU PCI.Voice MOS Sampling Rate [Hz] - Select one of the following:• 8000 - If you are testing on a traditional network (i.e. non-Wideband), select 8000 as the sampling rate.• 16000 or 48000 - If you are testing on a HD Voice or VOLTE network (AMR Wideband), select either

16000 or 48000 as the sampling rate depending on the network capability.Speech Reference File - Select the speech reference file based on the Voice MOS Sampling Rate.• 8000 Hz is referred as NB in the speech reference file name• 16000 Hz is referred as WB in the speech reference file name• 48000 Hz is referred as SWB in the speech reference file nameChannel - Select the audio channel for the USB audio device or MOTU PCI.• MAYA44USB/USBPLUS can be channel 1 to 4• MOTU24IO can be channel 1 to 8

Note: You must select channel number 2 to connect to the second phone. The channel number 2 in the application corresponds to channel number 3 in the hardware device, since each pair of channel corresponds to a single bus on the MOTU device.

Answering Method - Select an Answering Method as listed below. The property Answering Method lists the ways to control the Mobile terminated call.

• AT Command: The default method is set as AT Command. An AT command is sent to enable auto answer at the beginning of MT call control and a command to disable it at the end of the test. If the Answering Method is set to AT Command, select a proper modem port or AT command port in the property COM Port.

• ADB: An ADB (Android Debug Bridge) command is sent to pick up the incoming call during the MT call control. The ADB command is actually a key event. If the key event does not trigger the pick up then the command is re-sent. If you are testing using the Samsung Galaxy SIII (SGH i9305), do not use this method. Refer to the 18.1 Release Notes for the proper method.

• Phone Settings: Since there are some auto-answer settings outside the MT call control, the MT call control does not send any command to control the phone. It only monitors call progress and state change.

Set the other properties according to your network and test requirements. 8 In the Sequencer window, activate the desired test by selecting its corresponding check box. By default,

the test is activated when you add the test under the device.

One major advantage in using E6474A sequencer is the ability to automatically redial an individual channel upon a dropped call.

9 Prepare the output view by dragging the data items to views such as bar chart, Grid, Map, etc. 10 On the toolbar, start logging in the E6474A software.

At the end of measurements, the status panel will display task status. Upon completion of measurement iterations for all activated channels, MOS results will be automatically generated.

Additional information and settings

The Voice MOS Warning message is a useful data item that can help you set your audio configuration. The data item can be best displayed using a grid view (refer to Figure 20).

Chapter 2 Measuring Voice QualityPart 3: Calibration of Signal level using MAYA44USB/USBPLUS


Figure 20 Voice MOS Warning Message

A warning message is only displayed if the audio amplitude is too loud or too soft and the MOS is affected. For example, if the audio is too soft, the message displays “Soft audio detected with 43.78dB loss”.

You should increase the gain to optimize the MOS measurement. Start with 50% amplitude for MAYA input and output volume, which is set in the ASIO Control Panel.

With MOTU PCI, you can enable the auto calibration feature and run one round of auto calibration before doing an actual measurement.

You should use the maximum volume on the phone.

Part 3: Calibration of Signal level using MAYA44USB/USBPLUSNote: Skip this section if you are using MOTU24I/O since it supports auto calibration.

Measurement may normally be performed at the recommended settings for the ASIO USB control application; refer to “Setting up the MAYA44USB/USBPLUS Control Panel" on page 13. However, the attenuation or boosting of voice amplitude may occur along the communication network (which includes the mobile handset), such that the undesirable low SNR (signal-to-noise-ratio) or clipping occurs. Hence, it may be necessary to adjust the gain setting for downlink (ear gain) or uplink (mouth gain).

To verify if calibration is necessary

1 Start the measurement by logging in E6474A and let it run for about 3 minutes before terminating mea-surement. See Step 10 of “Part 2: Preparing E6474A for Mobile Measurements (MOS and Delay Measurements)" on page 24.

NOTE:

For MOTU equipment, the available auto calibration feature in E6474A allows you to bypass amplitude issues. Auto calibration is only available with MOTU24IO and should not be enabled when performing the actual MOS measurement.

Chapter 2 Measuring Voice QualityPart 3: Calibration of Signal level using MAYA44USB/USBPLUS


2 Start the Waveform Analyzer application by selecting Start > All Programs > Viavi Solutions > E6474A > Utilities > Waveform Analyzer.

Figure 21 Waveform Analyzer user interface3 Browse and locate your reference wave file. This location should be same as the one defined in the

E6474A > Call Control Test properties. See step 7 of “Part 2: Preparing E6474A for Mobile Measurements (MOS and Delay Measurements)" on page 24.

4 Browse and locate your test wave file located in the folder defined in the E6474A > Call Control Test properties. See step 7 of “Part 2: Preparing E6474A for Mobile Measurements (MOS and Delay Measurements)" on page 24.

5 Select the Voice MOS Algorithm as PESQ or POLQA.6 Select the Voice MOS Sampling rate. For PESQ, the sampling rate is fixed to 8000Hz. For POLQA, you

must set the same sampling rate as set in the Call Control Test properties, E6474A application.7 Select the Calculate button. You will see the waveform comparisons and a calculated MOS value

(Figure 21).

For good results, a test (measured) waveform’s peak is normally within 4 dB of the reference waveform’s peak.

To zoom into the waveform display, click in the white area.8 If the test waveform is outside the 4 dB range, adjust the Input and Output Control sliders on the

MAYA44USB/USBPLUS Control Panel. See “Setting up the MAYA44USB/USBPLUS Control Panel" on page 13.

Chapter 2 Measuring Voice QualityPart 4: Measurement results


Figure 22 MAYA44USB/USBPLUS Control Panel adjustments

Both the INPUT (ear) and OUTPUT (microphone) sliders need to be calibrated. The INPUT (ear) calibration affects the downlink quality (mobile side of the system). The OUTPUT (microphone) calibration affects the uplink quality (central office side of the system).

Wizard recommends that the volume levels of the phone should be set around the middle of their range, then the levels adjusted using the MAYA44USB/USBPLUS Control Panel.

Part 4: Measurement resultsWhen you perform a mobile to PSTN call, the system performs the downlink measurement at the mobile site and performs the uplink measurement at the office site. When you perform a mobile to mobile call, the system displays only the downlink measurement, but not the uplink measurement.

A downlink measurement is the transmission path from the base station to the mobile device. An uplink measurement is the transmission path from the mobile device to the base station.

Downlink results are stored in the recorded data file in the E6474A application. You can view the measurement results from the E6474A application menu View > System Panel > Data items for both PESQ and POLQA algorithm. You can search for the measurement results in the data items panel and drag it to a desired view. The recorded speech samples



and the VQT log files are archived in the work directory that was defined in the test prop-erties in the E6474A application.

Figure 23 Data items that can be added to views

For description of the measurement results, select the data item and click Help > Dynamic Help.

Uplink MOS results for PESQ and POLQA algorithm can be found in the “mos_score.txt” file which is located in the output folder for each channel when you run the Voice MOS Test Office application.

As the results are time-stamped for both downlink and uplink MOS, it is recommended that you manually time-sync the clock for both mobile and CO control PC.



Detailed test results can be displayed during the test using a grid, chart and map view. Refer to Figure 23 on page 31 and Figure 24 on page 32 for examples of data used and data collected.

Figure 24 Chart View example


3

Chapter 3 Measuring Voice Quality Without External Hardware

This chapter describes how to measure voice quality without the use of external sound card hardware. In this case the voice MOS is performed on the UE device and the measurement results are transferred back to the controlling PC.

This chapter includes:

• “Overview" on page 33• “Confirm Your License Options" on page 34• “On-Device Voice Quality Operation" on page 34• “Preparing E6474A for Mobile Measurements" on page 35

OverviewThis functionality is licensed separately from the voice MOS measurements provided with the external sound card. The B9990A-210 On-Device POLQA Base license is required perform these measurements on two devices. Upgrade licenses are available for addi-tional devices.

• B9990A-212 On-Device POLQA Upgrade 2 to 4 Devices• B9990A-214 On-Device POLQA Upgrade 4 to 6 Devices

Note:

• When you are using On-Device POLQA you must not turn on the Speaker Phone capability of the device or it will impact the on-device POLQA measurement.

Supported PhonesRefer to the Supported Phones Capabilities in the E6474A Supported Phone & Device List for the devices that support the On-Device Voice MOS test.

Chapter 3 Measuring Voice Quality Without External HardwareConfirm Your License Options


PrerequisitesRefer to the VoLTE Instructions Appendix in the UE Device Reference for E6474A Users to set up the phones.

Confirm Your License OptionsMake sure you have the required base license and applicable upgrade licenses from a software license server or by attaching a license dongle to your computer.

• B9990A-210 On-Device POLQA Base license (2 Devices)• B9990A-212 On-Device POLQA Upgrade 2 to 4 Devices• B9990A-214 On-Device POLQA Upgrade 4 to 6 Devices

To check your license options:

Select Help > About E6474A > License Info

The License Information screen appears listing the detected license options.

On-Device Voice Quality OperationThe test works in two modes: caller and answerer. Both the caller and the answerer should have the same speech reference file before executing this test. During execution of the test, the caller makes a call to the answerer and the answerer replies back by adding a speech reference file to the audio channel. The caller then records the speech reference file. After the recording is completed, the POLQA MOS score is calculated. Then the role is reversed, the caller plays back the speech reference file and the answerer records it and calculates the MOS score. This cycle is repeated for the duration of the call or until the call gets terminated.

NOTE: You may hear the speech file from the ear piece of the calling as well from the ear piece of the answering device during the POLQA testing. This is the expected behavior and has no impact to the POLQA MOS score and other results.

For example, if you select the POLQA_SWB_SHORT (4 seconds) speech reference file, when the call gets connected, the caller will start the recording immediately. It will last for 4+1= 5 seconds.The answerer will first wait for a half second before it plays back the speech reference file.

The MOS score calculation takes about five to seven seconds after the completion of the recording, depending on the phone processing power as well as the sample rate of the speech reference file.

Chapter 3 Measuring Voice Quality Without External HardwarePreparing E6474A for Mobile Measurements


Both the caller and the answerer switch their roles at the same pace which is equal to the [length of speech]+[2 seconds buffer]. In this example, it is 4+2=6 seconds. Therefore, both the caller and the answerer will shift their roles every six seconds.

The first MOS score from the caller will be reported at the12th (5+7) second after the call gets connected and the first MOS score from the answerer will be reported at the 18th (6+5+7) second.

The following Narrow Band or Super Wide Band speech reference files are supported by the Voice Quality Test:

• POLQA_NB_SHORT (4 seconds)• POLQA_SWB_SHORT (4 seconds)• POLQA_NB (8 seconds)• POLQA_SWB (8 seconds)

Preparing E6474A for Mobile Measurements1 Run the E6474A application. Refer to the E6474A Drive Test User’s Guide and online help for more infor-

mation.2 Add two devices (Mobile Originating and Mobile Terminating), for example, Samsung Galaxy S4 SGH-

I257, to the E6474A Hardware panel. See Help > Documentation Library > UE Device Reference for E6474A Users for details.

3 Add a parallel sequence node in the Sequencer Panel.

4 Add both devices (Mobile Originating and Mobile Terminating) under the parallel sequence.5 Add a call control test under each device.6 Configure the following test properties for the Mobile Originating device:

Auto Dial = YesAuto Answer = NoVoLTE Call Trace = EnabledVoice MOS Test = YesVoice Quality Test Device = PhoneDevice.Voice MOS Reference File in Device - Select a Narrow Band or Super Wide Band speech reference file:• POLQA_NB_SHORT (4 seconds)• POLQA_SWB_SHORT (4 seconds)



• POLQA_NB (8 seconds)• POLQA_SWB (8 seconds)

Note:

• Both the caller and the callee must have the same speech reference file.• The Inter call idle time in the caller phone should be greater than or equal to the Inter call idle time in

the answerer phone.

7 Configure the following test properties for the Mobile Terminating device: Auto Dial = NoAuto Answer = YesVoice MOS Test = YesVoLTE Call Trace = EnabledVoice Quality Test Device = PhoneDevice.Voice MOS Reference File in Device - Select a Narrow Band or Super Wide Band speech reference file:• POLQA_NB_SHORT (4 seconds)• POLQA_SWB_SHORT (4 seconds)• POLQA_NB (8 seconds)• POLQA_SWB (8 seconds)

Note:

• Both the caller and the callee must have the same speech reference file.• The Inter call idle time in the answerer phone should be less than or equal to the Inter call idle time

in the caller phone.



8 In the Sequencer panel, activate the desired test by selecting its corresponding check box. By default, the test is activated when you add the test under the device.

9 Prepare the output view by dragging the data items (for example, Data Items panel > Samsung Galaxy S4 Mini SGH-I257 > Dialup > CALL_CONTROL_TEST> Voice Quality) to the Tabular History view (View > Common Views > Tabular History). For a description of the measurement results, select the data item and click Help > Dynamic Help.

10 On the toolbar, start logging in the E6474A software.The Sequencer panel will display the task status.




4

Chapter 4 Troubleshooting

This chapter consists of frequently asked questions and contact information.

Frequently Asked Questions

Can a customized speech file be used to perform measurements?

Wizard recommends not using a customized speech file for measurement. The supplied collection of speech is recommended for the ITU standard PESQ/POLQA algorithm. The collection of male and female speech is a good representation of various phonemes in different languages.

What to do when there is an error message related to the reference speech?

Wizard recommends using speech in the default location “C:\Program Files\Agilent Tech-nologies\E6474A-X Voice MOS Test\Data\Wav”, under the folders: PESQ/POLQA. For HD voice testing, select wideband speech file (denoted by WB) or super wideband speech file (SWB)”

How to test which is the ear port and mic port of the E6473B-88x cable?1 Configure MAYA44USB or MOTU24I/O hardware for a single device e.g. Phone A as described in “Setting

up the hardware for Mobile System" on page 11.2 Configure E6474A for mobile measurements as described in “Part 2: Preparing E6474A for Mobile

Measurements (MOS and Delay Measurements)" on page 24.3 To test the ear connection of phone A

a Configure the Auto Answer property as No in the Call Control Test properties. b Call phone A using another device e.g. Phone B. You can listen or use the waveform analyzer to view

the audio record.

Chapter 4 TroubleshootingFrequently Asked Questions


4 To test the mic connection of Phone Aa Configure the Auto Answer as Yes in the Call Control Test properties. b Call Phone B using Phone A. You should be able to hear speech playback on Phone B.

Why is the equipment in the central office not picking up calls?

The call may be from a digital phone. Some offices use digital phones. The equipment only supports analog phone lines. However the equipment can be connected to a digital ISDN phone line as long as an ISDN-to-analog converter is used.

Why is the file, mos_score.txt, not available after data collection?

You may have used space characters when naming some of the folders in the work direc-tory. Remove all space characters from the path of the work directory on the central office.

Continuous Synchronization Time-out error when I start Voice MOS testing

The MAYA44USB device needs to be properly configured before starting Voice MOS test. The MOTU PCI requires its own configuration. See “Setting Up the MOTU 24I/O PCI Audio Console" on page 15.

If you are using MAYA44USBPLUS, refer to “Setting up the MAYA44USB/USBPLUS Control Panel" on page 13.

If you are using Maya44USB, you must initialize the ASIO Control Panel and properly configure the USB Tab, ASIO Tab, and Controls Tab. To open ASIO Control Panel go to: Start > Programs > Viavi Solutions > Utilities > MAYA44USB ASIO Control Panel.

Configure the ASIO control panel as follows:

USB Tab: • Output and Input must be checked• Sample rate set to 48KHz• Resolution set to 16 bit

ASIO Tab: • ASIO Resolution: 32 bit• System Performance: Relaxed• Application Priority: Normal

Controls Tab: • Monitor Area: Mute both• Input/Output Area: Check Gang for both. Make sure that Mute is unchecked.

Place both Equalizer bars to 1/3 position from the top. This would an be appropri-ate level for all technologies. These settings ensure that an adequate audio signal gets through without preventing clipping of the audio samples.

Chapter 4 TroubleshootingFrequently Asked Questions


Received low MOS (1.0 range) scores on my mobile unit even though the MOS_Value text file on the office unit was completely empty. Also, the diagnostic uplink audio files were not recorded on the office side.

Reason: The E6474A Voice Quality Test Office Utility was not opened and loaded on the office desktop or the STOP button has been pressed on the utility.

Before starting the voice quality test, make sure that E6474A Voice Quality Test Office Utility is loaded and in a ready state (The button in the lower middle must say “Stop Test”). Also, it is good practice to empty CH1 through to CH4 directories prior the voice MOS test. This way only the current test data is stored in the directory.

Interference between the MAYA device and phones may introduce undesirable noise on internal audio processing. Wizard recommends that you separate them approximately 2 inches (50 mm).

Repeatedly receiving low 1.0 MOS scores while testing Voice MOS

The most likely reason for repeated low MOS score is a mismatch of speech samples. Verify that the speech sample on the E6474A Voice Quality Test Office Utility matches the speech sample in the Sequencer Call Control Test properties. The mismatched samples will generate continuous low MOS score in the 1.0 range. Alternatively, verify that the correct speech sample is played by dialing and listening to the speech playback.

Continuous Synch Time-out errors with Voice MOS test

The RCA connection to the MAYA44USB device might be incorrect. This could be a wrong channel (you must use the same channel as selected in E6474A Sequencer properties), or the Ear/Mouth (Analog IN/Analog OUT) connections are reversed.

Also, if audio is heard through the phone (often the case with some Nokia GSM/UMTS phones), it may be necessary to disconnect and reconnect data cable so that the phone can properly detect audio cables. Ensure that the phone is neither muted or the volume is too low (at least half of max volume on most phones).

The Delay Measurement Results are not populated

Ensure that both the phones are connected to a single system and configured properly as mentioned in “Setting up the Voice Quality Test Mobile System" on page 8 and “Part 2: Preparing E6474A for Mobile Measurements (MOS and Delay Measurements)" on page 24.

How to interpret the attenuation and POLQA warning

The warning message will be displayed if the Mobile Originated or Mobile Terminated audio is too loud or too soft. The Attenuation measurement displays difference between the expected and the actual amplitude values. If you see the warning, then you must

Chapter 4 TroubleshootingContact Information


perform the steps described in “Part 3: Calibration of Signal level using MAYA44USB/USBPLUS" on page 28. If the POLQA warning is blank, it means the settings are perfect.

How to ensure the delays measurements are legitimate?

If you see the POLQA warning in the data items, you need to perform the steps described in “Part 3: Calibration of Signal level using MAYA44USB/USBPLUS" on page 28, until you see no warning.

Contact InformationFor technical support, contact your local country-specific Wizard office and they will quickly forward your inquiry to the person who can best help you solve your problem.

If you require technical assistance, call 1-844-GO-VIAVI (1.844.468.4284).

For the latest TAC information, go to http://www.viavisolutions.com/en/services-and-support/support/technical-assistance.


A

Appendix A POLQA Agreement

Perceptual Objective Listening Quality Analysis (POLQA) according to ITU-T Recommen-dation P. 863 included in this product is protected by copyright and by European, US and other International patents and patent applications and is provided under license from

OPTICOM Dipl.-Ing. M. Keyhl GmbH, Erlangen, Germany, 2012 – www.opticom.de

POLQA® is a registered trademark of OPTICOM GmbH. Used by permission.

© 2011 by the POLQA Coalition of OPTICOM GmbH, Germany - SwissQual AG, Switzer-land - KPN, The Netherlands - TNO, The Netherlands.

www.polqa.info

User shall not copy the POLQA SOFTWARE in whole or in part, other than is essential for the proper operation of the POLQA SOFTWARE or for normal security back-up purposes

User shall not engage in modifying, translating, reverse-engineering or decompiling the POLQA SOFTWARE except to the extent permitted by law

User shall not remove this POLQA acknowledge of the rights, except if the software is uninstalled

Appendix A POLQA Agreement



Index

AASIO Control Panel 28

CCan customized speech file be used to perform measurement 39central office set up 5central office sub-system 21contact information 42

Ffrequently asked questions 39

Llicense 5license keys 11loud audio 28

Mmeasurement results 30Measurement, Downlink MOS 30Measurement, Uplink MOS 31measuring voice quality 19Mobile VMT Software solution system components 1, 2MOTU 24IO with PCIe Card 13MOTU audio isolator 14MOTU PCI, auto-calibration 28

Nnoise immunity 11

Pphone support 42

Ssetting up hardware

central office 5mobile equipment 8

setting up license keys 11setting up USB Audio Module 13soft audio 28support contact 42

Ttroubleshooting 39

UUSB Audio Module 13, 28Using Van sub-system with WAMS 24, 35

Vvan set up 8Voice MOS Test Office Utility 20Voice MOS Warning Message 27

WWhy is the equipment in the central office not picking up calls 40Why is the file, mos_score.txt, not available after data collection 40

Index


Viavi Solutions

North America: 1.844.GO VIAVI / 1.844.468.4284

Latin America +52 55 5543 6644

EMEA +49 7121 862273

APAC +1 512 201 6534

All Other Regions: viavisolutions.com/contacts

email [email protected]

Voice QualityTest Getting Started GuideFebruary 2016English

B99990A Drive Test - s3.amazonaws.coms3.amazonaws.com/ss-infoshare/ranadvisor/B9990-90002_voice_mos... · The E6474A Drive Test solution is designed to allow benchmarking and qualification

Documents