INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Product Name Security Level

GENEX Probe INTERNAL
Product Version Page
V300R014 Total 14 pages

GENEX Probe V300R014 Voice

Quality Evaluation (MOS) Test
Guide

2015-4-4 Huawei confidential. No spreading Page 1. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Prepared Liu Yanan (employee Date 2014-11-07

By ID: 00290893)
Reviewed Li Xuge (employee Date 2014-11-07

By ID: 00190089)

Approved Date

By

Approved Date

By

Huawei Technologies Co., Ltd.

All rights reserved

2015-4-4 Huawei confidential. No spreading Page 2. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

1 Purpose
This document describes the usage method and precautions of the newly added MOSCard
synchronization MOS test Sync SQE (MAYA44 USB+) of the Probe V300R014C00 version.

2 Preparations for Test

2.1 Hardware Preparations

(1) One PC.

(2) Two terminals: applicable terminals include Mate7, P7, and U8860 mobile phones.
(3) One MAYA44 USB+ audio adapter. The method for obtaining the MAYA44 USB and audio
adapter is as follows:

(a) Product introduction: http://www.esi-audio.cn/?action=products&title=maya44usb%2B

(b) Purchase mode:
Authorization website: http://www.esi-audio.cn/?action=company&page=store
Contact: Manager Mr. Deng, telephone number: 13761118718
(4) Two MOS audio cables used for testing
Obtaining mode: contact Xiao Yongmao (employee ID: 00218250)
Telephone number: 13892834144

2.2 Software Preparations

(1) Probe V300R014C00 installation package

(2) MAYA44 USB+ audio adapter driver
(3) Corresponding drivers of terminals (The drivers of P7 and Mate7 are the same.)
(4) PESQ and POLQA algorithm licenses
(5) HiSilicon Agent

MAYA Driver.rar Install package HUA_7.2.2.exe

P7 Driver.rar

2.3 Environment Preparations

(1) Install the terminal driver to ensure that the terminal can be properly connected to the PC.
(2) Install the HiSilicon Agent.
(3) Install the Probe.
(4) Start the Probe and import the POLQA license (Without a POLQA license, you cannot
perform the POLQA NB and SWB algorithm tests. The license must be purchased.).

2015-4-4 Huawei confidential. No spreading Page 3. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

As shown in the preceding figure, click Update POLQA License and select POLQA License.
After a successful import, the system displays a message indicating that the POLQA license is
successfully imported.
(5) Install the audio adapter driver and then start the audio adapter console on the taskbar, as
shown in the following figure.

After connecting to the audio adapter, the console is displayed as shown in the following figure
indicating that the audio adapter driver is installed successfully. Otherwise, reinstall the driver.

2015-4-4 Huawei confidential. No spreading Page 4. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

3 Sync SQE (MAYA44 USB+) Operation

Description

3.1 Connecting to Terminals Properly

This document uses the terminal Mate7 as an example to describe the test operation, and similar
operations apply to P7 terminals.
(1) Start the HiSilicon Agent.
(2) Enter *#*#2846579159#*#* in the dialer interface of the terminal and choose Background
setting > Usb ports setting. In the USB mode switch interface, touch Switch to AP. In the
USB Ports Setting interface, select Balong Debug mode.
(3) Connect the terminals to the PC in turn and ensure that all ports on the Agent can be read (You
are advised to record the corresponding AT ports and mobile phone numbers of the terminals
to ensure that you will not confuse the ports and mobile phone numbers of different terminals
in the following configuration test plans.), as shown in the following figure.

2015-4-4 Huawei confidential. No spreading Page 5. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

(4) Connect the MAYA44 USB+ MOSCard to the PC.

(5) Start the Probe and connect the Probe to the terminals and MOSCard.

Record the corresponding port and mobile phone numbers of the terminals when you
configure the terminals, facilitating the subsequent configuration test plans. In the following
part of this document, the MS1 functions as the MOC and the MS2 functions as the MTC.

2015-4-4 Huawei confidential. No spreading Page 6. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

(6) Audio cable connection: Each audio cable has one 3.5 mm headset connector and two RCA
connectors (a red one and a black one). Insert the headset connectors (3.5 mm) of two audio
cables into two terminals, respectively. Then, connect the red RCA connector to the out port
of the audio adapter, and the black one to the in port (This connection mode is only used as an
example. In actual use, refer to the instructions of the audio cables for correct connection.
Improper connection may lead to low MOSs.). In this document, the MS1 functions as the
MOC and the MS2 functions as the MTC. Connect the MS1 terminal to the out port of the
MOSCard through an audio cable, serving as the voice playing end. Connect the MS2
terminal to the in port of the MOSCard through an audio cable, serving as the voice recording

2015-4-4 Huawei confidential. No spreading Page 7. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

end. The final connection diagram is as follows.

(7) After the configuration is complete, click the Connect icon. The results are shown as follows.

3.2 Configuring Test Plans Properly

1. Configure the test plan on the MOC, as shown in the following figure.

2015-4-4 Huawei confidential. No spreading Page 8. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Main parameter description (For details, see the help document):

Destination MS: indicates the name of the MTC.
MOS Card: indicates the name of the MOSCard.
Destination Number: indicates the phone number of the MTC.

MOS Algorithm: indicates the speech quality evaluation algorithm. The Probe supports the PESQ
and POLQ algorithms. You must install the POLQA license if you select the POLQA algorithm.

Save All Result File: indicates whether to save the result speech file settings.

Play Channel [OUT]: indicates the voice playing channel. Each OUT RCA interface on the audio
adapter is numbered (such as 1, 2, 3, and 4). The configured number must be the same as that on
the red RCA connector of the real connected MOC.

Record Channel [IN]: indicates the voice recording channel. Each IN RCA interface on the audio
adapter is numbered (such as 1, 2, 3, and 4). The configured number must be the same as that on
the black RCA connector of the real connected MTC.

Speech Sample File: indicates the sample speech file path. Currently, the PESQ algorithm enables
users to manually select the corpora path. If you need to replace the corpora when using the
POLQA algorithm, you must rename the corpora to be replaced in the corresponding installation

2015-4-4 Huawei confidential. No spreading Page 9. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

directory. The corpora name is modified according to the test plan default name. Delete the
corpora containing the wav48000 field when you replace a corpus. Otherwise, the obtained MOS
score is low.

Delete the corpora

containing the
wav48000 field
when you replace a
corpus.

Speech Result File: indicates the result speech file path.

2. Do not configure any test plan to the MTC and MOSCard.

3.3 Adjusting Attenuation

Before the actual test, the audio adapter output volume must be adjusted based on the test
terminal model to ensure the accuracy of MOS result. Set the in-call volumes of the two test
mobile phones to the maximum. Currently, the Probe does not support the MOS self-check
function and the attenuation value cannot be automatically adjusted. Before the formal test, you
need to select a stable and optimal attenuation value.

Configure and execute the test plan. Start the Probe and choose View > MOS > Voice Call >
Speech Quality Evaluation to view the MOS. Adjust the attenuation value of the out port
configured in the test plan. Start from 0, test about 10 values for each attenuation adjustment,
record the optimal attenuation value, and use the optimal value as the formal test attenuation
value. Do not modify the gain and muting settings of the INPUT and MONITOR during the
attenuation adjustment. After you complete the settings, the console is shown as follows:

2015-4-4 Huawei confidential. No spreading Page 10. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Because of terminal differences, you need to readjust the attenuation value when replacing the
terminals. However, the attenuation value range does not differ much.

When replacing the test corpora, you also need to readjust the attenuation value.

3.4 Querying Results

You can view the speech quality evaluation results by choosing View > MOS > Voice Call >
Speech Quality Evaluation.

2015-4-4 Huawei confidential. No spreading Page 11. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Test results are displayed in the corresponding interface of the MOC and MS1 data is displayed on the interface by
default. If MS1 is not the MOC, you can perform handover by right-click on the interface, as shown in the
following figure.

2015-4-4 Huawei confidential. No spreading Page 12. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

4 Precautions
If the test MOS is low (if the MOS test score is between 1 and 2), do as follows:
(1) Check method:
When executing the test plan, enable the hands-free function of the MTC to check whether
you can hear the sample speech corpus. If any speech is heard, it indicates that the MOC is
connected to the MOSCard properly.

(2) Check whether the audio cable is properly connected to the MTC: set Save All Result File to
yes, check whether you can hear any sound by playing the result speech files and whether the
sound is consistent with that in the sample speech files.

(3) Check the actual network quality: Call each other from two terminals and hear the actual
voice quality.

The audio cable is connected properly. However, after replacing the test corpus, the MOS is low.
Check method:

2015-4-4 Huawei confidential. No spreading Page 13. Total 14 Pages

without permission.
 INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

(1) Check whether corpora files including the field wav48000 exist in the corpora path. If any
files exist, delete them.

(2) If the MOS remains low after resolving the preceding problem, you are advised to adjust the
attenuation value of the out port. Because the sensitivities of different corpora are different,
you need to readjust the attenuation value.

(3) Check the attenuation and gain values of the MOSCard to ensure that the gain values of the
INPUT and MONITOR are 0 and the INPUT and MONITOR are set to muting.

When you test the VoLTE, if the MOS is low or fluctuates greatly, open the VoLTE Parameters
interface under the LTE node and check whether the jitter, delay, and packet loss values are great.

2015-4-4 Huawei confidential. No spreading Page 14. Total 14 Pages

without permission.