You are on page 1of 128

SwissQual...

QualiPoc
Android
Manual
13.0.1

(@<1=)
Manual

Test & Measurement

1612011351 13.0.1

SwissQual has made every effort to ensure that eventual instructions contained in the document are adequate and free of errors and omissions. SwissQual will, if necessary, explain issues which may not be covered
by the documents. SwissQuals liability for any errors in the documents is limited to the correction of errors
and the aforementioned advisory services.
Copyright 2000 - 2013 SwissQual AG. All rights reserved.
No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system,
or translated into any human or computer language without the prior written permission of SwissQual AG.
Confidential materials.
All information in this document is regarded as commercial valuable, protected and privileged intellectual
property, and is provided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material.
When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo
trademark somewhere in your text.
SwissQual, Seven.Five, SQuad, QualiPoc, NetQual, VQuad, Diversity as well as the following
logos are registered trademarks of SwissQual AG.
Diversity ExplorerTM, Diversity RangerTM, Diversity UnattendedTM, NiNA+TM, NiNATM, NQAgentTM,
NQCommTM, NQDITM, NQTMTM, NQViewTM, NQWebTM, QPControlTM, QPViewTM, QualiPoc FreeriderTM,
QualiPoc iQTM, QualiPoc MobileTM, QualiPoc StaticTM, QualiWatch-MTM, QualiWatch-STM, SystemInspectorTM, TestManagerTM, VMonTM, VQuad-HDTM are trademarks of SwissQual AG.

2013 Rohde & Schwarz GmbH & Co. KG


Mhldorfstr. 15, 81671 Mnchen, Germany
Phone: +49 89 41 29 - 0
Fax: +49 89 41 29 12 164
E-mail: info@rohde-schwarz.com
Internet: www.rohde-schwarz.com
Subject to change Data without tolerance limits is not binding.
R&S is a registered trademark of Rohde & Schwarz GmbH & Co. KG.
Trade names are trademarks of the owners.

SwissQual...QualiPoc

Contents

Contents
1 Introduction............................................................................................7
1.1

Service Tests.................................................................................................................7

1.2

Device Support..............................................................................................................8

1.3

Post-Processing Software............................................................................................8

1.4

QualiPoc Monitors........................................................................................................8

1.5

Related Documents.......................................................................................................9

2 Installing QualiPoc Android................................................................10


2.1

GPS Configuration......................................................................................................10

2.2

Date and Time Configuration.....................................................................................10

2.3

Updating QualiPoc Android.......................................................................................10

3 QualiPoc Settings................................................................................12
3.1

Map Settings................................................................................................................13

3.2

BTS Information..........................................................................................................14

3.3

Layer 3..........................................................................................................................14

3.4

IP Monitor.....................................................................................................................15

3.5

Customization.............................................................................................................16

3.6

Notifications................................................................................................................17

3.7

Technology Forcing....................................................................................................18

3.7.1

WCDMA Preferred Channel Forcing.............................................................................19

3.8

Unit Configuration.......................................................................................................20

3.9

Advanced Analysis Settings......................................................................................21

3.10

Exporting and Importing Configuration Settings.....................................................22

3.10.1

Exporting a Configuration File.......................................................................................23

3.10.2

Importing a Configuration File.......................................................................................24

4 Measurement Job Types.....................................................................25


4.1

Single CALL Job Answering Station......................................................................25

4.2

Single CALL Job Call to Any Number....................................................................25

4.3

Single CALL Job Speech MOC...............................................................................26

4.4

Single CALL Job - Speech Double Ended................................................................28

4.4.1

Supported Measurement Scenarios..............................................................................29

Manual 1612011351 13.0.1

SwissQual...QualiPoc

Contents

4.4.2

Creating and Running the Job on a QualiPoc Phone...................................................30

4.4.2.1

Starting the Job on the QualiPoc Phone.......................................................................37

4.4.2.2

Stopping the Job on the QualiPoc Phone.....................................................................38

4.4.3

Creating and Running the Job in Diversity NQView......................................................38

4.4.3.1

Creating a Voice Call Server in NQView ......................................................................38

4.4.3.2

Creating the Speech Double Ended Measurement Task in NQView............................41

4.4.3.3

Starting the Measurement Task in NQView..................................................................43

4.5

Single DATA Job Capacity DL................................................................................44

4.6

Single DATA Job Email Send and Receive............................................................44

4.7

Single DATA Job FTP DL and UL ..........................................................................45

4.8

Single DATA Job HTTP Browser............................................................................46

4.9

Single DATA Job HTTP Transfer DL and UL.........................................................47

4.10

Single DATA Job - Iperf UDP.....................................................................................48

4.10.1

Overview of Iperf Parameters.......................................................................................50

4.11

Single DATA Job Ping.............................................................................................51

4.12

Single DATA Job - Upload..........................................................................................52

4.13

Single MESSAGE Job MMS Send and Receive.....................................................54

4.14

Single MESSAGE Job SMS Send and Receive.....................................................55

4.15

Single VIDEO Job - YouTube No Reference.............................................................56

4.16

Multiple Jobs Multi-Data / Multi-Mix / Multi-RAB / Parallel...................................59

4.17

Job Sequence..............................................................................................................59

4.18

Advanced Job Settings..............................................................................................61

5 Using QualiPoc.....................................................................................63
5.1

Help Menu....................................................................................................................63

5.2

QualiPoc Main Toolbar...............................................................................................64

5.3

Creating and Running Basic Jobs.............................................................................65

5.3.1

Stopping a Job..............................................................................................................66

5.4

Creating and Running Advanced Jobs.....................................................................66

5.4.1

Exporting and Importing Advanced Measurement Jobs...............................................70

5.4.2

Running an Advanced Measurement Job.....................................................................70

5.4.2.1

Stopping a Job..............................................................................................................71

5.5

Viewing Results...........................................................................................................71

5.5.1

Automatically Uploading Result Files to a Server.........................................................71

Manual 1612011351 13.0.1

SwissQual...QualiPoc

Contents

5.6

Cell Info Banner...........................................................................................................73

5.7

Monitors.......................................................................................................................75

5.7.1

Customizing the Contents of a Monitor.........................................................................75

5.7.2

Status and Log Monitors...............................................................................................77

5.7.3

Technology Monitors.....................................................................................................78

5.7.3.1

Serving Cell Monitor......................................................................................................78

5.7.3.2

Data Monitors................................................................................................................79

5.7.3.3

Cells and Coverage Monitors........................................................................................80

5.7.4

Layer 3 Monitors...........................................................................................................81

5.7.4.1

Viewing and Saving Layer 3 Messages........................................................................82

5.7.5

Map Monitors................................................................................................................83

5.7.5.1

Outdoor Map Monitor....................................................................................................83


Offline Positioning with Open Street Map.....................................................................84
Saving a Selection of an Open Street Map...................................................................85
Exporting and Importing Open Street Map Tiles...........................................................86
Using BTS information on the Map Monitor..................................................................87

5.7.5.2

Indoor Map Monitor ......................................................................................................88

5.7.6

IP and PCAP Logging Monitors....................................................................................90

5.7.7

Test and Events Monitors.............................................................................................91

6 Measurement Files Post-Processing.................................................93


6.1

Measurement File Logging.........................................................................................93

6.2

Replaying Measurements on the Phone...................................................................93

6.3

Transferring the Measurement Files to a PC............................................................94

6.4

Replaying Measurement Files in NetQual NQView..................................................94

6.5

Analysing Measurement Data with NetQual NQDI...................................................95

A Creating an Answering Station for QualiPoc Android......................97


A.1

Modifying the Answering Station............................................................................105

A.1.1

Changing the Reference Sample for the Job..............................................................105

A.1.2

Restoring the Diversity Call Server.............................................................................106

A.2

Measurement Files....................................................................................................107

B Configuring Voice and Video Call Servers......................................108


B.1

Offline Configuration Mode......................................................................................108

Manual 1612011351 13.0.1

SwissQual...QualiPoc

Contents

B.2

Online Configuration Mode......................................................................................108

B.3

Configuring a Voice or Video Call Server in NQView............................................108

B.3.1

Configuring the Server in Offline Mode.......................................................................109

B.3.2

Configuring the Server in Online Mode.......................................................................111

B.4

Configuring a Voice Call Server in Diversity Supervisor......................................113

C Call Quality.........................................................................................116
C.1

Defining Call Quality.................................................................................................116

C.2

3 Viewing the Results...............................................................................................117

D Call Setup Time..................................................................................118


D.1

Dialing........................................................................................................................119

D.1.1

Incoming Call (B-Side Device)....................................................................................119

D.1.2

Calling Party Connect (A-Side Device).......................................................................119

E Fixed Duration Tests..........................................................................121


E.1

Fixed Duration Test...................................................................................................121

E.2

Limitations.................................................................................................................121

E.3

References.................................................................................................................122

E.4

Configuring Fixed Duration Tests...........................................................................122

E.4.1

FTP and HTTP Tests..................................................................................................122

E.4.2

Capacity Test..............................................................................................................123

E.5

3 Example Scenario and Results.............................................................................125

E.5.1

Results........................................................................................................................126

E.6

TCP-Based KPIs........................................................................................................127

E.6.1

FTP KPIs.....................................................................................................................127

E.6.2

HTTP Transfer KPIs....................................................................................................128

E.6.3

Capacity KPIs..............................................................................................................128

Manual 1612011351 13.0.1

SwissQual...QualiPoc

Introduction
Service Tests

1 Introduction
QualiPoc Android has been designed for handheld radio network optimization and quality
assessment. This software supports a variety of devices and technologies including
GSM, GPRS, EDGE, WCDMA, HSDPA, HSUPA and LTE. Due to the ease of use, you
can use QualiPoc to collect data and voice services statistics. SwissQual offers the following QualiPoc Handheld Android versions:

Android RF: RF optimization and troubleshooting for scenarios where MOS testing
is not a consideration. This tool has been designed for indoor and outdoor use for
easy and fast data collection on various technologies. Android RF is ideal for field
engineers who perform daily tasks such as site verification and commissioning, troubleshooting, and optimization.

QualiPoc Android RF is also available in a Lite version, which does not save the results
to a measurement file.

Android QA: Combines the functionality of Android RF with MOS quality testing
algorithms such as SQUAD, and P.863 (POLQA). Android QA is a mobile network
quality assessment tool that has been designed to allow customers to easily evaluate
the quality of services, such as voice calls, while providing the RF parameters and
application layer information that are crucial to troubleshooting.

1.1 Service Tests


QualiPoc Android includes the following test functionality:

CALL: Uses the Call2anynumber test to set up a speech call connection to a number
that automatically responds. Uses the Speech MOC test to measure intrusive speech
quality (MOS) on speech call connection to a responding station. The answering station job could be used to answer calls for a MOC DL job.

DATA: Sets up a PS data connection to an access point name. This functionality


includes FTP UL/DL, HTTP Browser, HTTP Transfer GET/PUT, Ping, Email and
Capacity DL testing.

MESSAGE: Test SMS and MMS functionality

Multi-Data, Multi-Mix, Multi-RAB, and Parallel: Execute data and call tests sequential or parallel.

Idle Monitoring: Allows you to monitor RF parameters during normal use of the
phone.

Manual 1612011351 13.0.1

SwissQual...QualiPoc

Introduction
Device Support

1.2 Device Support


QualiPoc Android is available for several smartphone and tablet models that run on
Android OS. For a complete list of the supported devices, see the
Release Notes QualiPoc Android.pdf document.

1.3 Post-Processing Software


SwissQual offers the following NetQual PC-based products for the post-processing of
QualiPoc measurement files:

NetQual NQView: Replay tool for post processing data from a QualiPoc Android
Handheld device.

NetQual NQDI: Database based post-processing tool with in-depth data analysis,
mapping, and reporting functionalities. This tool is useful for mass data post processing on files from a fleet of QualiPoc units.

1.4 QualiPoc Monitors


QualiPoc provides you with the ability to control and to monitor the tests on your QualiPoc
Android smartphone.
By default, the QualiPoc Android workspace contains several technology, mapping, and
result monitors. However, you can also customize and save personal workspaces.

Table 1-1: Description of the monitors that are available in QualiPoc Android
Monitor

Description

Status

Includes general information about the operator, technology, GPS, and general test
results statistics.

Log

Provides test execution information.

WCDMA/GSM/LTE

Displays the main serving cell information based on the actual technology.

HSDPA/HSUPA

Provides details on HSDP and HSUPA data technology information. This monitor is
only available for WCDMA technology.

GPRS/EDGE

Provides details on GPRS or EDGE data technology information. This monitor is only
available for GSM technology.

LTE DL/LTE UL

Provides details on LTE data technology information. This monitor is only available
for LTE technology.

Cells

Provides an overview of serving and neighbour cells status and coverage. The content
of this monitor depends on the main technology that the mobile phone is connected
to.

Manual 1612011351 13.0.1

SwissQual...QualiPoc

Introduction
Related Documents

Monitor

Description

Coverage line-chart

Displays serving and neighbour cell coverage. The content of this monitor depends
on the main technology that the mobile phone is connected to.

Test

Displays the summary of the on-going tests including KPI bar chart.

Layer3

Displays a list of signalling layer 3 headers including the option to decode each l3
message

IP

Displays the HTTP, FTP, TCP, DNS and ICMP messages that have been captured
including the option to decide the messages.

Events

Displays a list of voice and data call related events as well as Wi-Fi scanning results.

Map

Displays the current position, route and BTS information on a map based on Google
maps or Open Street Map.

Indoor

Displays a floor plan for indoor marking navigation.

1.5 Related Documents

Manual - QualiPoc Freerider II.pdf

Manual - QualiPoc Android Remote Controlled.pdf

Manual - NetQual - NQView.pdf

Manual 1612011351 13.0.1

SwissQual...QualiPoc

Installing QualiPoc Android


GPS Configuration

2 Installing QualiPoc Android


QualiPoc Android arrives pre-installed on a supported smartphone. SwissQual has modified the firmware and the Android operating system to enable the full feature set of the
QualiPoc application. The first start is also part of the delivery. However, you need a valid
licence key to use QualiPoc, which you can obtain from SwissQual Support. Ensure that
you read the Release Notes QualiPoc Android.pdfdocument before you use
QualiPoc Android and also before you update the software.
If you want to add speech testing features to your installation, contact SwissQual.

2.1 GPS Configuration


QualiPoc Android can use the internal GPS of the smartphone or an external Bluetooth
GPS to log the current location and display this location on the outdoor mapping monitor.
You need to enable the internal GPS on the phone to use GPS capability in QualiPoc.

You can pair a Bluetooth GPS device with the phone and then select the device in the
"Map" settings. In this case you can disable the internal GPS to save battery power.
Otherwise you can use the internal GPS as a backup location provider in the event that
the Bluetooth GPS disconnects or has insufficient coverage.

2.2 Date and Time Configuration


To ensure that the measurement tests run correctly, you need to disable the automatic
date and time update feature on the phone, for example, touch "Settings > Date & Time
> Automatic", and ensure that the automatic option is greyed out.

2.3 Updating QualiPoc Android


You can update QualiPoc through a network connection, that is, mobile or a WiFi network,
or you can use a USB connection to update the software.
Before you run an update, ensure that the memory card is correctly installed and recognized on your device.
To update QualiPoc Android through a mobile or WiFi network
1. 1. Press Menu

Manual 1612011351 13.0.1

and touch "About > Update".

10

SwissQual...QualiPoc

Installing QualiPoc Android


Updating QualiPoc Android

2. Touch "Update now", touch a version in the list, and then touch "OK".

Fig. 2-1: Over-the-air update

To update QualiPoc Android through a USB connection


1. Connect your Android phone to your computer with a USB cable.
2. On your phone, select the "USB connected" option.
3. Copy the *.apk file onto your phone, for example, copy the file to [sdcard]/
QualiPoc/.
4. Disconnect the phone from your PC.
5. Open a file manager on the phone and go to the folder that contains the *.apk update
file.
6. Start the update application and follow the instructions.
If you cannot run the application, touch "Settings" on the "Application" menu, and then
enable the "Unknown Sources" option.

Manual 1612011351 13.0.1

11

SwissQual...QualiPoc

QualiPoc Settings

3 QualiPoc Settings
You can use the menus on your smartphone to easily configure QualiPoc Android.

To access the QualiPoc settings, press Menu

You can also touch the up arrow


"Settings" on the toolbar.

and touch "Settings".

at the bottom of the screen and then touch

In some monitors, this icon opens a screen where you can customize the content of the
monitor.

Fig. 3-1: QualiPoc settings

Manual 1612011351 13.0.1

12

SwissQual...QualiPoc

QualiPoc Settings
Map Settings

3.1 Map Settings


The "Map settings" screen allows you to configure the settings for indoor and outdoor
maps.

Fig. 3-2: Map settings


Table 3-1: Description of the Map settings in QualiPoc
Setting

Description

"Map Engine"

Select the map source, that is, Google Maps or Open


Street Maps

"Map Mode (Google Maps only)"

Enables satellite mode.

"Online Mode (Open Street Map only)"

Enables online or offline mode for Open Street Maps.

"BTS monitor"

Displays BTS information on the map monitor.


You need to load a BTS list for this feature to work.

"GPS Device"

Select the internal GPS or an external Bluetooth GPS


device

"Indoor Map"

Select the image file in JPEG or PNG format to use


as a floor plan for indoor navigation

"Show signal information"

Show value label by each indoor marker

Manual 1612011351 13.0.1

13

SwissQual...QualiPoc

QualiPoc Settings
BTS Information

3.2 BTS Information


The BTS Information screen allows you to activate the BTS information display and to
select your GSM, WCDMA or LTE BTS lists. You can copy the file to any location on the
SD card of the phone. The BTS Info File must be in CSV format where each row corresponds to one cell ID. Use the following syntax for a BTS Info File:

Fig. 3-3: BTS information


Table 3-2: Description of the BTS information settings in QualiPoc
Setting

Description

WCDMA

Name,Technology,UARFCN,PSC,Lon,Lat,MCC,MNC,LAC,CellId,D
irection

GSM

Name,Technology,BCCH ,BSIC,Lon,Lat,MCC,MNC,LAC,CellId,Dir
ection

LTE

Name,Technology,EARFCN,PhyCID,Lon,Lat,MCC,MNC,LAC,CellId,Direction

3.3 Layer 3
The Layer 3 screen lists the available Layer 3 filtering options, which you can enable to
filter out the layer3 headers, for example, by group or by subgroup.

Manual 1612011351 13.0.1

14

SwissQual...QualiPoc

QualiPoc Settings
IP Monitor

Fig. 3-4: Layer 3 settings

3.4 IP Monitor
The IP Monitor screen allows you to selectively filter out messages that belong to the
HTTP, FTP, DNS, and ICMP protocols.

Manual 1612011351 13.0.1

15

SwissQual...QualiPoc

QualiPoc Settings
Customization

Fig. 3-5: IP Monitor filters

3.5 Customization
The customization screen allows you to customize the QualiPoc workspace to display
your preferred monitors as well as create and save different custom workspace configurations. You can then load different workspaces for different monitoring tasks. To customize your workspace, press Menu
and touch "Settings > Customization", and at the
bottom of the screen, select one of the following actions:

"Add": Adds a new monitor

"Remove": Deletes the monitor that you select.

" Move left": Moves the monitor one position to the left.

"Move right": Moves the monitor one position to the right.

Manual 1612011351 13.0.1

16

SwissQual...QualiPoc

QualiPoc Settings
Notifications

Fig. 3-6: Customizing the QualiPoc workspace

The Workspace editor provides you with an overview of the monitors in the current workspace.

To save a custom workspace, press Menu

To load a custom workspace, press Menu


select a workspace.

and touch "Save workspace".


and touch "Load workspace", and then

3.6 Notifications
You can configure notifications based on layer3 messages or on display values. A standard Android notification informs you about a new QualiPoc notification. You can also use
a custom sound or vibration for each QualiPoc notification.

To view the event history of the notification, touch the occurrence of the notification
in the list.

Manual 1612011351 13.0.1

17

SwissQual...QualiPoc

QualiPoc Settings
Technology Forcing

Fig. 3-7: Notification settings

3.7 Technology Forcing


On the Forcing screen you can select the technology and bands that you want to force
the phone to use.

Manual 1612011351 13.0.1

18

SwissQual...QualiPoc

QualiPoc Settings
Technology Forcing

To enable technology forcing


1. Press Menu

, touch "Settings", and then touch "Forcing".

2. Touch ""
3. Touch "Select Network Type", and then touch a network technology in the list, for
example, "WCDMA + GSM".
The list of available frequency bands for the technology depends on the capabilities of
the device.

Fig. 3-8: Forcing settings

3.7.1 WCDMA Preferred Channel Forcing


On some devices, you can force QualiPoc to use a preferred WCDMA channel when
multiple channels are available. This feature is only available for the following devices:

Samsung S III (I747, I747M, T999, T999V, SC-06D)

Samung GalaxyTab 8.9 (P-7320, P-7320T, I957, I957D)

After you set the preferred UARFCN channel, QualiPoc immediately restarts the device.

The forcing sets the radio modem to scan a priority UMTS UARFCN before other channels when the phone starts. The radio modem attempts to access the network with the

Manual 1612011351 13.0.1

19

SwissQual...QualiPoc

QualiPoc Settings
Unit Configuration

preferred UARFCN even if a cell on another UMTS channel can provide a better connection.
If the signal is lost on the preferred UMTS channel, the modem scans for another channel.
To force the phone to rescan for the preferred UMTS channel, you must power cycle the
modem.

Fig. 3-9: WCDMA Preferred UARFCN settings

3.8 Unit Configuration


On the "Unit configuration" screen you can specify the unit name, the connection settings
to the media server, and the structure of the results folder. The unit name is useful for
identifying the measurement files of a particular phone during post processing. If you
manually upload measurement files from a phone to the media server, that is, with the
"" command on the main menu, the unit name is also used for the folder on the media
server that contains the file.
You can configure the folder structure as flat, for example, 2011-12-10_Custom HD or
as a hierarchy, for example, 2011-12-10/Custom HD/. You can use the following
types of information for the folder names:

Date (for example, 2011-12-10

System (always QualiPoc)

Device

Task/Job (Task or job name)

Manual 1612011351 13.0.1

20

SwissQual...QualiPoc

QualiPoc Settings
Advanced Analysis Settings

Fig. 3-10: Unit configuration settings

3.9 Advanced Analysis Settings


The "Advanced analysis settings" screen allows you to configure additional QualiPoc
settings.

Manual 1612011351 13.0.1

21

SwissQual...QualiPoc

QualiPoc Settings
Exporting and Importing Configuration Settings

"Set max thrpt": Allows you to set the maximum throughput in kbps for different technologies.
This value is mostly used for charts and color coding.

"ROMES logging": Records additional raw data files that you can replay with ROMES

"Raw QC trace logging": Includes whole Qualcomm trace data in the results file

As this option can degrade the measurement performance of the phone, you should only
enable Raw QC trace logging for troubleshooting a problem.

Fig. 3-11: Advanced Analysis settings

3.10 Exporting and Importing Configuration Settings


You can export and import the following configuration files:

BTS lists

Layer 3 filter

Workspaces

Custom Monitors

Notifications

Job settings

Manual 1612011351 13.0.1

22

SwissQual...QualiPoc

QualiPoc Settings
Exporting and Importing Configuration Settings

3.10.1 Exporting a Configuration File


You export the QualiPoc configuration files over Bluetooth and Wi-Fi, and over the Internet through Email, and Dropbox
Some devices do not support Wi-Fi. To use the Email option, you need to configure the
Email server settings on your phone. For Dropbox support you need the Dropbox application on your phone.
To export a configuration file
1. Press Menu

and touch "Settings > Import/Export configuration".

2. Touch "Export configuration".


3. Touch the configuration file types that you want to export.
4. Export the files.
a) To export the files to the SD card, press Menu
, touch "Export to external
storage", enter a name for the file, and touch "Export".
b) To export the files off the phone, touch "Send via", touch a service in the list, for
example, "Email", and follow the instructions.

Manual 1612011351 13.0.1

23

SwissQual...QualiPoc

QualiPoc Settings
Exporting and Importing Configuration Settings

Fig. 3-12: Export configuration file

3.10.2 Importing a Configuration File


QualiPoc can only import a job from an SD card in the phone.
To import a measurement job
1. Copy the XML file of the measurement job, or the Zip file that contains the measurement files that you want to import, to the SD card on the phone:
2. Press Menu

and touch "Start Job".

3. Touch "Import from SD card", go to the location on the SD card where you stored the
job file, and touch the file.
This process overwrites existing measurement job files on the phone with the same
name.

Manual 1612011351 13.0.1

24

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job Answering Station

4 Measurement Job Types


You can create and configure a measurement job in QualiPoc directly on your smartphone or tablet, save the job locally, and run the job immediately. This section describes
the types of measurement jobs that you can create and run in QualiPoc.

4.1 Single CALL Job Answering Station


The single call test - answering station job starts a measurement device in answering
station mode. Once in this mode, another device can initiate MOC DL testing to the
answering station.

Fig. 4-1: Answering station single CALL job


Table 4-1: Description of the settings for an Answering station single CALL job
Setting

Description

"Algorithm"

Evaluates speech quality on the calling side.

"Reference File"

Reference file for speech quality evaluation

4.2 Single CALL Job Call to Any Number


A Call to Any Number job sets up a simple Circuit Switch (CS) call and outputs the main
test-related KPIs. This simple test requires you to input the following settings.

Manual 1612011351 13.0.1

25

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job Speech MOC

Fig. 4-2: Call to Any Number single CALL job


Table 4-2: Description of the settings for a Call to Any Number single CALL job
Setting

Description

"Phone number"

Number that you want to call

"Call duration"

Duration of the call in seconds

"Number of cycles"

Number of times to repeat a single test before the job


ends

4.3 Single CALL Job Speech MOC


A Speech MOC job sets up a Circuit Switch (CS) call to an answering station. This station
can be part of the network, that is, an automatic voice announcement number in MSC, a
Diversity Call Server that is running as an answering station, or another QualiPoc device
running in Answering Station mode, that is, single CALL job - Answering Station. Currently, the job outputs the main test-related KPIs and MOS values of the speech in the
downlink.
For information on how to configure a Diversity Call Server as an answering station, see
chapter A, "Creating an Answering Station for QualiPoc Android", on page 97.

Manual 1612011351 13.0.1

26

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job Speech MOC

Fig. 4-3: Speech MOC DL single CALL job


Table 4-3: Description of the settings for Speech MOC single CALL job
Setting

Description

"Phone number"

Number that you want to call

"Call duration"

Duration of the call in seconds

"Max call setup time"

Maximum waiting time for the call to be set up

"Algorithm"

Algorithm to evaluate speech quality

"Reference File"

Reference file to play for speech quality evaluation

"Wave file options"

Options for recording wave files during the test

For speech quality tests, you can use the SQUAD08 or POLQA (P.863) algorithm.

You need a valid QualiPoc Android license for the algorithm that you want to use.

Manual 1612011351 13.0.1

27

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

4.4 Single CALL Job - Speech Double Ended


The Speech Double Ended job establishes a CS call between two QualiPoc Android
phones, a QualiPoc Android phone and a Diversity Call Server, or QualiPoc Android
phone and a Diversity Smartphone without an MCM.
The Speech Double Ended job can only run on devices with Snapdragon S3 or S4 processors.

Fig. 4-4: Speech Double Ended job settings


Table 4-4: Description of the settings for a Speech Double Ended Job
Setting

Description

"Side"

Side of the call, that is, A or B-side

"Call direction"

"A-side to B-side", "B-side to A-side", or "Alternating Call Sequence"


In Diversity, the call direction is in MOC:MTC format, that is, 1:0 for A to B, 0:1
for B to A, and 1:1 for the "Alternating Call Sequence".

"Phone Number"

Number that you want to call

"Advanced settings"

Specify call timings, algorithm, and sample

"Number of cycles"

Number of times to repeat a single test before the job ends

"Job Name"

Name of the job


Diversity ignores this name.

"Timing and Scheduling"

Settings to configure the duration of the job. The window timings are compatible with Diversity.

"Speech Double Ended"

Specify the settings for the Speech Double Ended job

Manual 1612011351 13.0.1

28

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

Setting

Description

"Sample Direction"

From A to B, B to A, or Half-Duplex

"Selected Algorithm"

Select the algorithm to calculate quality scores, namely POLQA or SQuad08.

"Reference File"

Speech sample to use for the call.


You need to re-select the reference file when you change the algorithm. QualiPoc reference files do not have the same names as Diversity reference files.

" Supervised Unit"

QualiPoc to QualiPoc or with the stop call option where the phone operates as
an autonomous B-side answering station.
Do not enable this option if the job involves a call to a Diversity unit.

"Remote Job Number"

Unlike the job name, the value that you enter is transferred to a Diversity unit
during the call.

"Sample Frequency"

Plays a sample each time that the interval that you specify elapses

4.4.1 Supported Measurement Scenarios


QualiPoc Android supports the following speech double ended measurement scenarios:

QualiPoc Android to QualiPoc Android:


Manually configure the job in QualiPoc on the A-side and B-side phones.

Manually start the job in QualiPoc on the B-side and A-side phones, respectively.

For more information, see chapter 4.4.2, "Creating and Running the Job on a QualiPoc
Phone", on page 30.

QualiPoc Android to Diversity Call Server (PSTN/ISDN):


Add and configure the Diversity voice call server in NQView.
For more information, see chapter 4.4.3.1, "Creating a Voice Call Server in
NQView ", on page 38.

Export the configuration of the voice call server from NQView and import the
configuration on the voice call server.

Manually configure the job on the QualiPoc phone.


For more information, seechapter 4.4.2, "Creating and Running the Job on a
QualiPoc Phone", on page 30.

Add the QualiPoc phone as a mock voice call server in NQView.


For more information, see chapter 4.4.3.1, "Creating a Voice Call Server in
NQView ", on page 38.

Manually create the task in NQView, export the B-side task configuration file, and
import the file on the voice call server.
For more information, see chapter 4.4.3.2, "Creating the Speech Double Ended
Measurement Task in NQView", on page 41.

Manually start the job on the QualiPoc phone.


For more information, see chapter 4.4.2.1, "Starting the Job on the QualiPoc
Phone", on page 37. The QualiPoc phone must be the A-side device.

Diversity Android Smartphone without an MCM/PSM to QualiPoc Android:


Add and configure the Diversity smartphone . For more information, see
the Manual NetQual NQView.pdf document.

Manual 1612011351 13.0.1

29

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

Manually configure the job on the QualiPoc phone. For more information, see
chapter 4.4.2, "Creating and Running the Job on a QualiPoc Phone",
on page 30. Some Diversity settings are slightly different than the QualiPoc
counterparts. In such cases, consult the setting information in the paragraph
below the relevant step.

Diversity Android Smartphone without an MCM/PSM to QualiPoc Android:


Add the QualiPoc phone as a mock DTMF voice call server in NQView.
For more information, see chapter 4.4.3.1, "Creating a Voice Call Server in
NQView ", on page 38.

Create the measurement task in NQView with the Diversity smartphone as the
A-side device and the QualiPoc phone, that is, the mock DTMF voice call server,
as the B-side device.
For more information, see chapter 4.4.3.2, "Creating the Speech Double Ended
Measurement Task in NQView", on page 41.

Manually start the job on the QualiPoc phone.


For more information, see chapter 4.4.2.1, "Starting the Job on the QualiPoc
Phone", on page 37.

Start the measurement task in NQView.


For more information, see chapter 4.4.3.3, "Starting the Measurement Task in
NQView", on page 43. A Diversity smartphone only supports the DTMF job
transfer method. The Diversity smartphone must be the A-side device and the
QualiPoc Android phone must be the B-side device.

Diversity Smartphone in an MCM/PSM to QualiPoc Android:


Same as the Diversity Android Smartphone without an MCM/PSM to QualiPoc
Android scenario except that you need to include an MCM in the NQView hardware configuration

4.4.2 Creating and Running the Job on a QualiPoc Phone


The settings that you specify for the measurement job on the A-side device must be
identical to the settings on the B-side device, except for the respective phone numbers
and test direction.
To create a Speech Double Ended measurement job in QualiPoc
1. Press Menu
and touch "Jobs > Selected job type > Single CALL tests > Speech
Double Ended".
2. Configure the basic job settings.
a) Touch "Selected side" and then touch a side, for example, "A".

Manual 1612011351 13.0.1

30

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

b) Touch "Selected phone number > Add new", enter the number for the A-side
phone, and then touch "OK".

Fig. 4-5: Create a QualiPoc Speech Double Ended measurement job

3. Touch "Advanced settings > Job name", enter a name for the job, and then touch
"OK".

Fig. 4-6: Specify the job name

4. Specify the timing settings for the job.


a) Touch "Timings and Scheduling".

Manual 1612011351 13.0.1

31

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

b) Touch "Duration", enter a value, and then touch "OK".


For a test that involves a Diversity unit, enter the same duration as you did in
figure 4-16 for the measurement task in NQView.
c) Touch "# of Cycles", enter a value, and then touch "OK".
For a test that involves a Diversity unit, enter the same duration as you did in
figure 4-16 for the measurement task in NQView.

Fig. 4-7: Timings and Scheduling

d) Touch "Pause time", enter a value and then click "OK".


This setting is only available in QualiPoc and must be 0 if the test involves a
Diversity unit.

Manual 1612011351 13.0.1

32

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

e) Touch "Window Timings" and use the timings picker at the top left to select the
setting that you want to change, and then use the value picker at the top right to
select the new value.
For a test that involves a Diversity unit, specify the same Window timings as you
did in figure 4-17 for the intrusive job in NQView.

Fig. 4-8: Window timings

f)

Press Back

5. Specify the test settings.


a) On the "Job settings" screen, touch "Speech Double Ended" in the "Test" area.

Manual 1612011351 13.0.1

33

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

b) Touch "Selected call direction" and touch the call direction.


For a test that involves a Diversity unit, the call direction is the "MOC:MTC" ratio
in figure 4-17 that you specified for the intrusive job in NQView. For a
"MOC:MTC" ratio of 1:0, touch "Call A to B", for a "MOC:MTC" ratio of 0:1, touch
"Call B to A", and for "MOC:MTC" ratio of 1:1, touch "Alternating Call
Sequence".

Fig. 4-9: Set Call Direction

Manual 1612011351 13.0.1

34

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

c) Touch "Selected sample direction", and then touch an option in the list.
Unlike in Diversity, the half-duplex option in QualiPoc always starts with a B to A
sample direction and then alternates the sample direction. Furthermore, unlike in
Diversity, you cannot specify the number of samples that a QualiPoc job uses.
However, QualiPoc always evaluates the reference samples that the phone
receives. For a test that involves a Diversity unit, ensure that the sample direction
that you selected in figure 4-18 for the test in NQView reflects these limitations.

Fig. 4-10: Speech Double Ended test settings

Manual 1612011351 13.0.1

35

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

d) Touch "Selected algorithm" and touch one of the following options.

"SQuad08": for a "Speech" test


"SQuad08 (WB)": For a "Speech-Wideband" test
"POLQA": For a "Speech POLQA" test
"POLQA (WB)": For a "Speech-Wideband POLQA" test

For a test that involves a Diversity unit, touch the algorithm that you selected in
figure 4-18 for the test in NQView.

Fig. 4-11: Select the algorithm for the test

e) Touch "Selected reference file" and touch a sample file for the test.
For a test that involves a Diversity unit, use same reference sample that you
selected in figure 4-18 for the test in NQView, for example, "English (U.S.) IRS"
for the AM_fm_IRS.wav reference sample.

Manual 1612011351 13.0.1

36

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

f)

Touch "Sample frequency", enter one of the following sample frequencies, and
then touch "OK":

12.5: For tests that use the "SQuad08" and POLQA algorithms.
The sample frequency is the time difference between the start times of the
two subsequent samples. A sample frequency of 12.5 seconds in QualiPoc
corresponds to the combined 6 second "Record hang-over" that you specified
in figure 4-18 in NQView and the 6.5 second duration of the SwissQual reference samples.
20: For tests that use the "SQuad08 (WB)" and "POLQA (WB)" algorithms.
QualiPoc on slower phones requires the longer time to calculate the MOS
results in a wideband Speech Double Ended measurement job.

Fig. 4-12: Additional Speech Double Ended test settings

g) Touch "Selected wave file option" and touch an option.


4.4.2.1

Starting the Job on the QualiPoc Phone

To start the job, press Menu


, touch "Jobs", ensure that the Speech Double Ended
job is loaded, and touch "Start job".
To load the job, press Menu
, touch "Load job", touch "Speech Double Ended",
and touch the job that you created.

Manual 1612011351 13.0.1

37

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

4.4.2.2

Stopping the Job on the QualiPoc Phone


The B-side QualiPoc device handles a stop command from the Diversity A-side device
in the following ways:

Stop command arrives during a configuration call: QualiPoc restarts the measurement job into waiting for configuration mode and does not save a measurement
file

Stop command arrives during a normal call: QualiPoc stops the measurement job
and saves a measurement file.

Stop command arrives during a pause in a normal call: Job continues to run until
the timeout is reached

Stop command does not arrive: If the call has already been configured and the test
is running, the call runs indefinitely; however, if you restart the measurement task in
NQView and QualiPoc is configured to receive the call, then QualiPoc restarts the
job on the phone after the configuration call.

4.4.3 Creating and Running the Job in Diversity NQView


The following sections describe how to use Diversity NQView to configure the following
features for a speech double ended test:

4.4.3.1

Voice Call Server: Required for the QualiPoc Android to Diversity Call Server (PSTN/
ISDN), Diversity Android Smartphone without an MCM/PSM to QualiPoc Android,
and Diversity Smartphone in an MCM/PSM to QualiPoc Android scenarios

Speech Double Ended Measurement Task: Required for the Diversity Android
Smartphone without an MCM/PSM to QualiPoc Android, and Diversity Smartphone
in an MCM/PSM to QualiPoc Android scenarios

Starting the Measurement Task in NQView

Creating a Voice Call Server in NQView


This section describes how to configure a physical Diversity voice call server with PSTN
or ISDN cards in NQView as well as a mock Diversity voice call server. The mock call
server represents the QualiPoc unit when you configure a mixed environment Diversity
and QualiPoc speech double ended task in NQView.
For the Diversity smartphone to QualiPoc phone scenario, the following sections assume
that have already configured the Diversity smartphone for the test. For the QualiPoc to
Voice Call Server scenario, the following procedure assumes that you have already
installed the ISDN or PSTN devices and the respective Windows drivers on the PC that
hosts the voice call server.
To create a mock voice call server in NQView
1. On the Navigation panel of the "Control" console, click "System configuration".
2. Add a PC unit.

Manual 1612011351 13.0.1

38

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

a) Right-click "Hardware", point to "Add unit", and then click PC.

Fig. 4-13: Add PC unit to system configuration

b) Type a "Name" and "Computer name" for the unit, for example, QPAndroid.

Fig. 4-14: Create a voice call server

c) In the "Time synchronization" list, click "Internal sync".


d) In the following lists, click "No connection/DTMF":
"NQComm control"
"Unit control"
"Job transfer send"
"Job transfer listen"
e) Click "Apply" and click "OK".

Manual 1612011351 13.0.1

39

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

3. Create a subscriber profile for the phone device or PSTN or ISDN card.
a) Click "System configuration" on the Navigation panel and click the plus sign (+)
beside "Subscriber and access points".
b) Click the plus sign (+) beside an operator in the tree, right-click a provider, and
then click "Add subscriber".
c) Add the subscriber information, click "Apply", and then click "OK".
4. Add the QualiPoc phone or the PSTN or ISDN card as device to the DTMF voice call
server.
a) Right-click the unit in the tree, point to "Add device", and then click the type of
device, for example "Mobile" for a QualiPoc phone or "ISDN" for a Diversity
device.
b) Type a name for the phone.
c) In the "Model" list, click the type of phone or ISDN or PSTN model.
d) In the "Subscriber" list, click the profile that you created in the previous step.
If you are creating a mock call server for a QualiPoc phone, the subscriber number
is the only value that needs to be identical to the QualiPoc setting.
e) Click "Apply" and click "OK".

Fig. 4-15: Add a device to the voice call server

5. Transfer the configuration to the voice call server PC.


You do not need to perform this action for the QualiPoc mock voice call server.
For a description on how to transfer the configuration to the voice call server, see
chapter B, "Configuring Voice and Video Call Servers", on page 108.

Manual 1612011351 13.0.1

40

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

4.4.3.2

Creating the Speech Double Ended Measurement Task in NQView


The following procedure assumes that you have already configured the Diversity device
involved in the test, for example, the Diversity smartphone.
To define the Speech Double Ended measurement task in NQView
1. On the Navigation panel of the "Control" console, click "Tasks and Jobs", right-click
"Measurement task" in the tree, and then click "Add task".
2. Type a name for the task.

Fig. 4-16: Add a measurement task

3. In the "Device A/B side" area, select the A-side and B-side devices.
Scenario

A-Side Device

B-Side Device

QualiPoc to Diversity Call Server QualiPoc phone (mock call


(PSTN/ISDN) scenario
server)

Diversity call server (PC)

Diversity Android Smartphone


without an MCM/PSM to QualiPoc Android

Diversity Android Smartphone

QualiPoc phone (mock call


server)

Diversity Smartphone in an
MCM/PSM to QualiPoc Android
scenarios

Diversity Android Smartphone

QualiPoc phone (mock call


server)

4. Add a measurement job to the task


Important: You need to use the same job settings that you manually specified on the
QualiPoc phone in chapter 4.4.2, "Creating and Running the Job on a QualiPoc
Phone", on page 30.
a) In the "Job sequence" area, click the green plus sign

Manual 1612011351 13.0.1

41

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

b) Click the yellow asterisk

in front of the "Job" list, and then click "Intrusive job".

Fig. 4-17: Add an intrusive job to the measurement task

c) In the "Name" box, type a name for the job in the following DTMF job transfer
format:
job_xyz
d) In the "Record hang-over [ms]" box, type 6000.
QualiPoc does not have a hang-over recording setting. Instead, you need to
specify a "Record Hang-Over" value of 6000ms and a "Test Repetition
Sequence" of 11 in NQView.
e) In the "MOC:MTC ratio" box, specify the call direction, for example, 1:1.
QualiPoc does not use the MOC:MTC ratio to define the call direction, but rather
uses A-side and B-side. As a result, a MOC:MTC ratio of 1:0 corresponds to the
A to B call direction setting in QualiPoc and a 0:1 ratio corresponds to B to A.
However, the MOC:MTC ratio of 1:1 corresponds to the"Alternating Call
Sequence" call direction in QualiPoc.
f) In the "Timings" area, select "Use call duration to abort call".
If you do not enable this option, the measurement task will not run correctly
g) Specify the remaining timings, click "Apply", and then click "OK".
5. In the "Intrusive test" window, specify the settings for the speech test.
a) Type a name for the test.

Manual 1612011351 13.0.1

42

SwissQual...QualiPoc

Measurement Job Types


Single CALL Job - Speech Double Ended

b) In the "Test type" list, click one of the following types:


"Speech"
"Speech POLQA"
"Speech-Wideband"
"Speech-Wideband POLQA"
c) In the "Direction" area, click a direction for the reference sample.
You need to select the same direction for all of the reference samples that you
use. Samples with alternating directions must start with a B to A direction; otherwise NQView does not accept the configuration on the task level.
d) In the "Reference sample" list, click the speech sample that you want to use.
e) In the "Save WAV files" area, click an option.
f) Click "Apply" and then click "OK"

Fig. 4-18: Add a speech test to the intrusive job

6. In the "Job details in task" window, click "Save".


7. In the "Measurement task" window, specify the "Duration" and the number of
"Cycles" for the task.
8. Click "Apply", and then click "OK".
Note: For a description on how to transfer the task configuration to a Diversity voice
call server, see chapter B, "Configuring Voice and Video Call Servers",
on page 108.
4.4.3.3

Starting the Measurement Task in NQView


This section describes how to start the Speech Double Ended Measurement in NQView
and on the QualiPoc phone.
To start the measurement task on NQView
1. On the "Control" console in NQView, click "Tasks and Jobs".
2. Click the "Tasks" tab in the workspace.
3. Click the green arrow in the "Start" column in front of the task that you created.

Manual 1612011351 13.0.1

43

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job Capacity DL

4.5 Single DATA Job Capacity DL


Capacity DL tests can execute up to 4 parallel HTTP downloads at once.

Fig. 4-19: Capacity DL single DATA job


Table 4-5: Description of the settings for a Capacity DL single DATA job
Setting

Description

"URLs"

HTTP address of the site that you want to download

"Advanced Settings"

Specify advanced timeouts and test options

"Number of cycles"

Number of times to repeat a single test before the job


ends

Ensure that the total download size of the reference files is large enough to last for the
duration of the test.

4.6 Single DATA Job Email Send and Receive


The email test supports SMTP, POP3, IMAP, and SSL.

Manual 1612011351 13.0.1

44

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job FTP DL and UL

Fig. 4-20: Email Send single DATA job


Table 4-6: Description of the settings for a Email Send and Receive single DATA job
Setting

Description

"Outgoing and Incoming mail server"

Address of the email serve

"Advanced Settings"

Specify advanced timeouts and test options

"Number of cycles"

Number of times to repeat a single test before the job


ends

4.7 Single DATA Job FTP DL and UL


FTP Transfer DL and UL jobs establish a Packet Switch call, execute an FTP transfer,
and measure the test- related performances. You need to enter the following settings to
configure an FTP job.

Manual 1612011351 13.0.1

45

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job HTTP Browser

Fig. 4-21: FTP DL and UL single DATA jobs

Host address: IP address of the host

To add the port number, type a colon (:) at the end of the address, and then type the port
number. Only QualiPoc Handheld uses this number.
Table 4-7: Description of the settings for FTP DL and UL single DATA jobs
Setting

Description

"File"

Name of the remote file that you want to download

"Credentials"

Login credentials for the FTP server

"Advanced Settings"

Specify advanced timeouts and test options

"Number of cycles"

Specify the number of times to repeat a single test


before the job stops

4.8 Single DATA Job HTTP Browser


An HTTP Browsing job establishes a Packet Switch (PS) call and performs a browsing
test to output test relevant results. For this test QualiPoc application uses the same web
engine as the built in browser does. In order to run the test you need to specify the following settings for an HTTP Browsing job.

Manual 1612011351 13.0.1

46

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job HTTP Transfer DL and UL

Fig. 4-22: HTTP Browser single DATA job


Table 4-8: Description of the settings for an HTTP Browser single DATA job
Setting

Description

"URL"

HTTP address of the site that you want to browse

"Advanced Settings"

Specify advanced timeouts and test options

"Number of cycles"

Number of times to repeat a single test before the job


ends

4.9 Single DATA Job HTTP Transfer DL and UL


The HTTP Transfer Download (DL) and Upload (UL) jobs establish a Packet Switch (PS)
call, execute an HTTP transfer, and measures the test-related performances. You need
to enter the following settings for these tests.

Manual 1612011351 13.0.1

47

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job - Iperf UDP

Fig. 4-23: HTTP Transfer DL and UL single DATA jobs


Table 4-9: Description of the settings for HTTP Browser Transfer DL and UL single DATA jobs
Setting

Description

"Host address"

IP address of the host

"File"

Name of the remote file that you want to download

"Credentials"

Login credentials for the HTTP server

"Advanced Settings"

Specify advanced timeouts and test options

"Number of cycles"

Number of times to repeat a single test before the job


ends

4.10 Single DATA Job - Iperf UDP


The Iperf test allows you to measure network capacity with UDP streams.
1. Press Menu

Manual 1612011351 13.0.1

and touch "Jobs > Selected job type > Single DATA tests > Iperf".

48

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job - Iperf UDP

Fig. 4-24: Iperf DATA job settings and Advanced settings

2. Touch "Selected server address", touch "Add new", enter the name of the server, and
then touch "OK".
3. Specify the test settings.
a) Touch "Iperf" in the "Test" area.
b) To add a command-line setting, touch "Selected additional parameters", enter
the setting, and then touch "OK".

Fig. 4-25: Iperf test settings and parameters

Manual 1612011351 13.0.1

49

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job - Iperf UDP

Note: To view the list of available parameters, touch "Full arguments list".

4.10.1 Overview of Iperf Parameters


Setting

Description

-f, --format [kmKM]

Format to report: Kbits, Mbits, KBytes, MBytes

-i, --interval #

Seconds between periodic bandwidth reports

-l, --len #[KM]

Length of buffer to read or write (default 8 KB)

-m, --print_mss

Print TCP maximum segment size (MTU - TCP/IP


header)

-o, --output <filename>

Output the report or error message to this specified


file

-p, --port #

Server port to listen on/connect to

-u, --udp

Use UDP rather than TCP

-w, --window #[KM]

TCP window size (socket buffer size)

-B, --bind <host>

Bind to <host>, an interface or multicast address

-C, --compatibility

For use with older versions does not sent extra msgs

-M, --mss #

Set TCP maximum segment size (MTU - 40 bytes)

-N, --nodelay

Set TCP no delay, disabling Nagle's Algorithm

-V, --IPv6Version

Set the domain to IPv6

For the l and w, K or M parameters, suffixes are required, for example, l 8K, or
w 512K. QualiPoc supports the UDP protocol and automatically adds the u parameter.

Manual 1612011351 13.0.1

50

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job Ping

Fig. 4-26: Iperf log with the client report outlined in red

The client report in the Iperf log has the following fields:

20130104135043 date/time

10.105.30.236 sender IP address

34548 sender port (UDP)

82.220.1.20 receiver IP address

5001 receiver port

4 ID

1.0-2.0 Interval in seconds

132300 data transferred in Bytes

1058400 bandwidth in bits/s

The final report datagram from the client and server has a total of 14 fields, 9 from the
client report, and the following 5 fields:

6.429 Delay jitter

10 quantity of lost packets

893 quantity of received packets

1.120 lost packets in %

0 quantity of packets out of order

4.11 Single DATA Job Ping


A Ping job establishes a Packet Switch call and pings the host that you specify to evaluate
the Round Trip Time (RTT). You need to specify the following settings for a Ping job.

Manual 1612011351 13.0.1

51

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job - Upload

Fig. 4-27: Ping single DATA job


Table 4-10: Description of the settings for a Ping job
Setting

Description

"Host"

IP address of the host

"Number of pings and interva"

Number of pings and interval between pings in milliseconds

"Packet size and timeout"

Enter the packet size in bytes and the timeout for the
ping in seconds

"Advanced Settings"

Specify advanced timeouts and test options

"Number of cycles"

Number of times to repeat a single test before the job


ends

4.12 Single DATA Job - Upload


The Upload job uploads the results files to the server that you specify in the job settings.
This job uploads the files from the results folder that you define in the unit configuration
settings.

Manual 1612011351 13.0.1

52

SwissQual...QualiPoc

Measurement Job Types


Single DATA Job - Upload

To create an Upload measurement job


1. Press Menu
Upload".

and touch "Jobs > Selected job type > Single DATA tests >

2. Specify the server for the job.


a) Touch "Host address".

Fig. 4-28: Job settings for the Upload measurement job

b) In the "Result files upload connection profile" area, touch "Select connection
type".
c) Touch a connection type in the list, for example, "FTP" or "HTTP".
d) Touch "Select host", enter the URL for the server, and then touch "OK".
e) Select active or passive mode.
3. Specify the login information for the server.
a) Touch "Select user name", enter an account name, and touch "OK".
b) Touch "Password", enter the password for the account, and touch "OK".
4. Specify the remaining settings, for example, enable the "Auto upload" and "Auto
compression" options.

Manual 1612011351 13.0.1

53

SwissQual...QualiPoc

Measurement Job Types


Single MESSAGE Job MMS Send and Receive

Fig. 4-29: Results file settings

Note: You cannot specify timings for an Upload job.

4.13 Single MESSAGE Job MMS Send and Receive


You can add up to two attachments to an MMS test.

Manual 1612011351 13.0.1

54

SwissQual...QualiPoc

Measurement Job Types


Single MESSAGE Job SMS Send and Receive

Fig. 4-30: MMS Send MESSAGE job


Table 4-11: Description of the settings for MMS Send and Receive single MESSAGE jobs
Setting

Description

"Receiver number"

Number of the receiver

"Advanced Settings"

Specify advanced timeouts and test options

"Number of cycles"

Number of times to repeat a single test before the job


ends

4.14 Single MESSAGE Job SMS Send and Receive


The SMS test allows you to configure the following options.

Manual 1612011351 13.0.1

55

SwissQual...QualiPoc

Measurement Job Types


Single VIDEO Job - YouTube No Reference

Fig. 4-31: SMS Send MESSAGE job


Table 4-12: Description of the settings for SMS Send and Receive single MESSAGE jobs
Setting

Description

"Receiver number"

Number of the receiver

"Advanced Settings"

Specify advanced timeouts and test options

"Number of cycles"

Number of times to repeat a single test before the job


ends

4.15 Single VIDEO Job - YouTube No Reference


The YouTube No Reference test calculates the following quality values:

Configuration access time [s]: KPI 10620

Pre-buffering time [s]: KPI 30621

Video download time [s]: KPI 20625

Video Duration [s]: Length of the video

Video Display time [s]: Duration of the recorded video sequence

Time to ready to play [s]: Time from sending the first TCP SYN packet to the YouTube
server until completing the download of the player configuration

Time to start buffering [s]: KPI 10625

Time to first picture [s]: Time from sending the first TCP SYN packet to YouTube
server until the first video frame is displayed on the screen

Freezing [%] in relation to video display time

Jerkiness [%] in relation to video display time

Manual 1612011351 13.0.1

56

SwissQual...QualiPoc

Measurement Job Types


Single VIDEO Job - YouTube No Reference

You cannot use copyrighted videos or videos that have had embedding disabled.

Fig. 4-32: YouTube single VIDEO job

The YouTube No Reference job supports the following link types:

Full address http://www.youtube.com/watch?v=-UaMoP-D1VY

ID only -UaMoP-D1VY

Mobile site m.youtube.com/watch?v=-UaMoP-D1VY

Short address youtu.be/watch?v=-UaMoP-D1VY

You can also share a link from the Android YouTube application with QualiPoc.

Manual 1612011351 13.0.1

57

SwissQual...QualiPoc

Measurement Job Types


Single VIDEO Job - YouTube No Reference

Fig. 4-33: YouTube No Reference test settings

Fig. 4-34: YouTube single VIDEO job results

Manual 1612011351 13.0.1

58

SwissQual...QualiPoc

Measurement Job Types


Multiple Jobs Multi-Data / Multi-Mix / Multi-RAB / Parallel

4.16 Multiple Jobs Multi-Data / Multi-Mix / Multi-RAB / Parallel


Multiple jobs allow you to combine Data and Voice jobs into a single job. This option
supports all single data and call tests.

Multi-Data: Sequence of data tests in which all the tests occur in one session

Multi-Mix: Sequence of data and call tests in which a new session starts for each
test

Multi-RAB: Parallel execution of a call and a multi-data test

Parallel: Parallel execution of up to 3 parallel jobs independent from each other (one
call job and multiple single or multi-data jobs).

Fig. 4-35: Mult-Mix job settings

4.17 Job Sequence


A "Job Sequence" allows you to specify the sequence of single-sided measurement jobs
for a slave to perform. If you have created measurement jobs that run on all of the slaves,
then you can also specify a sequence for all of the slaves. In both cases, QualiPoc saves
a separate measurement files for each job that runs.
To create a job sequence
1. Press Menu

and touch "Jobs > Selected job type".

2. In the "Select Job Group" list, touch "Job Sequence".

Manual 1612011351 13.0.1

59

SwissQual...QualiPoc

Measurement Job Types


Job Sequence

Fig. 4-36: Job sequence

3. Touch "Taskname" and type a name for the sequence.

Fig. 4-37: Job sequence settings

4. Add a job to the sequence.


a) In the "Job Quick Start Settings" area, touch "Job Sequence contains".
b) In the "Select Job Group" list, touch a group that contains a job that you want to
include, for example, "Single DATA job".

Manual 1612011351 13.0.1

60

SwissQual...QualiPoc

Measurement Job Types


Advanced Job Settings

c) In the "Select Job Type" list, touch the type of job that you want to include, for
example, "FTP DL".
The Answering Station single CALL Job is not available.
d) In the "Select a job file" list, touch a job, for example, "LastJobFTPDL.xml".

Fig. 4-38: Jobs in a sequence

Note: If you touch "Add new", see chapter 5.3, "Creating and Running Basic Jobs",
on page 65 or chapter 5.4, "Creating and Running Advanced Jobs", on page 66.
You can only specify the number of cycles and test duration "Timings and Scheduling" options for the individuals.
5. Press Back
and on the "Job Sequence" screen, press Menu
job" to add an additional job.

and touch "Add

Note: Repeat this step for each additional job.


6. To start the "Job Sequence", press Back

, and touch "Start Job".

4.18 Advanced Job Settings


You can also specify the following advanced settings for each job.

Manual 1612011351 13.0.1

61

SwissQual...QualiPoc

Measurement Job Types


Advanced Job Settings

Fig. 4-39: Advanced settings


Setting

Description

"Timings and scheduling"

Time and date on which to start the job, the number of repetitions for the job, and
the related timings, for example, duration of the job, pause between the tests,
and so on

"Test"

Settings that are related to the job

"Access Point"

Network access point for the job

"Pcap"

Include the PCAP information to the measurement file

Manual 1612011351 13.0.1

62

SwissQual...QualiPoc

Using QualiPoc
Help Menu

5 Using QualiPoc
The following sections describe how to use QualiPoc to create, to run, and to control your
tests. QualiPoc makes full use of the smartphone touch functionalities so you can easily
switch between the monitors, zoom in or out in the map monitors, and scroll easily. The
application also has a toolbar, which you can use to access a variety of functions.

5.1 Help Menu


The QualiPoc "Help" menu contains instructional videos.

To access the QualiPoc Help menu, press Menu


the video that you want to watch.

, touch "Help", and then touch

If you do not see the menu, you need to manually copy the video files to the phone.

To enable the QualiPoc Help menu


1. Exit QualiPoc on the phone.
2. Connect the phone to a PC with a USB cable.
3. Create a HelpVideo folder in the QualiPoc folder on the phone.
4. Copy the video files, for example, 1.QualiPoc Android Introduction.mp4,
from the Documentation folder on the QualiPoc installation CD to the /
QualiPoc/HelpVideo folder on the phone.
5. Start QualiPoc.

Manual 1612011351 13.0.1

63

SwissQual...QualiPoc

Using QualiPoc
QualiPoc Main Toolbar

Fig. 5-1: Help videos for QualiPoc

5.2 QualiPoc Main Toolbar


Depending on your QualiPoc device, you can access the main toolbar with the arrow at
the bottom or the side of the screen.

Fig. 5-2: Main QualiPoc toolbar

The toolbar allows you to quickly perform the following actions when you monitor a test.
Table 5-1: Description of the icons on the QualiPoc main toolbar
Icon

Manual 1612011351 13.0.1

Name

Description

"Idle Monitoring"

Starts recording the slave information in a measurement file.

"Freezing"

Freezes the monitors until you touch the icon again.

"Screen Capture"

Captures the screen and saves the image to the SD card in PNG
format.

64

SwissQual...QualiPoc

Using QualiPoc
Creating and Running Basic Jobs

Icon

Name

Description

"Photo Marker"

Captures a photograph with the phone camera and saves the


photograph on the SD card in the QualiPoc/Results folder. If
you are in recording or testing mode, the photo marker is added
to the MF file.
Not supported in Freerider mode.

"Settings"

Opens the QualiPoc settings screen for the monitor that you currently have open.

5.3 Creating and Running Basic Jobs


This section describes how to quickly configure and run a basic measurement job on your
QualiPoc device.
If you want to configure advanced settings and save your job configuration, see chapter 5.4, "Creating and Running Advanced Jobs", on page 66.
To quickly create and run a basic job
1. Start QualiPoc.

Turn on the device and touch the QualiPoc icon.

2. Press Menu

and touch "Jobs".

Fig. 5-3: Open job settings

3. Touch "Select job type", touch a job group, and then touch a job type.

Manual 1612011351 13.0.1

65

SwissQual...QualiPoc

Using QualiPoc
Creating and Running Advanced Jobs

4. Touch and specify the settings for the job.


5. Start the job.

Touch "Start Job".

The job runs until you issue a stop command.

Fig. 5-4: Start job

5.3.1 Stopping a Job


To stop a job, press Menu
and touch "Stop Job".
The job might take a while to stop.

5.4 Creating and Running Advanced Jobs


This section uses the example of an HTTP Browser job to describe the steps that you
need to take to create, save, load, and run an advanced measurement job on a QualiPoc
device.
To create and save an advanced measurement job
1. Start QualiPoc

Turn on the device and touch the QualiPoc icon.

2. Press Menu

Manual 1612011351 13.0.1

and touch "Jobs > Advanced Job Settings".

66

SwissQual...QualiPoc

Using QualiPoc
Creating and Running Advanced Jobs

3. Press Menu
, touch "Create new job", and then touch a job group in the list, for
example, "Single DATA tests".

Fig. 5-5: Create new job

4. On the "Select Job Type" screen, touch the type of job that you want to create, for
example "HTTP Browser".

Note: For a description of the job types, see chapter 4, "Measurement Job Types",
on page 25.

Manual 1612011351 13.0.1

67

SwissQual...QualiPoc

Using QualiPoc
Creating and Running Advanced Jobs

5. Touch and specify the settings for the job.

Manual 1612011351 13.0.1

68

SwissQual...QualiPoc

Using QualiPoc
Creating and Running Advanced Jobs

Fig. 5-6: Configure job settings

6. Press Menu
, touch "Save job", type a name for the job in the "Save job" box, and
then touch "Save".

Note: QualiPoc stores the new job in in the following location: [sdcard]/
QualiPoc/Jobs/

Manual 1612011351 13.0.1

69

SwissQual...QualiPoc

Using QualiPoc
Creating and Running Advanced Jobs

5.4.1 Exporting and Importing Advanced Measurement Jobs


For a description on how to import and export job configuration files, see chapter 3.10.2,
"Importing a Configuration File", on page 24.

5.4.2 Running an Advanced Measurement Job


In QualiPoc, you can perform an active test, such as Call to Any Number or HTTP transfer,
or start idle monitoring. In both cases, the default QualiPoc monitors displays network
information, RF values, and test results whenever these values are available.
To load and run a measurement job
1. Press Menu

and touch "Jobs".

2. Press Menu , touch "Load job", and then touch a job group in the list, for example,
"Single DATA tests".
3. On the "Select Job Type" screen, touch the type of job.

4. In the list of jobs, touch the job that you want to run.
Note: QualiPoc loads a job from the following location on the phone: [sdcard]/
QualiPoc/Jobs/
5. Press the Back

Manual 1612011351 13.0.1

key and touch "Start Job".

70

SwissQual...QualiPoc

Using QualiPoc
Viewing Results

5.4.2.1

Stopping a Job

To stop a job, press Menu


and touch "Stop Job".
The job might take a while to stop.

5.5 Viewing Results


The Results monitor allows you to compress, to upload, and to delete measurement files
and crash dumps. You can also filter the files according to type, that is, the .mf, .crashdump, .sqz, and .crashdump.zip. When you compress a measurement file, the entire
contents of the file, that is, audio recording, pcap files, photo markers, screen shots,
indoor maps, and tab files, are included in the .sqz compressed file.

To access the "Results" monitor, press Menu

, and touch "Results".

5.5.1 Automatically Uploading Result Files to a Server


In addition to manually uploading a result file to a server, you can also configure QualiPoc
to automatically upload result files to an FTP or HTTP server.
To configure QualiPoc to automatically upload result files
1. Press Menu

Manual 1612011351 13.0.1

and touch "Settings > Unit Configuration".

71

SwissQual...QualiPoc

Using QualiPoc
Viewing Results

Fig. 5-7: Automatically upload result files

2. Touch "Select connection type" and choose "FTP" or "HTTP".

Fig. 5-8: HTTP post configuration for upload files

Note: If you want to use the HTTP post method to upload the files, touch "HTTP form
upload". Use the following format for the host name: HostName/
PostScriptFileName, for example, 82.220.1.20/post.php. If you want to use a
custom script file on your server, you need to edit the properties in the following file:
\sdcard\QualiPoc\Settings\Upload\httpform.properties. You can
configure the POST method to use file or text form input.

Manual 1612011351 13.0.1

72

SwissQual...QualiPoc

Using QualiPoc
Cell Info Banner

3. In the "Result files upload" area, touch "Auto upload".

5.6 Cell Info Banner


The Cell Info banner is at the top of the screen and displays the values that you select.

Fig. 5-9: Cell Info banner

This banner is only available on Samsung Galaxy SIII, Samsung Galaxy Tab 8.9, HTC
One XL mobile devices. If you do not see all of the values that you selected, touch the
banner to display the remaining values.
To customize the Cell Info banner
1. Touch and hold the Cell Info banner.
2. To change the title values, touch "Customize title values".
You can only have two title values.
a) In the list of parameters, touch the parameters for the title of the banner.
b) If the number of "Remaining" parameters is "0", you need to touch a selected
value, for example, "Network", to remove the selection.

Manual 1612011351 13.0.1

73

SwissQual...QualiPoc

Using QualiPoc
Cell Info Banner

c) Touch the parameter that you want to display in the title area of the Cell Info
banner.

Fig. 5-10: Title values in Cell Info banner

Note: You can only have two title values.


3. To change values that appear on the banner, touch Customize banner values.
The banner can only display 10 values.
a) If the list already contains 10 values, touch and hold the value that you want to
beside the value.
remove, and then touch the red x
b) b At the top of the "Add / remove / rearrange" screen, touch the green plus sign

Manual 1612011351 13.0.1

74

SwissQual...QualiPoc

Using QualiPoc
Monitors

c) Touch a value in the list and continue until you have selected 10 values.

Fig. 5-11: Customizing a Cell Info banner

5.7 Monitors
QualiPoc has several screens that you can you can use to monitor a measurement.

To change between monitors, swipe the screen.

5.7.1 Customizing the Contents of a Monitor


You can quickly customize the contents of monitors in QualiPoc.

To customize a monitor Touch the up arrow


screen and touch the "Settings" icon.

at the bottom of the monitor

The amount of customization depends on the monitor that you are in. The following customization options are available:

If the "Add / remove / rearrange" screen opens, you can perform the following actions:
To add and remove items, touch the green plus sign
at the top of the screen,
and then touch the values that you want to add or remove.

Manual 1612011351 13.0.1

75

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-12: Add or remove items from a monitor

To rearrange the list, drag the rearrange icon


or down in the list.

next to the name of the item up

Fig. 5-13: Add / Remove / Rearrange screen for a monitor

If an options screen opens, touch the items that you want to select or remove. If the
item does not have a check box, another screen opens where you select the items
that you want to display in the monitor.

Manual 1612011351 13.0.1

76

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-14: Monitor display options screen

On a monitor where you cannot customize a value, the "QualiPoc Settings" screen
opens.

5.7.2 Status and Log Monitors


The "Status" and"Log" monitors provide general information about the current QualiPoc
Android status and active tests. The status monitor displays information about the network in use, GPS position, and test results. The Log monitor lists the actions that are
performed by the active engine, which runs the test.

Manual 1612011351 13.0.1

77

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-15: Status and Log monitors

5.7.3 Technology Monitors


The "WCDMA", "GSM", "HSDPA", "HSUPA", "GPRS/EDGE" and "LTE" monitors automatically display the information that is relevant to the technology in use. For example,
when the smartphone performs a GSM to WCDMA handover, the WCDMA monitor automatically replaces the WCDMA monitor.
5.7.3.1

Serving Cell Monitor


The GSM and WCDMA technologies have separate monitors that summarize the technology status, such as serving cell and RF coverage information.

Manual 1612011351 13.0.1

78

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-16: Serving Cell monitors

5.7.3.2

Data Monitors
QualiPoc automatically displays the relevant data technology information in the following
monitors when HSDPA, HSUPA, GPRS/EDGE, or Wi-Fi technologies are in use.
Where available, these monitors also contain PDP context information, that is, APN, IP
address and NSAPI (only for GSM).

Manual 1612011351 13.0.1

79

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-17: Data monitors

5.7.3.3

Cells and Coverage Monitors


The "Cells" monitor displays the neighbor cells as well as the related RF parameters so
that you can monitor reselections and handovers. QualiPoc also provides a line chart
representation of the serving cell and neighbor cell signal levels. The neighbor cell data
is displayed as thin lines and the serving cell data as thicker lines.

Manual 1612011351 13.0.1

80

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-18: Cells and Coverage Monitors

5.7.4 Layer 3 Monitors


The layer 3 trace monitor is a list monitor that displays the header information of layer 3
messages. You can disable protocol or message group items in the monitor settings.
QualiPoc writes the layer 3 information to the measurement file independent of the filter
settings. You configure QualiPoc to fully decode Layer 3 information in a pop-up window.

To close the window, double-tap the window or press the back button

Manual 1612011351 13.0.1

81

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-19: Layer 3 monitors

5.7.4.1

Viewing and Saving Layer 3 Messages


You can view and save the contents of a Layer 3 message to a text file.

To view the contents of a Layer 3 message, touch a Layer 3 header.

To save the contents of Layer 3 message, touch and hold the screen, and then touch
"Save".

QualiPoc saves the file in the following location:


/mnt/sdcard/QualiPoc/Layer3 messages

Manual 1612011351 13.0.1

82

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-20: Saving Layer 3 messages

5.7.5 Map Monitors


This section describes the features of the outdoor and indoor map monitors.
5.7.5.1

Outdoor Map Monitor


The outdoor map monitor allows you to follow the measurement path during a test. In a
drive test the map monitor displays the current position, path, and the received signal
strength that is traced during the test. If you enable the option, BTS information appears
on the map monitor, including the base station that you are connected to.

To customize the signals that you want to trace during a test, touch the position
marker.

To change the map mode, touch the up arrow (^) at the base of the map.

To center the map on your current location, touch the icon

Manual 1612011351 13.0.1

83

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-21: Map monitor

Offline Positioning with Open Street Map

To use Open Street Map, touch the up arrow (^) at the base of the map, touch "Map
engine", and then touch "Open Street Maps".

Manual 1612011351 13.0.1

84

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-22: Open street maps

Saving a Selection of an Open Street Map


QualiPoc allows you to select a portion of an Open Street Map and save the selection as
an image file.
To download part of an map
1. Touch the up arrow (^) at the base of the map and ensure that your map is in online
mode.
2. Touch and hold somewhere on the map

Manual 1612011351 13.0.1

85

SwissQual...QualiPoc

Using QualiPoc
Monitors

3. On the "Download map area" screen use the sliders to define the area and touch
"OK".

Fig. 5-23: Download map

Exporting and Importing Open Street Map Tiles


You can export an Open Street Map tile from one phone and import the tile on another
phone. For more information, see chapter 3.10, "Exporting and Importing Configuration
Settings", on page 22.

Manual 1612011351 13.0.1

86

SwissQual...QualiPoc

Using QualiPoc
Monitors

Using BTS information on the Map Monitor


You can load and use BTS information for different technologies in the "Map" monitor.
To enable BTS information on the Map monitor
1. Press Menu

, touch "Settings > BTS Information".

2. Touch the type of BTS file that you want to load, for example, "BTS Info File LTE",
locate the file, and then touch "Select".
3. Return to the map, touch the up arrow (^) at the base of the map, and then touch
Settings.
4. Touch "BTS monitor".

Manual 1612011351 13.0.1

87

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-24: BTS information on the Map monitor

5.7.5.2

Indoor Map Monitor


For indoor testing, the map monitor can display a floor plan, which you can double-tap to
mark your current position. QualiPoc links the positions that you mark to create a simple
path. By default the color of the indoor positions reflects the current signal strength (RxLev
in GSM/EDGE or RSCP in WCDMA).

To customize the tracking value, touch and hold the map.

To mark your position on the map, double-tap the map.

To delete a marker that you just added to a map, touch the "Undo" button
top of the screen.

To zoom in and zoom out of the map, use the touch capabilities of the smartphone.

To navigate between waypoints, use the left and right arrows in the slide out menu
at the bottom.

To add a waypoint, tap the plus sign (+).

Manual 1612011351 13.0.1

at the

88

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-25: Indoor Map monitor

To automatically center the map on the current waypoint, tap the waypoint marker in
the bottom right of the screen .

Manual 1612011351 13.0.1

89

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-26: Indoor Map monitors

QualiPoc saves the positions that you mark in the measurement file. You can load these
markers in the NQDI post-processing software. If you want, you can load another map
during the measurement. When you reload a map, QualiPoc also reloads the previous
tracking list.

5.7.6 IP and PCAP Logging Monitors


The "IP trace" monitor is a list monitor that displays header information from HTTP, FTP,
TCP, DNS and ICMP packages. If you want, you can disable protocol items in the monitor
settings. You can also specify a text filter to customize what you see on the monitor.
Touch an item on the screen to view the decoded package. QualiPoc writes the HTTP,
FTP, TCP, DNS and ICMP packages to the MF independent of the filter settings.

Manual 1612011351 13.0.1

90

SwissQual...QualiPoc

Using QualiPoc
Monitors

Fig. 5-27: IP and PCAP monitors

5.7.7 Test and Events Monitors


QualiPoc displays results in the form of KPIs and statistics. KPIs are test-dependent, for
example the call setup time for a call to any number test and throughput for an HTTP
transfer test. Statistics represent the number of successfully completed tests as well as

Manual 1612011351 13.0.1

91

SwissQual...QualiPoc

Using QualiPoc
Monitors

average, minimum, and maximum KPI results. The "Events" monitor lists all most important events, for example Call States, that QualiPoc traces during the tests.

Fig. 5-28: Test and Events monitors

Manual 1612011351 13.0.1

92

SwissQual...QualiPoc

Measurement Files Post-Processing


Measurement File Logging

6 Measurement Files Post-Processing


QualiPoc creates and stores Measurement Files (MF) on the smartphone. You can replay
and analyse the contents of these files on the smartphone with the QualiPoc replay function or on your computer with SwissQual software.

6.1 Measurement File Logging


QualiPoc creates an MF when a job or idle recording starts and then stores the file on
the SD CARD in the [sdcard/QualiPoc/Results] folder.

Fig. 6-1: Measurement files

6.2 Replaying Measurements on the Phone

and touch
To replay a measurement in QualiPoc on your smartphone, press Menu
"Replay", slide open the bottom menu, tap the folder icon, select the file that you want
to replay, and then tap the Play icon.

You cannot replay an *.sqz file.

You can use the remaining controls to perform the following actions:

Return to previous session

Advance to next session

Pause the playback

Step through or fast forward through the replay

Fig. 6-2: Replay controls

While the phone is in this mode, "Replay" appears in a blue bar at the top of the screen.

Manual 1612011351 13.0.1

93

SwissQual...QualiPoc

Measurement Files Post-Processing


Transferring the Measurement Files to a PC

Fig. 6-3: QualiPoc title bar in Replay mode

To return to live mode, press Menu

and touch "Live".

6.3 Transferring the Measurement Files to a PC


You need to connect your phone to your PC as a storage device with a USB cable to
transfer the measurement files. The procedure might vary according to the model of the
phone. For more information, see the user guide for your phone.

6.4 Replaying Measurement Files in NetQual NQView


You can use NetQual NQView to replay multiple measurement files. During the playback,
you can open monitors for different quality parameters to observe the progress of a test
and search for points of interest in the monitors such as dropped calls, Layer 3 messages,
and so on. You can also search for measurement files that contain specific parameters
such as technology, operator, KPI thresholds, and RF channel numbers. NQView also
allows you to export certain data in CSV, Google Earth, and MapInfo format. For more
information, see the Manual NQView.pdf document.

Manual 1612011351 13.0.1

94

SwissQual...QualiPoc

Measurement Files Post-Processing


Analysing Measurement Data with NetQual NQDI

Fig. 6-4: NQView window

6.5 Analysing Measurement Data with NetQual NQDI


NetQual NQDI is designed to help you to perform an in-depth analysis of your measurement data, for example, a detailed analysis of mobile network services and protocols.
NQDI can quickly analyse CS and PS calls to help you to determine the main factors for
network. NQDI mapping support includes more than 500 pre-defined map plot items in a
powerful and fully configurable plot engine that supports MapInfo and Google Earth. This
engine also supports configurable binning on grid or latitude-longitude precision. NQDI
can generate reports in Excel format based on the measurement data. These reports can
contain success rate and average pivot tables with PDF, CDF, and Pie charts. NQDI also
has a trending sort function that can group data into time frames from one hour up to a
year. In addition to the default extended set of NQDI reports, you can customize your
own KPI report with the KPI report generator. For all details about NetQual NQDI please
see Manual NQDI.pdf.

Manual 1612011351 13.0.1

95

SwissQual...QualiPoc

Measurement Files Post-Processing


Analysing Measurement Data with NetQual NQDI

Fig. 6-5: NQDI window

Manual 1612011351 13.0.1

96

SwissQual...QualiPoc

Creating an Answering Station for QualiPoc Android

A Creating an Answering Station for QualiPoc


Android
The following sections describe how to convert a Diversity Call Server to an answering
station for QualiPoc Android in NQView.
For more information on the Diversity Call server, see chapter B, "Configuring Voice and
Video Call Servers", on page 108.
You can use the answering station for chapter 4.3, "Single CALL Job Speech MOC",
on page 26.
To create a answering station for QualiPoc Android
1. On the call server, create a folder with the name DefaultJobs in the following location:

C:\Program Data\SwissQual\Diversity\Tasks

2. In the "Control" console of NQView, add a call server to the "System Configuration".
a) On the Navigation panel, click "System configuration".
b) Right click "Hardware", point to "Add unit", and then click "PC".
c) On the "General" tab, select "Enabled", and specify the following information:

In the "Name" box, type the name for the call server.
In the "Computer" name box, type the Windows computer name of the call
server.
In the "Time synchronization" list, click "Internal sync".
In the "NQComm" control list, click "Diversity FTP".
In the"Unit control" list, click "Diversity FTP".
In the"NQComm result" list, click "Diversity FTP".

Manual 1612011351 13.0.1

97

SwissQual...QualiPoc

Creating an Answering Station for QualiPoc Android

d) Click "Apply" and click "OK".


Do not update the configuration of the unit.

Fig. 1-1: Create call server

3. Add one or more PSTN or ISDN devices to the call server.


a) Right-click the call server in the tree, point to "Add device", and then click
"ISDN" or "PSTN".
b) In the "Name" box, type a name for the device.
c) In the "Model" list, click a name.
d) d In the "Subscriber" list, click a subscriber profile.

Manual 1612011351 13.0.1

98

SwissQual...QualiPoc

Creating an Answering Station for QualiPoc Android

e) Select "Enabled", click "Apply", and then click "OK" .

Fig. 1-2: Add PSTN or ISDN device

Note: Do not select the"DTMF scan" option. Do not select "The device is an answering station" option in the"Answering station" area.
4. Create an intrusive speech job for the call server.
a) On the Navigation panel and click "Tasks and Jobs".
b) Expand "Job definitions", right-click Intrusive, and then click "Add job".
c) In the "Name" box, type a name for the job, for example, Answering Station
IT_clip_08.
d) In the "Record hang-over [ms]" box, type 18500.
For the "QP_default" audio clip, type 14500.
e) Clear the "Use call duration to abort call" check box.

Manual 1612011351 13.0.1

99

SwissQual...QualiPoc

f)

Creating an Answering Station for QualiPoc Android

In the "MOC:MTC" ratio box, type 1:0, click "Apply", and then click "OK".

Fig. 1-3: Create a job for the call server

g) In the "Direction" area, click "B to A".


h) In the "Reference sample" list, click the audio clip for the answering station.

Manual 1612011351 13.0.1

100

SwissQual...QualiPoc

i)

Creating an Answering Station for QualiPoc Android

Click "Apply" and click "OK".

Fig. 1-4: Reference audio sample for the job

5. Create a task that involves the call server and an A-side device.
If your system does not have an A-side device, add one as a placeholder device for
the task.
a) Right-click "Measurement tasks" in the tree and click "Add task".
b) In the "Name" box, type a name for the task, for example, Android Speech.
c) In the"Device A/B" side area, assign the devices.
In the first list, click your A-side device.
In the second list, click the call server that you created.
d) In the "Job sequence" area, click the green plus sign .
e) In the "Job" list, click the job that you created in "To create a answering station
for QualiPoc Android" on page 97, and then click "Save".

Fig. 1-5: Job details in task

Manual 1612011351 13.0.1

101

SwissQual...QualiPoc

f)

Creating an Answering Station for QualiPoc Android

In the "Measurement task" window, click "Apply", and then click "OK".

Fig. 1-6: Create measurement task

g) Right-click the task in the tree, click "Export B-side task" file, browse to a location,
and then click "OK".

Fig. 1-7: Export B-side task file

h) Copy the B-side task file to the following location on the call server:
6. Edit the settings in the B-side task file.

Manual 1612011351 13.0.1

102

SwissQual...QualiPoc

Creating an Answering Station for QualiPoc Android

a) Open the B-side task file, in this case,


Answering Station IT_clip_08.ini, in a text editor.

C:\Program Data\SwissQual\Diversity\Tasks\DefaultJobs

Fig. 1-8: B-side task file

Manual 1612011351 13.0.1

103

SwissQual...QualiPoc

Creating an Answering Station for QualiPoc Android

b) Set the following values:

CallWndSize=0
CallDuration=0
PauseDuration=15
This value must match the pause duration for the job on the QualiPoc Android
mobile phone.
MaxCSTime=30
This value must match the Max call setup time for the job on the QualiPoc
Android mobile phone.
TestSeqRepetition=999
This value allows for QualiPoc calls that are longer than 6 hours
RecordHO=18500
For a "QP_default" audio clip, use 14500.
c) Save the file.
7. Edit the Windows Registry on the call server.
a) Open the Registry Editor.
b) Right-click the following key and click "Modify":
HKEY_LOCAL_MACHINE\SOFTWARE\SwissQual\NetQual\NQMP\
ConfigCallMOCOnly=1
c) Change the value of the key to 0 and click "OK".

Fig. 1-9: ConfigCallMOCOnly value

d) On the "File" menu, click "Exit".


Note: You also need to edit this registry key after you install a Diversity software
update on the call server.
8. Update the unit configuration.

Manual 1612011351 13.0.1

104

SwissQual...QualiPoc

Creating an Answering Station for QualiPoc Android


Modifying the Answering Station

a) If the call server is connected to NQView, right-click the unit on the "System configuration" panel of the "Control" console, and click "Update configuration".

Fig. 1-10: Update the configuration of the answering station

b) If the call server is not connected to NQView, you need to complete the following
steps:

Right-click the unit on the "System configuration" panel, point to "Export configuration", and then click "Unit only".
Copy the .config file to the call server, for example, with a USB stick.
On the call server, click "Stop" on the "Control" menu in Diversity Supervisor.
On the "Tools" menu, click "Import Configuration", locate the .config file for
the unit, and then click "Open".
On the "Control" menu, click "Start".

Note: If you see error messages, restart Diversity Supervisor.

A.1 Modifying the Answering Station


This section describes how to quickly change the reference audio sample that the
answering station plays and how to revert the answering station to a call server.

A.1.1 Changing the Reference Sample for the Job


If you want to quickly change the audio clip, that is, reference sample, for the job, you
can edit the B-side task file.

Manual 1612011351 13.0.1

105

SwissQual...QualiPoc

Creating an Answering Station for QualiPoc Android


Modifying the Answering Station

To quickly change the reference sample


1. In a text editor, open the B-side task file that you exported in "To create a answering
station for QualiPoc Android" on page 97, for example, Answering Station IT_clip_08.ini.
2. In the "Tests" section at the end of the file, you can modify the following parameters:

TestName_0: You can enter Speech or Speech POLQA


TypeOfTest_0: You can enter Speech or Speech POLQA
ReferenceSample_0: You can change the first two letters of the file name to
use a different language. For example, if the current reference sample is
IT_fm_IRS.wav, you can change the first two letters from IT to EN for the English language audio file.

Fig. 1-11: B-side task configuration file

3. Save the file.


4. In Diversity Supervisor, click "Stop" on the "Control" menu.
5. After Supervisor stops, click "Start" on the "Control" menu.

A.1.2 Restoring the Diversity Call Server


You can change the answering machine back to a call server with a simple Windows
Registry edit.
To revert the answering station to a call server
1. Edit the Windows Registry on the answering station.
a) Open the Windows Registry Editor.
b) Right-click the following key and click "Modify":

HKEY_LOCAL_MACHINE\SOFTWARE\SwissQual\NetQual\NQMP\
ConfigCallMOCOnly=0

Manual 1612011351 13.0.1

106

SwissQual...QualiPoc

Creating an Answering Station for QualiPoc Android


Measurement Files

c) Change the value of the key to 1 and click "OK".

Fig. 1-12: Change value of ConfigCALLMOCOnly to 1

d) On the "File" menu, click "Exit".


2. Rename or delete the DefaultJobs folder in the following location:

On Windows 7: C:\Program Data\SwissQual\Diversity\Tasks


On Windows XP:
C:\Documents and Settings\All Users\Application Data\
SwissQual\Diversity\Tasks\

3. Update the unit configuration on the answering station.


a) If the call server is connected to NQView, right-click the unit in the "System configuration" tree, and click"Update configuration".
b) If the call server is not connected to NQView, you need to complete the following
steps:

Right-click the unit in the "System configuration" tree, point to "Export configuration", and then click unit only.
Copy the .config file to the call server, for example, with a USB stick.
On the call server, click "Stop" on the "Control" menu in Diversity Supervisor.
On the "Tools "menu, click "Import Configuration", locate the .config file for
the unit, and then click "Open".
On the "Control" menu, click "Start".

Note: If you see error messages, restart Diversity Supervisor.

A.2 Measurement Files


When the answering station is based on a voice call server, the measurement file option
for the server is enabled in the license. As a result, the server generates a B.sqz in the
result folder each time the voice engine stops, for example, during a reboot or when a
new default job starts. The related B.mf file is also created in the "Device" folder of the
MeasurementFiles folder. These files are transferred to the controlling laptop whenever a network connection is established.

Manual 1612011351 13.0.1

107

SwissQual...QualiPoc

Configuring Voice and Video Call Servers


Offline Configuration Mode

B Configuring Voice and Video Call Servers


A Diversity Voice or Video Call Server is a PCM or computer that controls PSTN or ISDN
phone lines. A Diversity Video Call Server controls the B-Side mobile phones in a video
call test. This server is also known as a Land Unit (LU).
You can use NQView to configure a Voice or Video Call Server in offline or online mode.
You can also create and configure a Diversity DTMF voice call server directly in Diversity
Supervisor, which is part of the Diversity Core installation, for example, for Diversity
Benchmarker.

B.1 Offline Configuration Mode


To configure a Voice or Video Call Server in offline mode, you need to perform the following steps:

In NQView, define the settings for the server, including the connection profiles

Export the settings to a configuration file

Copy the configuration file to the server

Import the configuration file on the server with Diversity Supervisor

B.2 Online Configuration Mode


To configure a Voice or Video Call Server in offline mode, you need to perform the following steps:

Define the settings for the server in NQView

Define the connection profile for a direct connection in NQView

Connect the server through a LAN to the controlling PC

Update the settings on the server

Change the connection profile in NQView

Disconnect the server from the controlling PC

B.3 Configuring a Voice or Video Call Server in NQView


This section describes how to configure a voice and video call server in offline mode as
well as online mode.

Manual 1612011351 13.0.1

108

SwissQual...QualiPoc

Configuring Voice and Video Call Servers


Configuring a Voice or Video Call Server in NQView

B.3.1 Configuring the Server in Offline Mode


This section describes how to export a configuration file for a voice and video call server
from NQView and how to import the file on your server. During the export process,
NQView does not validate if subscribers or phone numbers are assigned to the devices.
If you try to run a task on a device that does not have these assignments, the task fails
and you receive an error message about the missing assignment.
You need to repeat this procedure for each PC or PCM that you use as a Voice Call
Server.
To configure a voice or video call server with NQView
1. On the controlling PC, start NQView, and select the "Control" console.
2. Export the configuration files for the voice or video call server.
a) On the "System configuration" panel, right-click the voice or video call server unit,
point to "Export configuration", and then click "Unit, campaigns, tasks".
If you do not want to export the tasks and jobs for the server, select "Unit only".

Fig. 2-1: Export voice or video call server configuration

b) Go to where you want to save the *.config file, and then click "OK".

Manual 1612011351 13.0.1

109

SwissQual...QualiPoc

Configuring Voice and Video Call Servers


Configuring a Voice or Video Call Server in NQView

Note: If you want to view the contents of the configuration file, change the file extension from *.config to *.zip, and then open the ZIP file. This file contains individual
XML files.
3. Copy the configuration file to the voice or video call server.
4. On the voice or video call server, import the configuration file.
a) In the Windows notification area, double-click the Diversity Supervisor icon .
b) On the "Control" menu, click "Stop".
c) Wait until only the "SuperVisor" tab remains open, and then click "Import Configuration" on the "Tools" menu.
Diversity Supervisor does not validate the configuration file during the import
process. If the configuration file contains an error, the server enters an error state
during system startup.

Fig. 2-2: Import configuration file for voice or video call server

d) In the "Open" dialog box, locate the configuration file, for example,
PCM8000000.config, and then click "Open".
e) In the "Confirm" dialog box, click "Yes", and in the "Info" dialog box click "OK".

Fig. 2-3: Confirm dialog box

f) On the "File" menu, click "Exit SuperVisor".


g) On the Desktop, double-click the Diversity SuperVisor icon.

Fig. 2-4: Diversity Supervisor Desktop icon

Manual 1612011351 13.0.1

110

SwissQual...QualiPoc

Configuring Voice and Video Call Servers


Configuring a Voice or Video Call Server in NQView

B.3.2 Configuring the Server in Online Mode


This section describes how to update the server from NQView. You need to repeat this
procedure for each PC or PCM that you use as a Voice Call Server.
To configure a Voice or Video Call Server in online mode with NQView
1. Connect the server to the controlling PC.
a) Connect the controlling PC to the server through a LAN cable.
b) For a voice call server, connect the phone lines to the PSTN or ISDN card.
c) On the PC, start NQView and select the "Control" console.
2. On the "System configuration" panel, right-click the server, and then click "Edit".
3. Ensure that the "Computer Name" is different from the computer names in your
Diversity system.
4. Ensure that the correct profiles are selected and click "OK".

Fig. 2-5: Voice Call Server properties

5. If your server uses DTMF job transfer, right-click a device on the server, for example,
an ISDN device, and ensure that the "DTMF scan" check box is selected.

ISDN settings tab if your server uses an ISDN board

Manual 1612011351 13.0.1

111

SwissQual...QualiPoc

Configuring Voice and Video Call Servers


Configuring a Voice or Video Call Server in NQView

Fig. 2-6: ISDN settings

6. Right-click the server and click "Update Configuration".

Fig. 2-7: Update Voice or Video Call Server

Manual 1612011351 13.0.1

112

SwissQual...QualiPoc

Configuring Voice and Video Call Servers


Configuring a Voice Call Server in Diversity Supervisor

B.4 Configuring a Voice Call Server in Diversity Supervisor


This section describes how to configure a voice call server in Diversity Supervisor, which
is part of the Diversity Core installation, for example, for Diversity Benchmarker.
To create a voice call server with Diversity SuperVisor
1. Double-click the Diversity Supervisor icon on the Desktop.

Fig. 2-8: Diversity Supervisor Desktop icon

2. Right-click Diversity Supervisor icon in the Windows Notification area, point to


"Supervisor", and then click "Show".

Fig. 2-9: Show Diversity SuperVisor

3. On the "Control" menu, click "Stop".

Manual 1612011351 13.0.1

113

SwissQual...QualiPoc

Configuring Voice and Video Call Servers


Configuring a Voice Call Server in Diversity Supervisor

Fig. 2-10: Stop Diversity SuperVisor

4. On the "Tools" menu, click "Land Unit Configuration".

Fig. 2-11: Open Land Unit configuration

5. Add a device.

Manual 1612011351 13.0.1

114

SwissQual...QualiPoc

Configuring Voice and Video Call Servers


Configuring a Voice Call Server in Diversity Supervisor

a) Right-click your computer name in the tree and click the type of call device that
you want to add, for example, a PSTN Device.

Fig. 2-12: Add PSTN device

b)
c)
d)
e)

f)

In the "Device Type" list, click the device.


In the "Phone Number" box, type the number.
In the "Board Number" box, type the board number.
In the "Channel Number" box, type the channel for the device.
The phone, board, and channel numbers must be unique for each device that you
add.
Click "OK" and in the confirmation dialog box, click "Yes".

Fig. 2-13: Device settings

Note: Repeat these steps for each device that you want to use.
6. On the "Control" menu, click "Start".

Manual 1612011351 13.0.1

115

SwissQual...QualiPoc

Call Quality
Defining Call Quality

C Call Quality
The following sections describe Call Quality, which rates a complete call according to
subscriber experience.
The goal is to model how a subscriber would rate the call when the call is over. The main
quality determination is provided by the so-called "recency effect", that is, recent perceived quality degradations have a greater influence on the score, and a weighted average procedure, in which a strong quality drop has a strong influence on the overall call
quality.
To create the Call Quality prediction model, an auditory investigation was performed with
a simulated conversation in a fixed temporal structure [Neusinger, Berger: ETSI-STQ
04/2202]. This model can also be applied to test calls that consist of a series of test
samples that have been scored by P.862.1 or SQuad-LQ, so long as the defined temporal
structure has been met. The corresponding ETSI recommendation is [ETSI-STQ TR 102
506].
The Call Quality model contains the following steps:

Recency effect scores from the fist samples in the call are weighted less in the averaging process

To model impacts on call quality by drops of quality during the call, non-linear averaging is applied, which weights single MOS drops stronger than when the common
quality in the call is high.

C.1 Defining Call Quality


The Call Quality model can be applied to each call that fulfils the required temporal structure. To use the Call Quality model, you need to create and run a Speech measurement
job, for example, Job_CallQuality.ini, that matches the following requirements:

"Job type": "Intrusive"

10 x Speech and Speech-P.862 tests, that alternate between 5 x A->B and 5 x B->A

Sample length + Record hangover = 11.5 s

NQDI can calculate Call Quality during post-processing or during the database import
procedure, that is, the VoiceEngine does not calculate Call Quality. NQDI calculates the
Call Quality of calls that meet the following requirements:

"Job type": "Intrusive"

Only 5 Speech or Speech-P.862 tests in UL or DL per call

5 x A->B or 5 x B->A tests (alternating)

Time from the beginning of the first sample in the call to the beginning of the last (fifth)
sample in this direction is within the 100 and 115 s range

The Call Quality is calculated separately for the A->B and B->A directions as well for P.
862.1 and SQuad-LQ. As a result, four Call Quality values are calculated for Speech-P.
862 and UL/DL tests and two values for SQuad-LQ Speech UL and DL tests. For Qual-

Manual 1612011351 13.0.1

116

SwissQual...QualiPoc

Call Quality
3 Viewing the Results

iPoc or special applications that involve a DL or UL test, only one Call Quality value is
calculated for the test direction.
If you use a default SwissQual audio file, for example, AM_FM_IRS.wav, to evaluate the
Call Quality, you need to specify a "Record HO" value of 5500 ms. If you use the
AM_CallQual_IRS.wav audio file, which is a special Call Quality speech sample, you
need to specify a "Record HO" value of 1000 ms.
Due to the short hangover time, do not use the AM_CallQual_IRS.wav audio file for
Video Calls.

C.2 3 Viewing the Results


If a job NQDI meets the requirements for a Call Quality calculation, the Call Quality values
appears on the "CallQuality" tab in NQDI.

Fig. 3-1: CallQuality tab in NQDI window

Manual 1612011351 13.0.1

117

SwissQual...QualiPoc

Call Setup Time

D Call Setup Time


The following sections describe the call setup time, which is an important indicator of the
quality of service of a mobile or fixed telephone network.
To provide comparable measurement results across various technologies, SwissQual
measurement tests need to rely on call features that are common to each technology, for
example, the setup time. This document describes the setup time that is generally known
as the call setup time in the system. For a description of other methods to calculate setup
time, see the Manual - NQDI - KPI Users Guide.pdf document.

Fig. 4-1: Call Setup Sequence (marker in bold)

A common definition for call setup time is the amount of time that occurs between the
push of the send, dial, or call button and the reception of an audio channel by the called
party (B-side device) from the calling party (A-side device). This reception is also known
as the switch to conversation mode. In figure 4-1, the call setup time is represented by
the arrow between the Dial and Connected markers on the calling-party side of the diagram.
This definition applies to intrusive voice and video telephony tests as well as to nonintrusive voice call and call to any number tests that originate in GSM, UMTS, or ISDN
technologies.
Since CDMA, IS-136, and iDEN use tone detection, the Connected marker in these technologies corresponds to the detection of the first audio signal.
Based on this definition, the call setup time can easily be calculated on digital networks.
However, if one party uses an analog device or a technology that does not provide a
protocol message to indicate a connection, the situation is more complex.

Manual 1612011351 13.0.1

118

SwissQual...QualiPoc

Call Setup Time


Dialing

D.1 Dialing
This section describes the dialing process during the call setup time of a measurement
test.
If the A-side device uses a PSTN device, the device needs to check the connected network for a dial tone before calling. This action prompts the test to add a Wait for Channel
Ready message to the measurement file. After the dial tone is found, the PSTN board
dials the number and the test adds a Dialing.. message to the measurement file.
Mobile phone devices that use time-consuming key press emulation also add a Dialing
message to the measurement file.
At this point, the test starts the call setup timer and adds the Dial call marker to the
measurement file.

D.1.1 Incoming Call (B-Side Device)


An incoming call is only registered by the B-side device during an intrusive voice call or
video telephony call test.
The remaining voice call types do not have a log on the B-side device.

A test adds the Incoming Call marker to the measurement file when the B-side device
detects an incoming call. The device has an accept delay of 500 ms during which a PSTN
device tries to reliably determine the presence of an incoming call. Devices that use other
technology types simply wait during this delay period in order to retain comparability
between the technologies in the measurement results. When a call is accepted and the
B-side device switches to conversation mode, the Connected marker is added to the
measurement file. After the connection is established, the B-side device waits one second
plus the "SyncDelay" time that you specified for the B-Side device in the test configuration
before sending the connectall.wav audio sequence.

D.1.2 Calling Party Connect (A-Side Device)


The test tries to set the Connected call marker when the A-side device switches to conversation mode. However, this marker cannot be set in PSTN or with technologies such
as IS-136 and CDMA. In an intrusive voice call, the B-side device sends the connectall.wav audio sequence that the A-side searches for. Upon detection of the sequence,
the A-side calculates the connected time by determining the start of the synchronization
sequence and subtracting the sync delay and 1 second. This calculation appears as
connected (+ xxxms) in the measurement file, where the number in brackets represents
the time between the detection of sync and the time of the actual connection.

Manual 1612011351 13.0.1

119

SwissQual...QualiPoc

Call Setup Time


Dialing

The audio channel is assumed to be present when the B-side device is connected.

Manual 1612011351 13.0.1

120

SwissQual...QualiPoc

Fixed Duration Tests


Fixed Duration Test

E Fixed Duration Tests


The following sections describe the new variant of TCP-based data tests for Diversity,
including FTP, HTTP, and Capacity tests. This information is crucial to understanding
and collecting useful test data.
The technology in a wireless network can vary from location to location. This variation
can affect the data transfer speeds of a typical static quality measurement during a drive
test, for example, when you drive from a high bandwidth to a low bandwidth area. If the
intent of your measurement campaign is to determine the comprehensive average
throughput of the network, the campaign will fail due to the different download and upload
speeds in the high and low bandwidth areas in your network.
The problem arises when you base this calculation on the number of successful transfers
of a complete file while driving at a constant speed for the duration of the test. Due to the
different throughput rates, more transfers are likely to complete in a high bandwidth area
than in a low bandwidth area over the same amount of time. As a result, the statistics
tend to be weighted in favour of the high bandwidth values, which can eclipse the low
bandwidth values.
The comparison of different networks with parallel benchmarking of standard non-fixed
duration tests can sometimes lead to incorrect and biased results.
To solve this problem, SwissQual has developed TCP-based fixed duration tests.

E.1 Fixed Duration Test


The fixed duration test calculates the average throughput values in a heterogeneous
wireless network. More specifically, the test measures the data transfer performance of
the network by uploading and downloading files with the FTP and HTTP TCP/IP protocols. These tests yield more measurement results than tests in which the data transfer
must complete. A fixed duration test also measures the constant output of throughput
rates over time so that you can compare the comprehensive throughput averages or map
plots from different fixed duration tests.
A data transfer lasts for the entire duration of the test and then terminates, regardless of
whether the transfer successfully completed. As a result, the test can directly compare
the data transfer rates in a mixed high and low bandwidth network and calculate the
average expected throughput from a large number of samples that are evenly distributed
over time.

E.2 Limitations
The fixed duration test does not calculate download success rates. That is, if a data
transfer successfully completes before the test ends, the test fails.

Manual 1612011351 13.0.1

121

SwissQual...QualiPoc

Fixed Duration Tests


References

E.3 References

ETSI TS 102 678 Speech and multimedia Transmission Quality (STQ); QoS Parameter Measurement based on fixed Data Transfer Times

Manual NQDI KPI Users Guide.pdf

E.4 Configuring Fixed Duration Tests


This section describes how to configure FTP, HTTP, and Capacity tests with a fixed
duration in NQView.

E.4.1 FTP and HTTP Tests


This section describes how to enable the fixed duration option in an FTP or an HTTP test.
To configure FTP and HTTP jobs as fixed duration tests
1. In the"Control" console of NQView, click "Tasks and Jobs" on the Navigation panel.
2. Right-click "Job definitions" in the tree and click "Add job".
3. Type a name for the job and click "OK".
4. In the "Data test" dialog box, type a name for the job.
5. In the "Test type" list click "FTP" or "HTTP".
6. Specify the test settings.
a)
b)
c)
d)
e)
f)

In the "Max duration" box, specify the maximum duration for the test.
Select "Use as fixed duration".
In the "Host" box, type the address of the host server.
In the "Operation" area, specify the transfer direction.
Select a local or specify a remote file for the data transfer that is large enough to
not completely transfer during the test.
If necessary, specify the login information for the host server.

7. Click "Apply" and click "OK".

Manual 1612011351 13.0.1

122

SwissQual...QualiPoc

Fixed Duration Tests


Configuring Fixed Duration Tests

Fig. 5-1: Enabling fixed duration test option

E.4.2 Capacity Test


By default, a Capacity test has a fixed duration, which you cannot disable. You need to
use files that are large enough to not completely transfer during the test. If one of the
active transfers completes during the test, the test fails. During this test, the files transfer
simultaneously.
The "Put" test uploads the files into the system RAM before the transfer starts. To avoid
overloading your system, do not select files that exceed the amount of available RAM.
The "Get" test downloads files, the "Put" test uploads files, and the "Get and Put" test
downloads and uploads files
To create a Capacity test in NQView
1. In the "Control" console of NQView, click "Tasks and Jobs" on the Navigation panel.
2. Right-click "Job definitions" in the tree and click "Add job".

Manual 1612011351 13.0.1

123

SwissQual...QualiPoc

Fixed Duration Tests


Configuring Fixed Duration Tests

3. Type a name for the job and click "OK".


4. In the "Data test" dialog box, type a name for the test.
5. Specify the test settings.
a) In the "Test type" list, click "Capacity".
b) Specify the remaining options for the test.
c) Click "Apply", and then click "OK".

Fig. 5-2: Configuration of the Capacity test

The data to be transferred are buffered between the TCP and application layers. The
buffering can lead to differences in the amount of received and sent data for the same
point in time on the two layers and differences in the measured throughput. To minimize
the difference to around 5% error, use a fixed duration that is longer than the experienced
throughput is.
Recommended fixed durations for single transfers (get or put) HTTP/FTP test:

Throughput > 100kbps then 90s

Throughput < 200kbps then 60s

Throughput < 2000kbps then 30s

Manual 1612011351 13.0.1

124

SwissQual...QualiPoc

Fixed Duration Tests


3 Example Scenario and Results

Throughput > 2000kbps then 20s

Recommended fixed durations for multiple transfers (get or put) in a parallel Capacity
test:

Throughput < 100kbps then 120s

Throughput < 200kbps then 90s

Throughput < 2000kbps then 60s

Throughput > 2000kbps then 30s

The "Capacity Get" and "Put" test are not suitable for throughputs < 1000kbps (GSM in
general).

E.5 3 Example Scenario and Results


In the following scenario the data transfers occur in a commercially available application
stack. The stack receives commands from an external application, that is, the measurement engine, which controls the timing. The timing starts with the engine send the start
command and ends when the engine sends the stop command after the configured time
elapses.

Fig. 5-3: Overview

Due to processing delays the fixed duration that you specify does not precisely match
the time that the transfer lasts.

Manual 1612011351 13.0.1

125

SwissQual...QualiPoc

Fixed Duration Tests


3 Example Scenario and Results

E.5.1 Results
The fixed duration information is included in the measurement file as a test property. This
property appears as a special report item in the report generator.
To include fixed duration information in an NQDI report
1. Import the relevant file into NQDI.
2. On the "Data Selection" tab, click the "Test" tab.
3. On the "Test" tab, click the "Data" tab, and then click the "FTP" or "HTTP" tab.
4. Click the "Uncheck all selections" icon
then click the "Refresh" icon .

at the top of the "Data Selection" tab and

5. Select "Fixed duration" and click "Fixed duration" in the list.

Fig. 5-4: Include fixed duration in FTP report

In the "Parameters" area of the results tab for the test, the "Test timeout" parameter
shows the fixed duration information.

Manual 1612011351 13.0.1

126

SwissQual...QualiPoc

Fixed Duration Tests


TCP-Based KPIs

Fig. 5-5: Test timeout parameter

E.6 TCP-Based KPIs


This section describes the set of KPIs for fixed duration scenarios that have been developed for release 11.1. Each FTP, HTTP, and Capacity test scenario has a corresponding
set of TCP-based KPIs.
Prior to release 11.1, KPIs were calculated differently, that is, after a non-fixed duration
when the download had successfully completed. This approach has been abandoned.
Fixed Duration KPIs are now calculated when you enable the fixed duration in the test
configuration. Non-fixed duration KPIs are only calculated when you do not enable the
fixed duration option. As of 11.1, the success and failure is also tied to the result of the
test. In previous versions, in particular 10.6.x or 11.0.x, mixed approaches were used.
The start triggers for the fixed duration TCP KPIs are the same as for the normal TCP
KPIs, for example, HTTP/1.1 200 OK for HTTPTransfer GET. The end trigger for a fixed
duration KPI is the last packet that contains data for downlink or the FIN;ACK for the
uplink KPIs. For more information, see the
Manual - NQDI - KPI Users Guide.pdf document. In general the retainability
KPIs are slightly shorter than the configured fixed duration.

E.6.1 FTP KPIs


The following KPIs are calculated for the FTP fixed duration scenario:

Manual 1612011351 13.0.1

127

SwissQual...QualiPoc

Fixed Duration Tests


TCP-Based KPIs

20310 Retainability FTP Uplink Fixed Duration

20311 Retainability FTP Downlink Fixed Duration

30310 Integrity FTP Uplink Fixed Duration

30311 Integrity FTP Downlink Fixed Duration

E.6.2 HTTP Transfer KPIs


The following KPIs are calculated for the HTTP Transfer fixed duration scenario:

20411 Retainability HTTP Transfer Get Fixed Duration

20412 Retainability HTTP Transfer Put Fixed Duration

30411 Integrity HTTP Transfer Get Fixed Duration

30412 Integrity HTTP Transfer Put Fixed Duration

E.6.3 Capacity KPIs


The following KPIs are calculated for the Capacity test fixed duration scenario:

20461 Retainability Capacity Get

20462 Retainability Capacity Put

20463 Retainability Capacity Get and Put

30461 Integrity Capacity Get

30462 Integrity Capability Put

30463 Integrity Capacity Get and Put

Manual 1612011351 13.0.1

128

You might also like