Professional Documents
Culture Documents
QualiPoc
Android
Manual
13.0.1
(@<1=)
Manual
1612011351 13.0.1
SwissQual has made every effort to ensure that eventual instructions contained in the document are adequate and free of errors and omissions. SwissQual will, if necessary, explain issues which may not be covered
by the documents. SwissQuals liability for any errors in the documents is limited to the correction of errors
and the aforementioned advisory services.
Copyright 2000 - 2013 SwissQual AG. All rights reserved.
No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system,
or translated into any human or computer language without the prior written permission of SwissQual AG.
Confidential materials.
All information in this document is regarded as commercial valuable, protected and privileged intellectual
property, and is provided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material.
When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo
trademark somewhere in your text.
SwissQual, Seven.Five, SQuad, QualiPoc, NetQual, VQuad, Diversity as well as the following
logos are registered trademarks of SwissQual AG.
Diversity ExplorerTM, Diversity RangerTM, Diversity UnattendedTM, NiNA+TM, NiNATM, NQAgentTM,
NQCommTM, NQDITM, NQTMTM, NQViewTM, NQWebTM, QPControlTM, QPViewTM, QualiPoc FreeriderTM,
QualiPoc iQTM, QualiPoc MobileTM, QualiPoc StaticTM, QualiWatch-MTM, QualiWatch-STM, SystemInspectorTM, TestManagerTM, VMonTM, VQuad-HDTM are trademarks of SwissQual AG.
SwissQual...QualiPoc
Contents
Contents
1 Introduction............................................................................................7
1.1
Service Tests.................................................................................................................7
1.2
Device Support..............................................................................................................8
1.3
Post-Processing Software............................................................................................8
1.4
QualiPoc Monitors........................................................................................................8
1.5
Related Documents.......................................................................................................9
GPS Configuration......................................................................................................10
2.2
2.3
3 QualiPoc Settings................................................................................12
3.1
Map Settings................................................................................................................13
3.2
BTS Information..........................................................................................................14
3.3
Layer 3..........................................................................................................................14
3.4
IP Monitor.....................................................................................................................15
3.5
Customization.............................................................................................................16
3.6
Notifications................................................................................................................17
3.7
Technology Forcing....................................................................................................18
3.7.1
3.8
Unit Configuration.......................................................................................................20
3.9
3.10
3.10.1
3.10.2
4.2
4.3
4.4
4.4.1
SwissQual...QualiPoc
Contents
4.4.2
4.4.2.1
4.4.2.2
4.4.3
4.4.3.1
4.4.3.2
4.4.3.3
4.5
4.6
4.7
4.8
4.9
4.10
4.10.1
4.11
4.12
4.13
4.14
4.15
4.16
4.17
Job Sequence..............................................................................................................59
4.18
5 Using QualiPoc.....................................................................................63
5.1
Help Menu....................................................................................................................63
5.2
5.3
5.3.1
Stopping a Job..............................................................................................................66
5.4
5.4.1
5.4.2
5.4.2.1
Stopping a Job..............................................................................................................71
5.5
Viewing Results...........................................................................................................71
5.5.1
SwissQual...QualiPoc
Contents
5.6
5.7
Monitors.......................................................................................................................75
5.7.1
5.7.2
5.7.3
Technology Monitors.....................................................................................................78
5.7.3.1
5.7.3.2
Data Monitors................................................................................................................79
5.7.3.3
5.7.4
Layer 3 Monitors...........................................................................................................81
5.7.4.1
5.7.5
Map Monitors................................................................................................................83
5.7.5.1
5.7.5.2
5.7.6
5.7.7
6.2
6.3
6.4
6.5
A.1.1
A.1.2
A.2
Measurement Files....................................................................................................107
SwissQual...QualiPoc
Contents
B.2
B.3
B.3.1
B.3.2
B.4
C Call Quality.........................................................................................116
C.1
C.2
Dialing........................................................................................................................119
D.1.1
D.1.2
E.2
Limitations.................................................................................................................121
E.3
References.................................................................................................................122
E.4
E.4.1
E.4.2
Capacity Test..............................................................................................................123
E.5
E.5.1
Results........................................................................................................................126
E.6
TCP-Based KPIs........................................................................................................127
E.6.1
FTP KPIs.....................................................................................................................127
E.6.2
E.6.3
Capacity KPIs..............................................................................................................128
SwissQual...QualiPoc
Introduction
Service Tests
1 Introduction
QualiPoc Android has been designed for handheld radio network optimization and quality
assessment. This software supports a variety of devices and technologies including
GSM, GPRS, EDGE, WCDMA, HSDPA, HSUPA and LTE. Due to the ease of use, you
can use QualiPoc to collect data and voice services statistics. SwissQual offers the following QualiPoc Handheld Android versions:
Android RF: RF optimization and troubleshooting for scenarios where MOS testing
is not a consideration. This tool has been designed for indoor and outdoor use for
easy and fast data collection on various technologies. Android RF is ideal for field
engineers who perform daily tasks such as site verification and commissioning, troubleshooting, and optimization.
QualiPoc Android RF is also available in a Lite version, which does not save the results
to a measurement file.
Android QA: Combines the functionality of Android RF with MOS quality testing
algorithms such as SQUAD, and P.863 (POLQA). Android QA is a mobile network
quality assessment tool that has been designed to allow customers to easily evaluate
the quality of services, such as voice calls, while providing the RF parameters and
application layer information that are crucial to troubleshooting.
CALL: Uses the Call2anynumber test to set up a speech call connection to a number
that automatically responds. Uses the Speech MOC test to measure intrusive speech
quality (MOS) on speech call connection to a responding station. The answering station job could be used to answer calls for a MOC DL job.
Multi-Data, Multi-Mix, Multi-RAB, and Parallel: Execute data and call tests sequential or parallel.
Idle Monitoring: Allows you to monitor RF parameters during normal use of the
phone.
SwissQual...QualiPoc
Introduction
Device Support
NetQual NQView: Replay tool for post processing data from a QualiPoc Android
Handheld device.
NetQual NQDI: Database based post-processing tool with in-depth data analysis,
mapping, and reporting functionalities. This tool is useful for mass data post processing on files from a fleet of QualiPoc units.
Table 1-1: Description of the monitors that are available in QualiPoc Android
Monitor
Description
Status
Includes general information about the operator, technology, GPS, and general test
results statistics.
Log
WCDMA/GSM/LTE
Displays the main serving cell information based on the actual technology.
HSDPA/HSUPA
Provides details on HSDP and HSUPA data technology information. This monitor is
only available for WCDMA technology.
GPRS/EDGE
Provides details on GPRS or EDGE data technology information. This monitor is only
available for GSM technology.
LTE DL/LTE UL
Provides details on LTE data technology information. This monitor is only available
for LTE technology.
Cells
Provides an overview of serving and neighbour cells status and coverage. The content
of this monitor depends on the main technology that the mobile phone is connected
to.
SwissQual...QualiPoc
Introduction
Related Documents
Monitor
Description
Coverage line-chart
Displays serving and neighbour cell coverage. The content of this monitor depends
on the main technology that the mobile phone is connected to.
Test
Displays the summary of the on-going tests including KPI bar chart.
Layer3
Displays a list of signalling layer 3 headers including the option to decode each l3
message
IP
Displays the HTTP, FTP, TCP, DNS and ICMP messages that have been captured
including the option to decide the messages.
Events
Displays a list of voice and data call related events as well as Wi-Fi scanning results.
Map
Displays the current position, route and BTS information on a map based on Google
maps or Open Street Map.
Indoor
SwissQual...QualiPoc
You can pair a Bluetooth GPS device with the phone and then select the device in the
"Map" settings. In this case you can disable the internal GPS to save battery power.
Otherwise you can use the internal GPS as a backup location provider in the event that
the Bluetooth GPS disconnects or has insufficient coverage.
10
SwissQual...QualiPoc
2. Touch "Update now", touch a version in the list, and then touch "OK".
11
SwissQual...QualiPoc
QualiPoc Settings
3 QualiPoc Settings
You can use the menus on your smartphone to easily configure QualiPoc Android.
In some monitors, this icon opens a screen where you can customize the content of the
monitor.
12
SwissQual...QualiPoc
QualiPoc Settings
Map Settings
Description
"Map Engine"
"BTS monitor"
"GPS Device"
"Indoor Map"
13
SwissQual...QualiPoc
QualiPoc Settings
BTS Information
Description
WCDMA
Name,Technology,UARFCN,PSC,Lon,Lat,MCC,MNC,LAC,CellId,D
irection
GSM
Name,Technology,BCCH ,BSIC,Lon,Lat,MCC,MNC,LAC,CellId,Dir
ection
LTE
Name,Technology,EARFCN,PhyCID,Lon,Lat,MCC,MNC,LAC,CellId,Direction
3.3 Layer 3
The Layer 3 screen lists the available Layer 3 filtering options, which you can enable to
filter out the layer3 headers, for example, by group or by subgroup.
14
SwissQual...QualiPoc
QualiPoc Settings
IP Monitor
3.4 IP Monitor
The IP Monitor screen allows you to selectively filter out messages that belong to the
HTTP, FTP, DNS, and ICMP protocols.
15
SwissQual...QualiPoc
QualiPoc Settings
Customization
3.5 Customization
The customization screen allows you to customize the QualiPoc workspace to display
your preferred monitors as well as create and save different custom workspace configurations. You can then load different workspaces for different monitoring tasks. To customize your workspace, press Menu
and touch "Settings > Customization", and at the
bottom of the screen, select one of the following actions:
" Move left": Moves the monitor one position to the left.
16
SwissQual...QualiPoc
QualiPoc Settings
Notifications
The Workspace editor provides you with an overview of the monitors in the current workspace.
3.6 Notifications
You can configure notifications based on layer3 messages or on display values. A standard Android notification informs you about a new QualiPoc notification. You can also use
a custom sound or vibration for each QualiPoc notification.
To view the event history of the notification, touch the occurrence of the notification
in the list.
17
SwissQual...QualiPoc
QualiPoc Settings
Technology Forcing
18
SwissQual...QualiPoc
QualiPoc Settings
Technology Forcing
2. Touch ""
3. Touch "Select Network Type", and then touch a network technology in the list, for
example, "WCDMA + GSM".
The list of available frequency bands for the technology depends on the capabilities of
the device.
After you set the preferred UARFCN channel, QualiPoc immediately restarts the device.
The forcing sets the radio modem to scan a priority UMTS UARFCN before other channels when the phone starts. The radio modem attempts to access the network with the
19
SwissQual...QualiPoc
QualiPoc Settings
Unit Configuration
preferred UARFCN even if a cell on another UMTS channel can provide a better connection.
If the signal is lost on the preferred UMTS channel, the modem scans for another channel.
To force the phone to rescan for the preferred UMTS channel, you must power cycle the
modem.
Device
20
SwissQual...QualiPoc
QualiPoc Settings
Advanced Analysis Settings
21
SwissQual...QualiPoc
QualiPoc Settings
Exporting and Importing Configuration Settings
"Set max thrpt": Allows you to set the maximum throughput in kbps for different technologies.
This value is mostly used for charts and color coding.
"ROMES logging": Records additional raw data files that you can replay with ROMES
"Raw QC trace logging": Includes whole Qualcomm trace data in the results file
As this option can degrade the measurement performance of the phone, you should only
enable Raw QC trace logging for troubleshooting a problem.
BTS lists
Layer 3 filter
Workspaces
Custom Monitors
Notifications
Job settings
22
SwissQual...QualiPoc
QualiPoc Settings
Exporting and Importing Configuration Settings
23
SwissQual...QualiPoc
QualiPoc Settings
Exporting and Importing Configuration Settings
3. Touch "Import from SD card", go to the location on the SD card where you stored the
job file, and touch the file.
This process overwrites existing measurement job files on the phone with the same
name.
24
SwissQual...QualiPoc
Description
"Algorithm"
"Reference File"
25
SwissQual...QualiPoc
Description
"Phone number"
"Call duration"
"Number of cycles"
26
SwissQual...QualiPoc
Description
"Phone number"
"Call duration"
"Algorithm"
"Reference File"
For speech quality tests, you can use the SQUAD08 or POLQA (P.863) algorithm.
You need a valid QualiPoc Android license for the algorithm that you want to use.
27
SwissQual...QualiPoc
Description
"Side"
"Call direction"
"Phone Number"
"Advanced settings"
"Number of cycles"
"Job Name"
Settings to configure the duration of the job. The window timings are compatible with Diversity.
28
SwissQual...QualiPoc
Setting
Description
"Sample Direction"
From A to B, B to A, or Half-Duplex
"Selected Algorithm"
"Reference File"
QualiPoc to QualiPoc or with the stop call option where the phone operates as
an autonomous B-side answering station.
Do not enable this option if the job involves a call to a Diversity unit.
Unlike the job name, the value that you enter is transferred to a Diversity unit
during the call.
"Sample Frequency"
Plays a sample each time that the interval that you specify elapses
Manually start the job in QualiPoc on the B-side and A-side phones, respectively.
For more information, see chapter 4.4.2, "Creating and Running the Job on a QualiPoc
Phone", on page 30.
Export the configuration of the voice call server from NQView and import the
configuration on the voice call server.
Manually create the task in NQView, export the B-side task configuration file, and
import the file on the voice call server.
For more information, see chapter 4.4.3.2, "Creating the Speech Double Ended
Measurement Task in NQView", on page 41.
29
SwissQual...QualiPoc
Manually configure the job on the QualiPoc phone. For more information, see
chapter 4.4.2, "Creating and Running the Job on a QualiPoc Phone",
on page 30. Some Diversity settings are slightly different than the QualiPoc
counterparts. In such cases, consult the setting information in the paragraph
below the relevant step.
Create the measurement task in NQView with the Diversity smartphone as the
A-side device and the QualiPoc phone, that is, the mock DTMF voice call server,
as the B-side device.
For more information, see chapter 4.4.3.2, "Creating the Speech Double Ended
Measurement Task in NQView", on page 41.
30
SwissQual...QualiPoc
b) Touch "Selected phone number > Add new", enter the number for the A-side
phone, and then touch "OK".
3. Touch "Advanced settings > Job name", enter a name for the job, and then touch
"OK".
31
SwissQual...QualiPoc
32
SwissQual...QualiPoc
e) Touch "Window Timings" and use the timings picker at the top left to select the
setting that you want to change, and then use the value picker at the top right to
select the new value.
For a test that involves a Diversity unit, specify the same Window timings as you
did in figure 4-17 for the intrusive job in NQView.
f)
Press Back
33
SwissQual...QualiPoc
34
SwissQual...QualiPoc
c) Touch "Selected sample direction", and then touch an option in the list.
Unlike in Diversity, the half-duplex option in QualiPoc always starts with a B to A
sample direction and then alternates the sample direction. Furthermore, unlike in
Diversity, you cannot specify the number of samples that a QualiPoc job uses.
However, QualiPoc always evaluates the reference samples that the phone
receives. For a test that involves a Diversity unit, ensure that the sample direction
that you selected in figure 4-18 for the test in NQView reflects these limitations.
35
SwissQual...QualiPoc
For a test that involves a Diversity unit, touch the algorithm that you selected in
figure 4-18 for the test in NQView.
e) Touch "Selected reference file" and touch a sample file for the test.
For a test that involves a Diversity unit, use same reference sample that you
selected in figure 4-18 for the test in NQView, for example, "English (U.S.) IRS"
for the AM_fm_IRS.wav reference sample.
36
SwissQual...QualiPoc
f)
Touch "Sample frequency", enter one of the following sample frequencies, and
then touch "OK":
12.5: For tests that use the "SQuad08" and POLQA algorithms.
The sample frequency is the time difference between the start times of the
two subsequent samples. A sample frequency of 12.5 seconds in QualiPoc
corresponds to the combined 6 second "Record hang-over" that you specified
in figure 4-18 in NQView and the 6.5 second duration of the SwissQual reference samples.
20: For tests that use the "SQuad08 (WB)" and "POLQA (WB)" algorithms.
QualiPoc on slower phones requires the longer time to calculate the MOS
results in a wideband Speech Double Ended measurement job.
37
SwissQual...QualiPoc
4.4.2.2
Stop command arrives during a configuration call: QualiPoc restarts the measurement job into waiting for configuration mode and does not save a measurement
file
Stop command arrives during a normal call: QualiPoc stops the measurement job
and saves a measurement file.
Stop command arrives during a pause in a normal call: Job continues to run until
the timeout is reached
Stop command does not arrive: If the call has already been configured and the test
is running, the call runs indefinitely; however, if you restart the measurement task in
NQView and QualiPoc is configured to receive the call, then QualiPoc restarts the
job on the phone after the configuration call.
4.4.3.1
Voice Call Server: Required for the QualiPoc Android to Diversity Call Server (PSTN/
ISDN), Diversity Android Smartphone without an MCM/PSM to QualiPoc Android,
and Diversity Smartphone in an MCM/PSM to QualiPoc Android scenarios
Speech Double Ended Measurement Task: Required for the Diversity Android
Smartphone without an MCM/PSM to QualiPoc Android, and Diversity Smartphone
in an MCM/PSM to QualiPoc Android scenarios
38
SwissQual...QualiPoc
b) Type a "Name" and "Computer name" for the unit, for example, QPAndroid.
39
SwissQual...QualiPoc
3. Create a subscriber profile for the phone device or PSTN or ISDN card.
a) Click "System configuration" on the Navigation panel and click the plus sign (+)
beside "Subscriber and access points".
b) Click the plus sign (+) beside an operator in the tree, right-click a provider, and
then click "Add subscriber".
c) Add the subscriber information, click "Apply", and then click "OK".
4. Add the QualiPoc phone or the PSTN or ISDN card as device to the DTMF voice call
server.
a) Right-click the unit in the tree, point to "Add device", and then click the type of
device, for example "Mobile" for a QualiPoc phone or "ISDN" for a Diversity
device.
b) Type a name for the phone.
c) In the "Model" list, click the type of phone or ISDN or PSTN model.
d) In the "Subscriber" list, click the profile that you created in the previous step.
If you are creating a mock call server for a QualiPoc phone, the subscriber number
is the only value that needs to be identical to the QualiPoc setting.
e) Click "Apply" and click "OK".
40
SwissQual...QualiPoc
4.4.3.2
3. In the "Device A/B side" area, select the A-side and B-side devices.
Scenario
A-Side Device
B-Side Device
Diversity Smartphone in an
MCM/PSM to QualiPoc Android
scenarios
41
SwissQual...QualiPoc
c) In the "Name" box, type a name for the job in the following DTMF job transfer
format:
job_xyz
d) In the "Record hang-over [ms]" box, type 6000.
QualiPoc does not have a hang-over recording setting. Instead, you need to
specify a "Record Hang-Over" value of 6000ms and a "Test Repetition
Sequence" of 11 in NQView.
e) In the "MOC:MTC ratio" box, specify the call direction, for example, 1:1.
QualiPoc does not use the MOC:MTC ratio to define the call direction, but rather
uses A-side and B-side. As a result, a MOC:MTC ratio of 1:0 corresponds to the
A to B call direction setting in QualiPoc and a 0:1 ratio corresponds to B to A.
However, the MOC:MTC ratio of 1:1 corresponds to the"Alternating Call
Sequence" call direction in QualiPoc.
f) In the "Timings" area, select "Use call duration to abort call".
If you do not enable this option, the measurement task will not run correctly
g) Specify the remaining timings, click "Apply", and then click "OK".
5. In the "Intrusive test" window, specify the settings for the speech test.
a) Type a name for the test.
42
SwissQual...QualiPoc
43
SwissQual...QualiPoc
Description
"URLs"
"Advanced Settings"
"Number of cycles"
Ensure that the total download size of the reference files is large enough to last for the
duration of the test.
44
SwissQual...QualiPoc
Description
"Advanced Settings"
"Number of cycles"
45
SwissQual...QualiPoc
To add the port number, type a colon (:) at the end of the address, and then type the port
number. Only QualiPoc Handheld uses this number.
Table 4-7: Description of the settings for FTP DL and UL single DATA jobs
Setting
Description
"File"
"Credentials"
"Advanced Settings"
"Number of cycles"
46
SwissQual...QualiPoc
Description
"URL"
"Advanced Settings"
"Number of cycles"
47
SwissQual...QualiPoc
Description
"Host address"
"File"
"Credentials"
"Advanced Settings"
"Number of cycles"
and touch "Jobs > Selected job type > Single DATA tests > Iperf".
48
SwissQual...QualiPoc
2. Touch "Selected server address", touch "Add new", enter the name of the server, and
then touch "OK".
3. Specify the test settings.
a) Touch "Iperf" in the "Test" area.
b) To add a command-line setting, touch "Selected additional parameters", enter
the setting, and then touch "OK".
49
SwissQual...QualiPoc
Note: To view the list of available parameters, touch "Full arguments list".
Description
-i, --interval #
-m, --print_mss
-p, --port #
-u, --udp
-C, --compatibility
For use with older versions does not sent extra msgs
-M, --mss #
-N, --nodelay
-V, --IPv6Version
For the l and w, K or M parameters, suffixes are required, for example, l 8K, or
w 512K. QualiPoc supports the UDP protocol and automatically adds the u parameter.
50
SwissQual...QualiPoc
Fig. 4-26: Iperf log with the client report outlined in red
The client report in the Iperf log has the following fields:
20130104135043 date/time
4 ID
The final report datagram from the client and server has a total of 14 fields, 9 from the
client report, and the following 5 fields:
51
SwissQual...QualiPoc
Description
"Host"
Enter the packet size in bytes and the timeout for the
ping in seconds
"Advanced Settings"
"Number of cycles"
52
SwissQual...QualiPoc
and touch "Jobs > Selected job type > Single DATA tests >
b) In the "Result files upload connection profile" area, touch "Select connection
type".
c) Touch a connection type in the list, for example, "FTP" or "HTTP".
d) Touch "Select host", enter the URL for the server, and then touch "OK".
e) Select active or passive mode.
3. Specify the login information for the server.
a) Touch "Select user name", enter an account name, and touch "OK".
b) Touch "Password", enter the password for the account, and touch "OK".
4. Specify the remaining settings, for example, enable the "Auto upload" and "Auto
compression" options.
53
SwissQual...QualiPoc
54
SwissQual...QualiPoc
Description
"Receiver number"
"Advanced Settings"
"Number of cycles"
55
SwissQual...QualiPoc
Description
"Receiver number"
"Advanced Settings"
"Number of cycles"
Time to ready to play [s]: Time from sending the first TCP SYN packet to the YouTube
server until completing the download of the player configuration
Time to first picture [s]: Time from sending the first TCP SYN packet to YouTube
server until the first video frame is displayed on the screen
56
SwissQual...QualiPoc
You cannot use copyrighted videos or videos that have had embedding disabled.
ID only -UaMoP-D1VY
You can also share a link from the Android YouTube application with QualiPoc.
57
SwissQual...QualiPoc
58
SwissQual...QualiPoc
Multi-Data: Sequence of data tests in which all the tests occur in one session
Multi-Mix: Sequence of data and call tests in which a new session starts for each
test
Parallel: Parallel execution of up to 3 parallel jobs independent from each other (one
call job and multiple single or multi-data jobs).
59
SwissQual...QualiPoc
60
SwissQual...QualiPoc
c) In the "Select Job Type" list, touch the type of job that you want to include, for
example, "FTP DL".
The Answering Station single CALL Job is not available.
d) In the "Select a job file" list, touch a job, for example, "LastJobFTPDL.xml".
Note: If you touch "Add new", see chapter 5.3, "Creating and Running Basic Jobs",
on page 65 or chapter 5.4, "Creating and Running Advanced Jobs", on page 66.
You can only specify the number of cycles and test duration "Timings and Scheduling" options for the individuals.
5. Press Back
and on the "Job Sequence" screen, press Menu
job" to add an additional job.
61
SwissQual...QualiPoc
Description
Time and date on which to start the job, the number of repetitions for the job, and
the related timings, for example, duration of the job, pause between the tests,
and so on
"Test"
"Access Point"
"Pcap"
62
SwissQual...QualiPoc
Using QualiPoc
Help Menu
5 Using QualiPoc
The following sections describe how to use QualiPoc to create, to run, and to control your
tests. QualiPoc makes full use of the smartphone touch functionalities so you can easily
switch between the monitors, zoom in or out in the map monitors, and scroll easily. The
application also has a toolbar, which you can use to access a variety of functions.
If you do not see the menu, you need to manually copy the video files to the phone.
63
SwissQual...QualiPoc
Using QualiPoc
QualiPoc Main Toolbar
The toolbar allows you to quickly perform the following actions when you monitor a test.
Table 5-1: Description of the icons on the QualiPoc main toolbar
Icon
Name
Description
"Idle Monitoring"
"Freezing"
"Screen Capture"
Captures the screen and saves the image to the SD card in PNG
format.
64
SwissQual...QualiPoc
Using QualiPoc
Creating and Running Basic Jobs
Icon
Name
Description
"Photo Marker"
"Settings"
Opens the QualiPoc settings screen for the monitor that you currently have open.
2. Press Menu
3. Touch "Select job type", touch a job group, and then touch a job type.
65
SwissQual...QualiPoc
Using QualiPoc
Creating and Running Advanced Jobs
2. Press Menu
66
SwissQual...QualiPoc
Using QualiPoc
Creating and Running Advanced Jobs
3. Press Menu
, touch "Create new job", and then touch a job group in the list, for
example, "Single DATA tests".
4. On the "Select Job Type" screen, touch the type of job that you want to create, for
example "HTTP Browser".
Note: For a description of the job types, see chapter 4, "Measurement Job Types",
on page 25.
67
SwissQual...QualiPoc
Using QualiPoc
Creating and Running Advanced Jobs
68
SwissQual...QualiPoc
Using QualiPoc
Creating and Running Advanced Jobs
6. Press Menu
, touch "Save job", type a name for the job in the "Save job" box, and
then touch "Save".
Note: QualiPoc stores the new job in in the following location: [sdcard]/
QualiPoc/Jobs/
69
SwissQual...QualiPoc
Using QualiPoc
Creating and Running Advanced Jobs
2. Press Menu , touch "Load job", and then touch a job group in the list, for example,
"Single DATA tests".
3. On the "Select Job Type" screen, touch the type of job.
4. In the list of jobs, touch the job that you want to run.
Note: QualiPoc loads a job from the following location on the phone: [sdcard]/
QualiPoc/Jobs/
5. Press the Back
70
SwissQual...QualiPoc
Using QualiPoc
Viewing Results
5.4.2.1
Stopping a Job
71
SwissQual...QualiPoc
Using QualiPoc
Viewing Results
Note: If you want to use the HTTP post method to upload the files, touch "HTTP form
upload". Use the following format for the host name: HostName/
PostScriptFileName, for example, 82.220.1.20/post.php. If you want to use a
custom script file on your server, you need to edit the properties in the following file:
\sdcard\QualiPoc\Settings\Upload\httpform.properties. You can
configure the POST method to use file or text form input.
72
SwissQual...QualiPoc
Using QualiPoc
Cell Info Banner
This banner is only available on Samsung Galaxy SIII, Samsung Galaxy Tab 8.9, HTC
One XL mobile devices. If you do not see all of the values that you selected, touch the
banner to display the remaining values.
To customize the Cell Info banner
1. Touch and hold the Cell Info banner.
2. To change the title values, touch "Customize title values".
You can only have two title values.
a) In the list of parameters, touch the parameters for the title of the banner.
b) If the number of "Remaining" parameters is "0", you need to touch a selected
value, for example, "Network", to remove the selection.
73
SwissQual...QualiPoc
Using QualiPoc
Cell Info Banner
c) Touch the parameter that you want to display in the title area of the Cell Info
banner.
74
SwissQual...QualiPoc
Using QualiPoc
Monitors
c) Touch a value in the list and continue until you have selected 10 values.
5.7 Monitors
QualiPoc has several screens that you can you can use to monitor a measurement.
The amount of customization depends on the monitor that you are in. The following customization options are available:
If the "Add / remove / rearrange" screen opens, you can perform the following actions:
To add and remove items, touch the green plus sign
at the top of the screen,
and then touch the values that you want to add or remove.
75
SwissQual...QualiPoc
Using QualiPoc
Monitors
If an options screen opens, touch the items that you want to select or remove. If the
item does not have a check box, another screen opens where you select the items
that you want to display in the monitor.
76
SwissQual...QualiPoc
Using QualiPoc
Monitors
On a monitor where you cannot customize a value, the "QualiPoc Settings" screen
opens.
77
SwissQual...QualiPoc
Using QualiPoc
Monitors
78
SwissQual...QualiPoc
Using QualiPoc
Monitors
5.7.3.2
Data Monitors
QualiPoc automatically displays the relevant data technology information in the following
monitors when HSDPA, HSUPA, GPRS/EDGE, or Wi-Fi technologies are in use.
Where available, these monitors also contain PDP context information, that is, APN, IP
address and NSAPI (only for GSM).
79
SwissQual...QualiPoc
Using QualiPoc
Monitors
5.7.3.3
80
SwissQual...QualiPoc
Using QualiPoc
Monitors
To close the window, double-tap the window or press the back button
81
SwissQual...QualiPoc
Using QualiPoc
Monitors
5.7.4.1
To save the contents of Layer 3 message, touch and hold the screen, and then touch
"Save".
82
SwissQual...QualiPoc
Using QualiPoc
Monitors
To customize the signals that you want to trace during a test, touch the position
marker.
To change the map mode, touch the up arrow (^) at the base of the map.
83
SwissQual...QualiPoc
Using QualiPoc
Monitors
To use Open Street Map, touch the up arrow (^) at the base of the map, touch "Map
engine", and then touch "Open Street Maps".
84
SwissQual...QualiPoc
Using QualiPoc
Monitors
85
SwissQual...QualiPoc
Using QualiPoc
Monitors
3. On the "Download map area" screen use the sliders to define the area and touch
"OK".
86
SwissQual...QualiPoc
Using QualiPoc
Monitors
2. Touch the type of BTS file that you want to load, for example, "BTS Info File LTE",
locate the file, and then touch "Select".
3. Return to the map, touch the up arrow (^) at the base of the map, and then touch
Settings.
4. Touch "BTS monitor".
87
SwissQual...QualiPoc
Using QualiPoc
Monitors
5.7.5.2
To delete a marker that you just added to a map, touch the "Undo" button
top of the screen.
To zoom in and zoom out of the map, use the touch capabilities of the smartphone.
To navigate between waypoints, use the left and right arrows in the slide out menu
at the bottom.
at the
88
SwissQual...QualiPoc
Using QualiPoc
Monitors
To automatically center the map on the current waypoint, tap the waypoint marker in
the bottom right of the screen .
89
SwissQual...QualiPoc
Using QualiPoc
Monitors
QualiPoc saves the positions that you mark in the measurement file. You can load these
markers in the NQDI post-processing software. If you want, you can load another map
during the measurement. When you reload a map, QualiPoc also reloads the previous
tracking list.
90
SwissQual...QualiPoc
Using QualiPoc
Monitors
91
SwissQual...QualiPoc
Using QualiPoc
Monitors
average, minimum, and maximum KPI results. The "Events" monitor lists all most important events, for example Call States, that QualiPoc traces during the tests.
92
SwissQual...QualiPoc
and touch
To replay a measurement in QualiPoc on your smartphone, press Menu
"Replay", slide open the bottom menu, tap the folder icon, select the file that you want
to replay, and then tap the Play icon.
You can use the remaining controls to perform the following actions:
While the phone is in this mode, "Replay" appears in a blue bar at the top of the screen.
93
SwissQual...QualiPoc
94
SwissQual...QualiPoc
95
SwissQual...QualiPoc
96
SwissQual...QualiPoc
C:\Program Data\SwissQual\Diversity\Tasks
2. In the "Control" console of NQView, add a call server to the "System Configuration".
a) On the Navigation panel, click "System configuration".
b) Right click "Hardware", point to "Add unit", and then click "PC".
c) On the "General" tab, select "Enabled", and specify the following information:
In the "Name" box, type the name for the call server.
In the "Computer" name box, type the Windows computer name of the call
server.
In the "Time synchronization" list, click "Internal sync".
In the "NQComm" control list, click "Diversity FTP".
In the"Unit control" list, click "Diversity FTP".
In the"NQComm result" list, click "Diversity FTP".
97
SwissQual...QualiPoc
98
SwissQual...QualiPoc
Note: Do not select the"DTMF scan" option. Do not select "The device is an answering station" option in the"Answering station" area.
4. Create an intrusive speech job for the call server.
a) On the Navigation panel and click "Tasks and Jobs".
b) Expand "Job definitions", right-click Intrusive, and then click "Add job".
c) In the "Name" box, type a name for the job, for example, Answering Station
IT_clip_08.
d) In the "Record hang-over [ms]" box, type 18500.
For the "QP_default" audio clip, type 14500.
e) Clear the "Use call duration to abort call" check box.
99
SwissQual...QualiPoc
f)
In the "MOC:MTC" ratio box, type 1:0, click "Apply", and then click "OK".
100
SwissQual...QualiPoc
i)
5. Create a task that involves the call server and an A-side device.
If your system does not have an A-side device, add one as a placeholder device for
the task.
a) Right-click "Measurement tasks" in the tree and click "Add task".
b) In the "Name" box, type a name for the task, for example, Android Speech.
c) In the"Device A/B" side area, assign the devices.
In the first list, click your A-side device.
In the second list, click the call server that you created.
d) In the "Job sequence" area, click the green plus sign .
e) In the "Job" list, click the job that you created in "To create a answering station
for QualiPoc Android" on page 97, and then click "Save".
101
SwissQual...QualiPoc
f)
In the "Measurement task" window, click "Apply", and then click "OK".
g) Right-click the task in the tree, click "Export B-side task" file, browse to a location,
and then click "OK".
h) Copy the B-side task file to the following location on the call server:
6. Edit the settings in the B-side task file.
102
SwissQual...QualiPoc
C:\Program Data\SwissQual\Diversity\Tasks\DefaultJobs
103
SwissQual...QualiPoc
CallWndSize=0
CallDuration=0
PauseDuration=15
This value must match the pause duration for the job on the QualiPoc Android
mobile phone.
MaxCSTime=30
This value must match the Max call setup time for the job on the QualiPoc
Android mobile phone.
TestSeqRepetition=999
This value allows for QualiPoc calls that are longer than 6 hours
RecordHO=18500
For a "QP_default" audio clip, use 14500.
c) Save the file.
7. Edit the Windows Registry on the call server.
a) Open the Registry Editor.
b) Right-click the following key and click "Modify":
HKEY_LOCAL_MACHINE\SOFTWARE\SwissQual\NetQual\NQMP\
ConfigCallMOCOnly=1
c) Change the value of the key to 0 and click "OK".
104
SwissQual...QualiPoc
a) If the call server is connected to NQView, right-click the unit on the "System configuration" panel of the "Control" console, and click "Update configuration".
b) If the call server is not connected to NQView, you need to complete the following
steps:
Right-click the unit on the "System configuration" panel, point to "Export configuration", and then click "Unit only".
Copy the .config file to the call server, for example, with a USB stick.
On the call server, click "Stop" on the "Control" menu in Diversity Supervisor.
On the "Tools" menu, click "Import Configuration", locate the .config file for
the unit, and then click "Open".
On the "Control" menu, click "Start".
105
SwissQual...QualiPoc
HKEY_LOCAL_MACHINE\SOFTWARE\SwissQual\NetQual\NQMP\
ConfigCallMOCOnly=0
106
SwissQual...QualiPoc
Right-click the unit in the "System configuration" tree, point to "Export configuration", and then click unit only.
Copy the .config file to the call server, for example, with a USB stick.
On the call server, click "Stop" on the "Control" menu in Diversity Supervisor.
On the "Tools "menu, click "Import Configuration", locate the .config file for
the unit, and then click "Open".
On the "Control" menu, click "Start".
107
SwissQual...QualiPoc
In NQView, define the settings for the server, including the connection profiles
108
SwissQual...QualiPoc
b) Go to where you want to save the *.config file, and then click "OK".
109
SwissQual...QualiPoc
Note: If you want to view the contents of the configuration file, change the file extension from *.config to *.zip, and then open the ZIP file. This file contains individual
XML files.
3. Copy the configuration file to the voice or video call server.
4. On the voice or video call server, import the configuration file.
a) In the Windows notification area, double-click the Diversity Supervisor icon .
b) On the "Control" menu, click "Stop".
c) Wait until only the "SuperVisor" tab remains open, and then click "Import Configuration" on the "Tools" menu.
Diversity Supervisor does not validate the configuration file during the import
process. If the configuration file contains an error, the server enters an error state
during system startup.
Fig. 2-2: Import configuration file for voice or video call server
d) In the "Open" dialog box, locate the configuration file, for example,
PCM8000000.config, and then click "Open".
e) In the "Confirm" dialog box, click "Yes", and in the "Info" dialog box click "OK".
110
SwissQual...QualiPoc
5. If your server uses DTMF job transfer, right-click a device on the server, for example,
an ISDN device, and ensure that the "DTMF scan" check box is selected.
111
SwissQual...QualiPoc
112
SwissQual...QualiPoc
113
SwissQual...QualiPoc
5. Add a device.
114
SwissQual...QualiPoc
a) Right-click your computer name in the tree and click the type of call device that
you want to add, for example, a PSTN Device.
b)
c)
d)
e)
f)
Note: Repeat these steps for each device that you want to use.
6. On the "Control" menu, click "Start".
115
SwissQual...QualiPoc
Call Quality
Defining Call Quality
C Call Quality
The following sections describe Call Quality, which rates a complete call according to
subscriber experience.
The goal is to model how a subscriber would rate the call when the call is over. The main
quality determination is provided by the so-called "recency effect", that is, recent perceived quality degradations have a greater influence on the score, and a weighted average procedure, in which a strong quality drop has a strong influence on the overall call
quality.
To create the Call Quality prediction model, an auditory investigation was performed with
a simulated conversation in a fixed temporal structure [Neusinger, Berger: ETSI-STQ
04/2202]. This model can also be applied to test calls that consist of a series of test
samples that have been scored by P.862.1 or SQuad-LQ, so long as the defined temporal
structure has been met. The corresponding ETSI recommendation is [ETSI-STQ TR 102
506].
The Call Quality model contains the following steps:
Recency effect scores from the fist samples in the call are weighted less in the averaging process
To model impacts on call quality by drops of quality during the call, non-linear averaging is applied, which weights single MOS drops stronger than when the common
quality in the call is high.
10 x Speech and Speech-P.862 tests, that alternate between 5 x A->B and 5 x B->A
NQDI can calculate Call Quality during post-processing or during the database import
procedure, that is, the VoiceEngine does not calculate Call Quality. NQDI calculates the
Call Quality of calls that meet the following requirements:
Time from the beginning of the first sample in the call to the beginning of the last (fifth)
sample in this direction is within the 100 and 115 s range
The Call Quality is calculated separately for the A->B and B->A directions as well for P.
862.1 and SQuad-LQ. As a result, four Call Quality values are calculated for Speech-P.
862 and UL/DL tests and two values for SQuad-LQ Speech UL and DL tests. For Qual-
116
SwissQual...QualiPoc
Call Quality
3 Viewing the Results
iPoc or special applications that involve a DL or UL test, only one Call Quality value is
calculated for the test direction.
If you use a default SwissQual audio file, for example, AM_FM_IRS.wav, to evaluate the
Call Quality, you need to specify a "Record HO" value of 5500 ms. If you use the
AM_CallQual_IRS.wav audio file, which is a special Call Quality speech sample, you
need to specify a "Record HO" value of 1000 ms.
Due to the short hangover time, do not use the AM_CallQual_IRS.wav audio file for
Video Calls.
117
SwissQual...QualiPoc
A common definition for call setup time is the amount of time that occurs between the
push of the send, dial, or call button and the reception of an audio channel by the called
party (B-side device) from the calling party (A-side device). This reception is also known
as the switch to conversation mode. In figure 4-1, the call setup time is represented by
the arrow between the Dial and Connected markers on the calling-party side of the diagram.
This definition applies to intrusive voice and video telephony tests as well as to nonintrusive voice call and call to any number tests that originate in GSM, UMTS, or ISDN
technologies.
Since CDMA, IS-136, and iDEN use tone detection, the Connected marker in these technologies corresponds to the detection of the first audio signal.
Based on this definition, the call setup time can easily be calculated on digital networks.
However, if one party uses an analog device or a technology that does not provide a
protocol message to indicate a connection, the situation is more complex.
118
SwissQual...QualiPoc
D.1 Dialing
This section describes the dialing process during the call setup time of a measurement
test.
If the A-side device uses a PSTN device, the device needs to check the connected network for a dial tone before calling. This action prompts the test to add a Wait for Channel
Ready message to the measurement file. After the dial tone is found, the PSTN board
dials the number and the test adds a Dialing.. message to the measurement file.
Mobile phone devices that use time-consuming key press emulation also add a Dialing
message to the measurement file.
At this point, the test starts the call setup timer and adds the Dial call marker to the
measurement file.
A test adds the Incoming Call marker to the measurement file when the B-side device
detects an incoming call. The device has an accept delay of 500 ms during which a PSTN
device tries to reliably determine the presence of an incoming call. Devices that use other
technology types simply wait during this delay period in order to retain comparability
between the technologies in the measurement results. When a call is accepted and the
B-side device switches to conversation mode, the Connected marker is added to the
measurement file. After the connection is established, the B-side device waits one second
plus the "SyncDelay" time that you specified for the B-Side device in the test configuration
before sending the connectall.wav audio sequence.
119
SwissQual...QualiPoc
The audio channel is assumed to be present when the B-side device is connected.
120
SwissQual...QualiPoc
E.2 Limitations
The fixed duration test does not calculate download success rates. That is, if a data
transfer successfully completes before the test ends, the test fails.
121
SwissQual...QualiPoc
E.3 References
ETSI TS 102 678 Speech and multimedia Transmission Quality (STQ); QoS Parameter Measurement based on fixed Data Transfer Times
In the "Max duration" box, specify the maximum duration for the test.
Select "Use as fixed duration".
In the "Host" box, type the address of the host server.
In the "Operation" area, specify the transfer direction.
Select a local or specify a remote file for the data transfer that is large enough to
not completely transfer during the test.
If necessary, specify the login information for the host server.
122
SwissQual...QualiPoc
123
SwissQual...QualiPoc
The data to be transferred are buffered between the TCP and application layers. The
buffering can lead to differences in the amount of received and sent data for the same
point in time on the two layers and differences in the measured throughput. To minimize
the difference to around 5% error, use a fixed duration that is longer than the experienced
throughput is.
Recommended fixed durations for single transfers (get or put) HTTP/FTP test:
124
SwissQual...QualiPoc
Recommended fixed durations for multiple transfers (get or put) in a parallel Capacity
test:
The "Capacity Get" and "Put" test are not suitable for throughputs < 1000kbps (GSM in
general).
Due to processing delays the fixed duration that you specify does not precisely match
the time that the transfer lasts.
125
SwissQual...QualiPoc
E.5.1 Results
The fixed duration information is included in the measurement file as a test property. This
property appears as a special report item in the report generator.
To include fixed duration information in an NQDI report
1. Import the relevant file into NQDI.
2. On the "Data Selection" tab, click the "Test" tab.
3. On the "Test" tab, click the "Data" tab, and then click the "FTP" or "HTTP" tab.
4. Click the "Uncheck all selections" icon
then click the "Refresh" icon .
In the "Parameters" area of the results tab for the test, the "Test timeout" parameter
shows the fixed duration information.
126
SwissQual...QualiPoc
127
SwissQual...QualiPoc
128