SPIRENT 8100 MOBILE DEVICE TEST SYSTEM

UMTS Radio Access - Operator Acceptance

and Performance Testing
APPLICATIONS
Manufacturers:

Research & Development

Design verification

Performance analysis

Benchmarking

Regression test
Operators:

Pre-launch evaluation

Acceptance test

Mobile applications test

Software regression test

End user and network KPI
analysis
Spirent 8100 UMTS Radio Access - Performance solutions
decrease the time and cost required to verify fundamental
and critical capabilities of mobile devices which are not fully
addressed by todays conformance/certication test standards:
data throughput, call reliability and mobility. Real-world device
performance in these areas is a major contributor to an optimal
end-user experience, which in turn helps to assure network
operator and device manufacturer success.
Data Throughput Test Packs automate performance testing of
handsets, data cards and embedded modules from physical to
application layer, including Rx diversity support. Call Reliability
and Mobility Test Packs provide automated testing of a devices
ability to reliably make and maintain voice and data calls across
2G and 3G networks. Testing is carried out under realistic
conditions using exible multi-cell, multi-RAT network emulation,
including radio channel conditions and interfering cells. Powerful
data analysis and reporting tools deliver comprehensive KPIs for
evaluating performance of a single device or for benchmarking of
multiple devices.
UMTS Radio Access - Performance test capability is part of the
Spirent 8100 Mobile Device Test System - an open, scalable multi-
purpose test system that is expandable beyond initial testing
needs. The system meets a range of high-value mobile device
testing requirements using highly capable components including
an SR3420 Network Emulator with network-grade protocol stacks
to enable delivery of high-quality devices to end users.
BENEFITS

Reduce time to market run more tests on a single,
automated platform

Reduce device returns and customer churn through improved
device quality identify 2G/3G data performance and call
reliability/mobility issues under real-world conditions in the
lab

Address the entire lifecycle of testing needs with a single
solution R&D, DVT, Benchmarking/Evaluation, Acceptance,
Applications, Regression

Purchase only the capability you need, when you need it
offered with turnkey and user-customizable test modules and
scenarios; upgradeable to A-GNSS location performance and
conformance testing
Delivers automated solutions for repeatable data throughput, call reliability and mobility
performance analysis of HSPA, WCDMA and GSM/GPRS/EDGE devices.
UMTS Radio Access - Operator Acceptance and Performance Testing
SPIRENT 8100 MOBILE DEVICE TEST SYSTEM
Data Throughput

Multi RAB - simultaneous PS & CS call

HSPA Physical & Application Layer Data Rate Tests

Multi-cell option (3 WCDMA, 1 GSM) to create interference
and neighbor cells

Programmable CQI vs. TBS table to evaluate CQI performance/
sensitivity

Integrated RX Diversity

Integrated Sweep Looping Functions

Dynamic control and monitoring

Fixed or Normal CQI tests

FTP, HTTP, & UDP Protocol

Static and Dynamic Fading Conditions

Programmable Uplink (U/L) and Downlink (D/L) Rates Up to
Full-rate ~21 Mbps

UDP Protocol Bi-Directional and Multi-hour Stress test

Round Trip Latency tests (Short Ping and Long Ping)

2.5G GPRS/EDGE Option
KEY FEATURES
Call Reliability and Mobility

Multi-cell option (3 WCDMA, 1 GSM) to create interference
and neighbor cells

Mobile Terminated and Mobile Originated call support

PS, CS, and Multi-RAB scenarios

UE Measurement Accuracy tests

Call Setup & Call Maintainability tests

Data Call Reconfiguration

SHO & HHO Call Maintainability (PS and CS support)

GSM, WCDMA, HSPA and HSPA+ support

2G-3G Inter-RAT Handover and Reselection testing

Service Recovery and Service Availability

Downlink Power Usage tests

Measurement & reporting of key End User KPIs including:
Call Drop Rate, Call Setup Failure Rate

Measurement & reporting of key Parametric KPIs including:
Handover and Reselection Success Rate and Connection
Establishment Time

Complete device automation through either:
Congurable AT commands
Pre-dened API interface
Powerful reporting tools enable device throughput performance benchmarking.
UMTS Radio Access - Operator Acceptance and Performance Testing
SPIRENT 8100 MOBILE DEVICE TEST SYSTEM
ADVANCED AUTOMATION AND CONFIGURABLE
TEST CASES
Spirents industry-leading Test Manager provides the highest
level of test automation and visibility into the performance of the
device under test. Test Manager enables development of custom,
automated tests for regression, pre-compliance, or network
operator acceptance test requirements without the need to write
complex scripts or code. Customizable parameters such as
network reselection, handover, and MAC-hs criteria allow device
performance to be fully characterized under a wide range of real-
world network settings.
The ability to make run-time changes to test case parameters
greatly simplies device debugging. Pending test case
parameters can be changed after a test session has begun to
adjust the focus of an investigation while working through test
scenarios to isolate issues.
WIDE RANGE OF PERFORMANCE TEST PACKS
UMTS Radio Access - Performance test coverage is grouped into
Test Packs, enabling test coverage to be matched to testing and
budgetary requirements. Test Packs address 2G and 3G packet
and circuit switched environments, as well as full multi-cell
mobility scenarios. Data Throughput Test Packs address data
throughput performance testing of GPRS/EDGE and WCDMA/
HSPA/HSPA+ devices. In additional to single-cell 2G and 3G call
reliability, the Call Reliability and Mobility Test Packs address
advanced scenarios such as Inter-RAT Handover, Inter-RAT
Reselection and Out of Service Recovery to provide modeling of
real-world issues not effectively covered by current standards-
based conformance/certication testing.
Test Suites tune parameters in a group of core test cases from
one or more Test Packs to align with a particular test plan or test
standard. Test Suites are maintained by Spirent to ensure they
evolve with the test plan or standard.
UMTS Radio Access - Performance Test Packs offer a wide range of
exible test coverage options.
Test Manager enables test parameters to be
easily customized.
OPERATOR ACCEPTANCE TESTING
Spirent 8100 Radio Access Performance solution offers a broad
range of automated, precongured and validated test cases
based on operators test plans. The turnkey Data Performance,
Call Reliability, Mobility, Voice Quality, and Adversarial Data
tests allow operators and their vendors to greatly improve their
device development and evaluation cycle meaning faster time
to market. In addition to pre-congured tests, the solution also
offers operators the exibility to develop a broader range of
performance tests, quickly and easily creating custom, automated
test suites for existing or new test plans.
RESEARCH AND DEVELOPMENT TESTING
For developers and evaluators looking for the ultimate exibility
in test case creation, a Development Library option offers a
powerful set of tools focused on Application, Protocol, and
Physical Layer testing of devices. A UI-based script engine
allows for rapid creation and editing of custom test cases in a
multi-cell/multi-RAT environment with optional fading and noise.
Development library is ideally suited to software/hardware
development, including integration, interop., regression and
application testing. An integrated RF playback engine helps
re-create an RF environment in the lab by allowing modeling and
variation of features and parameters for cell power, fading, noise,
Doppler frequency, phase shift, AWGN SNR and multi-path.
UMTS Radio Access - Operator Acceptance and Performance Testing
SPIRENT 8100 MOBILE DEVICE TEST SYSTEM
0.00%
20.00%
40.00%
60.00%
80.00%
100.00%
3G CS Call Maintain - Single Cell,
PB3, RSCP = -95 dBm, CPICH_Ec/No = -20 dB
0.00%
20.00%
40.00%
60.00%
80.00%
100.00%
3G CS Call Maintain - Single Cell,
VA120, RSCP = -95 dBm, CPICH_Ec/No = -20 dB
IN DEPTH DATA ANALYSIS, AND POWERFUL
REPORTING TOOLS
Data Throughput and CQI Histogram charts greatly simplify the
analysis of handset and data card throughput performance while
running tests and during post-test analysis. The CQI histogram
provides insight into how well the receiver is performing under
dynamic real-world fading and noise conditions, as well as
allowing benchmarking of CQI performance between devices or
across rmware versions.
Event charts and logging greatly simplify the reporting of device
call reliability and mobility performance, in real time and during
post-test analysis. A Procedure Chart provides insight into
performance of the device relative to network dened conditions
during testing, which enables benchmarking of key performance
metrics between devices or across rmware versions. Root
cause failure analysis is aided by integrated network logging and
reporting.
CONFIGURABLE REAL NETWORK AND RF CHANNEL
EMULATION
Quantifying the data throughput or call setup/drop rate
performance of devices on live networks can be extremely
challenging given their highly-variable nature. Operating
parameters such as trafc variation and number of connected
users can change at any time, impacting the collection of
consistent eld test data.
The Spirent SR3420 Network Emulator provides the ability to
simulate realistic multi-cell 2G and 3G network conditions in the
lab. The SR3420 is highly congurable, with a real-time state
machine that delivers an experience much closer to the real
network than other network emulators. It is designed to address
the needs of high-speed data throughput testing by delivering up
to 21 Mbps in the downlink at the application layer.
The SR3420s range of congurable network, RNC, and Node B
parameter options, from SIBs to Physical Channels enable real
network settings to be reproduced. SIB Parameters such as Cell
Quality Level Qqualminand Handover Reporting Range can
be all congured to test call performance under a wide range
of network scenarios. In addition to providing full Inter-RAT
capability, the SR3420 also supports testing of GSM, GPRS, EDGE
and WCDMA using co-channel and adjacent channel interference
rather than noise, since true interfering cells present a much more
realistic scenario.
Powerful reporting and charting simplies performance analysis.
Ideal for regression testing and benchmarking of call reliability performance.
Call Maintenance - Single Cell (Failure Rate)
Same vendor, different device
Same device, different rmware
UMTS Radio Access - Operator Acceptance and Performance Testing
SPIRENT 8100 MOBILE DEVICE TEST SYSTEM
Spirents industry-leading SR5500 Wireless Channel Emulator
generates realistic fading conditions that accurately and
repeatably model the time-varying degradation of the RF signals
received by the device due to multi-path, shadowing and
propagation losses. The SR5500 allows the exibility to choose
from a suite of pre-programmed 3GPP-recommended models or to
develop custom fading proles that reect other real-world fading
scenarios.
Leading network operators and mobile device developers make
use of these congurable network parameters and RF fading
conditions to model a particular type of network for effective
testing of device performance under specic real-world network
conditions.
PROVIDES ANSWERS TO KEY PERFORMANCE
QUESTIONS

How well does Physical Layer throughput perform?

How well does Rx Diversity perform?

How does fading impact performance?

How well does Application Layer throughput perform?

How sensitive is throughput to code power or C/N?

What is the impact of key MAC-hs parameters on throughput?

How well does the device set up a call?

How well does a device maintain a call?

How reliable are calls during mobility scenarios?

How much downlink power does a device require?

Which device performs better in terms of call reliability and
why?

How well does a device maintain service during Inter-RAT
handover?

How well does a device recover from extended loss of service?
Address real-world device performance issues including handovers and cell reselection.
Creation of custom fading proles is easy with the SR5500.
UMTS Radio Access - Operator Acceptance and Performance Testing
SPIRENT 8100 MOBILE DEVICE TEST SYSTEM
WCDMA, HSDPA, HSUPA, HSDPA+ (64QAM)
Number of Cells Up to 3 WCDMA/HSPA Cells; Up to 3 Interfering Cells
Bands 1, 2, 3, 4, 5, 6, 8, 9, 11
Uplink Power Control Algorithms 1 and 2
Downlink Power Control Mode 0; 1 to 6 dB
DPCH Gain -25 to -1 dB
P-CPICH, SCH, PCCPCH, S-CCPCH -40 to -1 dB
HS-PDSCH and HS-SCCH Channel Gain -40 to -1 dB
AGCH, RGCH, HICH -40 to -1 dB
Voice Calls AMR 12.2, AMR 5.9
Packet Calls UL: 64, 128, 384 kbps; DL: 64, 128, 384 kbps
Voice + Packet Calls Voice + Packet (R99); Voice + Packet (HSPA)
HSDPA/HSDPA+ UE Categories 1-14; Fixed or Normal CQI modes
HSUPA UE Categories 1-5 (10 ms TTI); CAT 4 (2 ms TTI), CAT 6 (2 ms TTI)
Handover Capability Cell Selection/Re-selection
Soft Handover
Intra/Inter-Frequency Hard Handover
HSDPA Serving Cell Change
Ciphering Release 99, HSPA (UEA1)
OCNS Release 99 (12 codes); Release 5 and 6 (5 codes)
GSM for Inter-RAT
Number of Cells 2 GSM Cell; Up to 2 Interfering Cells
GSM Bands 850, 900, 1800, 1900
Voice call Supports AMR 12.2
Ciphering A5/1, A5/3
WCDMA to GSM Voice handover Blind, Synchronous
Channel / Propagation Conditions
Standard 3GPP Fade Models WCDMA: Case 1, Case 2, Case 3. Case 6, PA3, PB3, VA30, VA120
GSM: RA130, RA250, TU1.5, TU3, TU50, HT100
Custom Channel/RF Models
(user dened)
Denable parameters with 10ms granularity:
- Cell Power (Ior)
- Multi-path
- Fade Model/Prole
- Doppler Frequency
- Phase Shift
- AWGN SNR
RF Specications
Number of Uplink RF Channels 2
Number of Downlink RF Channels** 2 Channels on A50*, A100, A300, A600
4 Channels on A304
RF Output Resolution 0.1 dB
RF Output Accuracy +/- 1 dB
AWGN SNR Ratio -30 dB to 32 dB
TECHNICAL SPECIFICATIONS
* Fading/Noise optional on 8100-A50 conguration.
** Upto 4 channels supported 2 channels per SR5500 Wireless Channel Emulator.
UMTS Radio Access - Operator Acceptance and Performance Testing
SPIRENT 8100 MOBILE DEVICE TEST SYSTEM
ORDERING INFORMATION
Data Throughput testing is supported on the A50, A100, A200, A300 and A600 congurations of the Spirent 8100 Mobile Device Test
System.
Call Reliability and Mobility testing is supported on the A200 (single cell test cases only), A300 and A600 congurations of the Spirent
8100 Mobile Device Test System.
1
Test Suites require one or more Test Packs.
2
Available to AT&T and its authorized suppliers only.
For detailed Test Pack and Test Suite descriptions, see the Radio Access Performance Test Packs data sheet.
Please contact your regional Spirent sales representative for detailed ordering information.
PERFORMANCE TESTS
Test Pack Part Number Test Pack Name & Performance Test Coverage
TM-DATA-HSDPA WCDMA/HSPA/HSPA+ Data Throughput
Physical Layer (FRC or RMC) and end-to-end Application Layer performance covering FTP, UDP, HTTP and
Round Trip Latency for WCDMA (R99) and HSPA/HSPA+ devices.
TM-DATA-EGPRS GPRS/EDGE Data Throughput
End-to-end Application Layer performance covering FTP, UDP, HTTP and Round Trip Latency for GPRS and
EDGE devices.
TM-UCR-3GCR 3G Call Reliability
Ability to make or maintain voice and/or data calls with one primary 3G radio link.
TM-UCR-R99-MOBILITY 3G R99 Mobility
Ability to maintain voice and/or data calls while moving from one cell to another and/or performing
radio link modication.
TM-UCR-HS-DL-MOBILITY 3G HSDPA DL Mobility
Ability to maintain HSDPA data transfers while moving from one cell to another and/or performing radio
link modications.
TM-UCR-2GCR 2G Call Reliability
Ability to make or maintain voice and/or data calls with one primary 2G radio link.
TM-UCR-2G3GRES 3G-2G Reselection
Idle Mode reselection performance.
TP-UCR-2G3GHCS 3G-2G Hierarchical Cell Selection
3G to 3G inter-frequency and intra-frequency HCS selection and reselection performance
(with a roadmap to 3G to 2G).
TM-UCR-2G3GICR Inter-RAT Call Reliability
Ability to maintain voice calls while moving between 3G and 2G cells.
PRE-CONFORMANCE TESTS
Test Suite Part Number Test Suite Name & Contents
1
TS-DATA-PRECONF-34.121 3GPP 34.121 Section 9.2.1 Pre-Conformance
Non-validated test cases covering 3GPP TS 34.121 Sections 9.2.1 A to G.
TS-HCS-PRECONF-34.123 3GPP 34.123 Section 6.1.2 Pre-Conformance HCS
Non-validated HCS test cases from 3GPP TS 34.123 Sections 6.1.2.3, 6.1.2.5, 6.1.2.10 and 6.1.2.3.10a.
OPERATOR VALIDATION & UE ACCEPTANCE TESTS
Test Suite Part Number Test Suite Name & Contents
1
TS-DATA-EGPRS-ATT AT&T GPRS and EDGE Data Throughput
2
TS-DATA-HSPA-ATT AT&T WCDMA and HSPA Data Throughput
2
TS-UCR-CS-ATT AT&T Call Reliability & Data Mobility
2
TS-UDL-DRIVE-TEST-ATT AT&T Simulated Drive Test
2
TS-DATA-HSPA-REL7-ATT AT&T HSPA+ Data Throughput Test
2
TS-UDL-DAM-ATT AT&T Device Aggressiveness Test
2
TS-UDL-3G-PESQ-ATT AT&T 3G Voice Quality PESQ with Rate Matching
2
2010 Spirent Communications, Inc. All of the company names and/or brand names and/or product names referred to in this document,
in particular the name Spirent and its logo device, are either registered trademarks or trademarks pending registration in accordance with
relevant national laws. All rights reserved. Specications subject to change without notice. Rev. B 07/10
AMERICAS 1-800-SPIRENT +1-818-676-2683 sales@spirent.com
EUROPE AND THE MIDDLE EAST +44 (0) 1293 767979 emeainfo@spirent.com
ASIA AND THE PACIFIC +86-10-8518-2539 salesasia@spirent.com
UMTS Radio Access - Operator Acceptance and Performance Testing
SPIRENT 8100 MOBILE DEVICE TEST SYSTEM
SPIRENT GLOBAL SERVICES
Spirent Global Services provides a variety of professional services, support services and educa-
tion services all focused on helping customers meet their complex testing and service assurance
requirements. For more information, visit the Global Services website at www.spirent.com/gs or
contact your Spirent sales representative.