[Classification]

Technical Product Description

TEMS Discovery 3.0

Ascom Network Testing AB

NT11-5751, 1.0, 3/31/2011

[Classification]

Version Overview
Vers. 2.0 Date 2011-3-31 Author Mikael Burman Modification First edition

Document Management
Word Text File: Document2 Release: This document was released following formal review by [Approved by]

NT11-5751, 1.0, 3/31/2011

[Classification]

Contents
1 Introduction
1.1 1.2 1.3

Key Features of TEMS Discovery ........................................................................ 6 Who Is TEMS Discovery Intended For? ............................................................... 6 Capabilities ........................................................................................................... 7 1.3.1 1.3.2 1.3.3 1.3.4 1.3.5 1.3.6 1.3.7 1.3.8 1.3.9 1.3.10 Drive Test Data Import .......................................................................... 7 Call Trace Import .................................................................................. 7 IP Trace Import ..................................................................................... 7 Network Configuration Import ............................................................... 8 GIS Data Import .................................................................................... 8 Antenna Data Import ............................................................................. 8 Coverage Map Import ........................................................................... 8 Handover Matrix Import ........................................................................ 8 Import API ............................................................................................. 8 Operating Systems ............................................................................... 8 TEMS Discovery Replay ....................................................................... 9 TEMS Discovery Standard ................................................................... 9 TEMS Discovery Professional .............................................................. 9

1.4

Functionality Levels .............................................................................................. 9 1.4.1 1.4.2 1.4.3

1.5

Where to Find Out More ....................................................................................... 9

Overview
2.1 2.1.1 2.1.2 2.1.3 2.1.4 2.2 2.2.1

10
Network Data Integration .................................................................... 11 Scripting Capabilities .......................................................................... 12 Reporting Capabilities ......................................................................... 13 Problem Set Capability ....................................................................... 14 Free Access to GIS Databases .......................................................... 15

Easy and Extensive Customization Capabilities ................................................ 10

Low Total Cost of Ownership ............................................................................. 15

System Description
3.1 3.1.1 3.1.2 3.2

16

Licensing ............................................................................................................ 16 Fixed Licensing ................................................................................... 16 Network Licensing............................................................................... 16

Deployment Scenarios ....................................................................................... 17

Features
4.1 4.1.1 4.1.2

19
Versatile Data Binning ........................................................................ 20 Automatic Data Processing ................................................................ 21

Flexible Deployment With Instant Access to Data ............................................. 19

NT11-5751, 1.0, 3/31/2011

[Classification]

4.1.3 4.1.4 4.1.5 4.1.6 4.1.7 4.1.8 4.1.9 4.2 4.2.1 4.2.2 4.2.3 4.2.4 4.2.5 4.2.6 4.2.7 4.2.8 4.2.9

Data Organization and Management ..................................................23 Powerful Data Filtering ........................................................................24 Diagnostics ..........................................................................................24 Full Access to Information Elements ...................................................26 Message Flow Diagram ......................................................................26 Highly Automatic Batch Printing ..........................................................28 Extensive Data Sharing Across the Organization ...............................29 Map View.............................................................................................30 Time Chart View ..................................................................................32 Message View .....................................................................................33 Point Detail View .................................................................................34 Instant Chart View ...............................................................................35 Metric Correlation View .......................................................................36 Problem Summary View......................................................................37 Report View .........................................................................................38 Histogram View ...................................................................................40

Analysis Views ....................................................................................................30

TEMS Discovery: Drilling Down Into Measurement Data 41

5.1 5.2 Contents and Characteristics .............................................................................41 Further Examples of How to Use TEMS Discovery............................................43 5.2.1 5.2.2 5.2.3 Dropped Call Analysis .........................................................................43 Positioning of Indoor Measurements ..................................................44 Sector Based Statistics .......................................................................46

Appendix:
6.1 6.2 6.3 6.4 6.5 6.6 6.7 6.8 6.9

47

Supported Operating Systems ...........................................................................47 Logfile Support ...................................................................................................47 Supported Technologies .....................................................................................48 Cell File Format ..................................................................................................48 Handover Matrix .................................................................................................49 GIS ......................................................................................................................49 Reporting ............................................................................................................49 License Options ..................................................................................................50 Features ..............................................................................................................50

NT11-5751, 1.0, 3/31/2011

[Classification]

Introduction

For true analysis and troubleshooting of UMTS, CDMA, TD-SCDMA, WiMAX, and LTE wireless networks, Ascom Network Testing offers the post-processing tool TEMS Discovery. TEMS Discovery is highly configurable and extremely user-friendly. It allows engineers to easily assess wireless performance and quickly pinpoint network problems. Highly automatic data processing increases the efficiency and provides instant access to knowledge about the behavior and performance of your network. No other product can match the variety of information elements that TEMS Discovery handles, allowing thorough analysis of the collected data. With comprehensive GIS data support and display you can pinpoint and visualize network problems. Analyzing air interface measurements in TEMS Discovery is the only way to obtain a truly adequate picture of the network, thanks to the many unique and advanced features within TEMS Discovery that competing reporting and analysis products cannot match. TEMS Discovery helps operators to: Increase revenue: Problems can be located and fixed before they start affecting customers, improving customer satisfaction and reducing churn. Fewer blocked and dropped calls mean more call time and higher earnings. A high quality of service also facilitates attracting new subscribers. Optimize investments: A wireless telecom network represents a huge investment and needs optimization to bring the best possible return. TEMS Discovery helps when analyzing the collected data, allowing you to make wise investment decisions. It can also be used to test new features before rollout to ensure their performance in the live network. Maximize their competitive edge: With TEMS Discovery the entire network is scrutinized down to the smallest detail. Every single event, all important key performance indicators (KPIs), any signs of network degradation and much more are examined continuously. This keeps your network at the highest possible quality, leaving competitors behind. Speed up rollout and verification of new technology: Analyzing huge data volumes takes a lot of time and with TEMS Discovery the process can be simplified and focused on detecting and solving problems not only processing data. With the introduction of TEMS Discoverys new diagnostics features, users can pinpoint issues in network configuration and other problems that can be time consuming to identify. Using diagnostics, they can find the signatures of the problems and highlight them.

TEMS Discovery provides comprehensive data processing for both packet-switched and circuit-switched data. TEMS Discovery supports all major radio technologies, see appendix 6.3 This data processing uses multiple data sources, such as measurement data from drive test devices and scanners, as well as GIS data, network cell configuration and parameters, neighbor lists, and antenna patterns. To complete the picture, drive test data can be synchronized with Ericsson network recordings (UETR) and IP traces (LibPcap). For LTE, for example, TEMS Discovery supports analysis of both LTE scanner data and LTE device data, more than 400 LTE information elements, events, and cell data.
NT11-5751, 1.0, 3/31/2011

[Classification]

1.1

Key Features of TEMS Discovery

With TEMS Discovery, you will increase your efficiency and profit via: Easy and extensive customization capabilities. The various views and data explorers can be arranged in an endless number of combinations. Multiple sub-views for easy side-by-side comparison or the more conventional views with maps (including Google Maps and Microsoft Bing Maps, via license agreements), time series, messages, tables, histograms or reports the choice is yours. In addition, TEMS Discovery includes a completely customizable report template builder, key information settings, analysis sets, point detail configuration, and more.

Figure 1: Example of the highly configurable user interface of TEMS Discovery

Low total cost of ownership. The software can be deployed with minimal IT system requirements and with minimal dependence on third-party software. Large volumes of data are handled with low memory demand, and the intuitive interface provides a fast learning curve and reduced analysis time. There is also integrated online access to free or low-cost GIS data sources. Flexible deployment architecture. Network configuration is easy to set up with minimal platform requirements and allows for collaboration of engineers across functional roles and geographies. The processed data is instantly accessible across the organization and provides highly organized information, with an unlimited number of composite datasets. Multi-vendor capabilities. TEMS Discovery handles a variety of drive test tools and is thus the only post-processing tool you need to learn, maintain, and upgrade.

1.2

Who Is TEMS Discovery Intended For?

RF engineers are notified of all sorts of local malfunctions (weak signal reception, bad C/I, low data throughput, etc.), prompting them to try out
NT11-5751, 1.0,3/31/2011

TEMS Discovery is designed to benefit all levels of the operators organization:

[Classification]

various tweaks to the network configuration. TEMS Discovery provides easy access to information elements as well as on-demand data extraction and intelligence embedding with the Script Builder, for pinpointing and evaluating network problem areas. Advanced R&D staff can also use TEMS Discovery as a research tool in the rollout stage of emerging technologies, because it provides customization of scripts. Managers are able to supervise the organizations processes and the services it offers. They can keep track of any events or metrics of interest (dropped call rate, to give just one example) by studying reports easily defined with the Report Builder. They are aided in making decisions on investments and organizational improvements. By getting a tighter grip on the networks end-to-end voice and data quality, the company is also in a better position to offer customers reliable service level agreements. Network planners learn about spots with recurrent problems by requesting statistics confined to specific areas. This helps them reveal deficiencies in the network layout or the underlying theoretical models, while also providing input for improvements. As a result they are able to boost network utilization and get maximum mileage out of the existing network before new investments are made. Marketing staff can extract statistics on usage patterns, furnishing the basis for precisely targeted advertising campaigns. Being more intimately familiar with the networks quality of service, they can also work out more advanced and precise charges for various services. It is less risky to promise, and charge for, quality that has been thoroughly assured. The customer care unit can order coverage information to enlighten customers who are making complaints or enquiries. Complaints can be cross-checked against network status reports to help determine whether a problem resides in the network or in the customers handset.

1.3
1.3.1

Capabilities
Drive Test Data Import

TEMS Discovery supports the import of native drive test data from the major drive test tool vendors, see appendix 6.2 With the generic data import, any text based (.tab or .csv) file format can be imported to TEMS Discovery. It is easy to define an import schema by dragging and dropping.

1.3.2

Call Trace Import

Call traces (UETR) from Ericsson OSS can be imported and synchronized with the drive test data.

1.3.3

IP Trace Import

IP trace data (LibPcap) collected together with drive test data can be synchronized and analyzed in TEMS Discovery.

NT11-5751, 1.0, 3/31/2011

[Classification]

1.3.4

Network Configuration Import

Site data can be imported as network configuration files. TEMS Discovery supports import of cell configuration data from multiple network planning tool and drive test tool vendors. Network configuration data can also be imported from Ericsson OSS (Bulk CM), see appendix 6.4 With the generic network configuration import, any text based (.tab or .csv) file format can be imported to TEMS Discovery. It is easy to define an import schema by dragging and dropping. Network configurations imported into TEMS Discovery can be exported to Ascom Network Testings TEMS XML cell file format.

1.3.5

GIS Data Import

For map display, there is a wide selection of free or low-cost yet high quality data available. TEMS Discovery supports approximately 100 commonly used GIS file formats, including: Automatic merging of GIS data with different sources, formats, and projections Terrain elevation data, raster images, and vector data Free access to online GIS databases Google Maps/Microsoft Bing Maps as a complement to ordinary map formats

1.3.6

Antenna Data Import

The Network configuration file can contain antenna type as a parameter of the sector table. TEMS Discovery is able to provide a view for the antenna pattern of a sector.

1.3.7

Coverage Map Import

Coverage maps exported from external planning tools can be imported into TEMS Discovery. Those coverage maps can be displayed in the map view for viewing, or used to generate delta metrics.

1.3.8

Handover Matrix Import

Handover matrices can be imported. Based on those matrices, TEMS Discovery can perform neighbor list tuning and eventually export a neighbor list work order for implementation. See appendix 6.5

1.3.9

Import API

TEMS Discovery provides an API for users to develop their own parser to import data into TEMS Discovery. This means that you can import native data from any tool and any type of data.

1.3.10

Operating Systems

TEMS Discovery is a .NET application that can be used with most of the Microsoft operating systems, see appendix 6.1 8
NT11-5751, 1.0,3/31/2011

[Classification]

1.4

Functionality Levels
TEMS Discovery Replay, single logfile analysis TEMS Discovery Standard includes all the functionality needed to analyze drive test data TEMS Discovery Professional is an advanced version with enhanced functionality for automated reporting and analysis

TEMS Discovery has three levels of functionality:

1.4.1

TEMS Discovery Replay

TEMS Discovery Replay is a low cost single logfile post processing tool for TEMS logfiles. With TEMS Discovery Replay you can make a quick analysis of collected logfiles. For more information see chapter 6 Appendix

1.4.2

TEMS Discovery Standard

The standard version includes multiple logfile analysis capabilities with synchronized views and built-in standard reporting. TEMS Discovery Standard is available with fixed or floating license. See chapter 6 Appendix

1.4.3

TEMS Discovery Professional

The professional version includes all of the functionality needed for drive test data analysis and lets you tailor the tool to fit into the process flow. TEMS Discovery includes Script Builder, Report Builder, and automatic data processing, just to mention some of the advanced features that can make the analysis efficient. See chapter 6 Appendix

1.5

Where to Find Out More

For additional information concerning TEMS Discovery or other TEMS please visit us on the Web at www.ascom.com/networktesting.

products,

To sign up for a subscription to TEMS Bulletins, please go to the link above and click Register for TEMS Bulletins. This free service includes e-mail notification of TEMS product launches, version upgrades and patches, as well as our online customer magazine.

NT11-5751, 1.0, 3/31/2011

[Classification]

2
2.1

Overview
Easy and Extensive Customization Capabilities

With TEMS Discovery, you have the flexibility to configure a wide range of items, from simple view layouts and key information settings to sophisticated report templates. You can embed your companys preferences, expertise, and knowledge into the tool and thereby define your sets of preferences or templates. Post-processing with TEMS Discovery fulfills a full range of needs: Initial tuning Find missing neighbors, evaluate your coverage, and review your services, among other tasks. Network monitoring Key performance indicators (KPIs) for voice, data services, streaming video, and video telephony help you to keep track of the quality of your network. They also serve as a good decision support for your improvements. Network optimization The tool assists in pinpointing network problems, with root cause analysis. Benchmarking Find out if you are best or worst, and the difference between you and your competitors. Coverage analysis Coverage is not only about measuring your signal strength values, but also accessibility of different services, limited service plots, and no coverage plots. With various drive test tools you can measure on your roaming partners to find out if they are fulfilling their requirements. TEMS Discovery coverage plots can also be used in your planning tool. Troubleshooting With TEMS Discovery, the troubleshooting of tricky problems that need multiple data sources (drive test data, call trace data, IP trace data) can be done in one tool with full synchronization.

10

NT11-5751, 1.0,3/31/2011

[Classification]

2.1.1

Network Data Integration

Full access to various types of data and simultaneous display of this data enhances your understanding of the networks performance. You can customize what to display on the screen as well as how it is displayed.

Figure 2: Customized display of network data

Some of the useful functions that ensure you find what you are looking for are listed below: Integration of imported network configuration data, parameters, and neighbor lists Color coding or labeling of all parameters Grouping and searching by one or multiple parameters Linking of drive test data points to sectors Graphical neighbor list display and editing

NT11-5751, 1.0, 3/31/2011

11

[Classification]

2.1.2

Scripting Capabilities

The Script Builder provides an advanced function to extract data from messages and apply customized algorithms to generate new metrics and events. It offers rule based classification of events and automated analysis, and thus considerable time savings.

Figure 3: The Script Builder assists in customizing algorithms and extracting specific data

The functions in brief: On-demand data extraction and intelligence embedding Simple drag-and-drop access to: o o All metrics All information elements in Layer 3 messages

Generation of any metrics, events, and filtering criteria Embedding of proprietary algorithms for standardization across the organization Scripting in C#/C/C++ syntax Generated metrics and events are accessible from all tools and reports, similar to already built-in metrics and events

12

NT11-5751, 1.0,3/31/2011

[Classification]

2.1.3

Reporting Capabilities

Accurate analysis templates and reports are important for the sharing of knowledge. The Report Builder within TEMS Discovery is designed to provide great flexibility to generate reports in Microsoft Office Excel (*.xls) format from drive test data. It eliminates the need to request customized generations from other tool vendors, or manually conduct data manipulation. There are also predefined and built-in report templates for RAN tuning or acceptance reports, among others. The corresponding map view is automatically included in the report, without any need for copy and paste.

Figure 4: Intuitive Report Builder allows customized reports to be generated on demand

With the Report Builder, all you need is to drag and drop data objects to generate a final report. The bullets below summarize the advantages of the tool: Access to all TEMS Discovery events and metrics
NT11-5751, 1.0, 3/31/2011

Full array of statistical attributes The ability to drag and drop to any desired cell Formula and Equation Styles Charting

Access to all Excel functions

Data filtering per any file/device attributes 13

[Classification]

Operators: for benchmarking Date: for trending Ability to use universal templates or specific data Reports can be sent via e-mail directly to specific recipients or to predefined groups of recipients.

2.1.4

Problem Set Capability

A problem set is predefined rules for filtering out specific logfiles (from a large set of logfiles) that contain problems. TEMS Discovery is delivered with a number of built-in problem sets for the different technologies. The problem sets can be customized and connected to analysis sets tailored for the analysis of the detected problem.

Figure 5: Problem set for LTE problem detection

Users can define any combination of problem sets from pre-defined or user-defined events.

14

NT11-5751, 1.0,3/31/2011

[Classification]

2.2

Low Total Cost of Ownership

TEMS Discovery is easy to learn and extremely user friendly. That minimizes the need for training and the start-up time is very short. A getting-started function called Walk-UThrough (TEMS Discovery Wizard) walks you through some of the most common usage tasks.

Figure 6: Walk-U-Through wizard for work process guidance

Since the tool has an exceptional number of rich features and supports all possible technologies, it is a complete choice for your post-processing needs.

2.2.1

Free Access to GIS Databases

TEMS Discovery fully integrates Google Maps /Microsoft Bing Maps. Moreover, more than 100 different file formats of terrain elevation data, raster image data, and vector files are supported.

Figure 7: Free GIS data made instantly accessible by TEMS Discovery

Easy access at low cost, thanks to: Integrated online access to multiple free GIS databases USGS TerraServer High-resolution terrain elevation data, aerial, or satellite images Free downloading of data for TEMS Discovery default boundary or any user-defined area

Web links to popular Web sites for free or low-cost GIS data sources

NT11-5751, 1.0, 3/31/2011

15

[Classification]

System Description

TEMS Discovery can be deployed for different scenarios, from stand-alone data processing to centralized data processing and network licenses.

3.1

Licensing

TEMS Discovery has two types of licensing: fixed licensing and network licensing.

3.1.1

Fixed Licensing

The fixed license is installed on each users laptop or desktop, and each user can have the different configurations of options on his/her dongle. Hence, there is no need to have access to the intranet.

Figure 8: TEMS Discovery fixed license deployment

3.1.2

Network Licensing

This licensing is achieved by a floating license pool, with a global or regional license server. Multiple users can share the license as long as there are free licenses available on the server. The license pool needs to have the same setup of options and all users will get the same license options.

Figure 9: TEMS Discovery network licensing deployment

16

NT11-5751, 1.0,3/31/2011

[Classification]

3.2

Deployment Scenarios

The data collected by the different methods of measurement (RTU, TEMS Investigation, TEMS Pocket, TEMS Symphony, TEMS Monitor Master, Nemo, JDSU or other test units) is processed and stored in databases, and then accessed by and analyzed in TEMS Discovery.

Figure 10: TEMS Discovery deployment overview.

TEMS Discovery can be deployed for various scenarios (see Figure 10), but those can be categorized into two main types: Stand-alone, where a client application together with the data processing and storage is installed on a laptop or desktop. All tasks are performed locally, with possible connection to other machines for data sharing (if used). The licensing is achieved by attaching a local dongle. Client access to automatically processed data, where the drive test data is uploaded to and automatically processed by data processors from which the data is imported into the TEMS Discovery client where it is also stored.

The user can select to use TEMS Discovery file systems or Microsoft SQL Server for the storage of processed data. Every installed version of TEMS Discovery has its own private data storage. The following two types of additional data access are possible: Via public folder or database Projects and datasets are visible to authorized versions of TEMS Discovery and can be downloaded. An

NT11-5751, 1.0, 3/31/2011

17

[Classification]

authorized version of TEMS Discovery can also upload (publish) projects and datasets to the public folder. Via peer-to-peer data sharing Projects and datasets are visible to authorized peers and can be downloaded by the connected peer. Peerto-peer sharing uses a TCP protocol and can be set up within a LAN or remotely through the Internet.

In an automated data processing environment, one computer is set up as master task dispatcher, and multiple computers can be set up as slave task members. The processed data can be published and downloaded by multiple authorized clients for additional data analysis or visualization.

18

NT11-5751, 1.0,3/31/2011

[Classification]

Features

This chapter fleshes out the key features of TEMS Discovery as stated in section 1.1 The listings below are by no means comprehensive. The aim of the chapter is to cover some essentials of how TEMS Discovery works, but also to spotlight a number of specific functions that are particularly useful.

4.1

Flexible Deployment With Instant Access to Data

Using drive test data and site data, you can build business intelligence for the entire organization with TEMS Discovery. The data is processed and easily accessible by all possible departments and for different purposes, such as: RF engineers, for analyzing the collected information in detail Sales force, which can be provided with reports showing improvements that have been made and comparisons with competitors Customer support, needing daily updated coverage information where poor areas or ongoing network improvements can be highlighted in maps or reports Network operation/rollout, where site acceptance and verification of changes can be monitored Management, interested in KPI reports showing competitor comparisons, trends over time, or just a summary of the overall health of the network Government requirements, where TEMS Discovery can provide reports for compliance, such as coverage maps

NT11-5751, 1.0, 3/31/2011

19

[Classification]

4.1.1

Versatile Data Binning

The binning of data directly affects the KPI statistics as well as analysis of the data.

Figure 11: Data binning options

For utmost flexibility, there are several options available for data binning according to the list below: Time binning during data import Frame level resolution Smart selection No binning for event-triggered messages Binning for periodic messages

Geo binning Distance binning Grid binning Per-region mixed resolution (for example, fine resolution in dense urban areas and coarse resolution in rural areas) Holes can be defined in regions, for additional binning (and filtering) options

20

NT11-5751, 1.0,3/31/2011

[Classification]

4.1.2

Automatic Data Processing

For analysis of huge amounts of information to be possible at all, the handling and processing of the collected data must be carried out in a very efficient manner.

Figure 12: Automatic data processing increases efficiency

One of the major reasons why TEMS Discovery is so powerful and yet so easy to use is that the processing of data is fast and efficient, due to the following features: Handling of large volumes of data with low memory demand Multi-thread, background data processing, while additional logfiles are being processed simultaneously Multi-computer distributed computing with automatic task dispatcher and load balancing Easy and flexible configuration Multiple tasks can be configured Options for selective data import Flexible processing, where the user selects IEs of interest and whether to perform geolocation binning directly or later on Possibility to adjust antenna gain during import Other valuable features:
NT11-5751, 1.0, 3/31/2011

Smart merge of fragmented files Direct reading of zipped files 21

[Classification]

Group attribute editing during import

Automatic creation of multiple projects and datasets according to the users configuration Automatic creation of KPI plots and reports Automatic e-mail notifications to multiple recipients Automatic rule-based device attribute assignment

22

NT11-5751, 1.0,3/31/2011

[Classification]

4.1.3

Data Organization and Management

To be able to find specific information with little effort and analyze it smoothly, the collected data has to be highly organized and cleverly managed.

Figure 13: Organized and well-managed data enables easy access and fast analysis

This is possible within TEMS Discovery: Each raw test file needs to be processed only once Processed data provides highly organized information There is incremental merging of new data with existing data Data is instantly accessible You have an unlimited number of composite datasets There is controlled sharing of all processed data across multiple users, for avoiding duplication of work Old data can be easily archived, and restored if needed with its structure intact

NT11-5751, 1.0, 3/31/2011

23

[Classification]

4.1.4

Powerful Data Filtering

In order to find specific information among the collected data, no matter how well organized, you need a filtering function that assists you in this complex task.

Figure 14: Efficient filtering of data

You have several filtering options that, either one-by-one or combined, bring out the wanted information. Those filtering options are: Geographical regions Network sector groups User-defined metric-based conditions User-defined problem set Data collection date Data processing date User-defined event set

4.1.5

Diagnostics

Diagnostics (intelligent rule-based analysis) is a supremely powerful feature that will help you to pinpoint existing or potential problem areas that are often difficult and tedious to locate manually. The diagnostics are designed to reveal weaknesses related to cell configuration, tuning and optimization, accessibility, retainability, and integrity. Diagnostics are also used for classification of problem events like drop, block, etc. Examples of diagnostics included in TEMS Discovery Speech quality due to radio or core network issues Low PESQ categorization on WCDMA (e.g., due to missing neighbor, pilot pollution, etc.) Dropped call categorization for GSM and WCDMA

24

NT11-5751, 1.0,3/31/2011

[Classification]

Dropped call diagnostics based on 3GPP recommendations, indicating radio link failure, due to too early handover, radio link failure, due to handover to wrong cell. Ping-pong handover (on GSM)

NT11-5751, 1.0, 3/31/2011

25

[Classification]

4.1.6

Full Access to Information Elements

TEMS Discovery supports comprehensive message decoding, giving you full access to information elements. Extracting the value of a key information element from over-theair Layer 3 signaling messages is as simple as clicking the desired information element, or IE, in the built-in IE explorer. You can select any information elements and display their values in the message summary view, eliminating the need to check message details one by one.

Figure 15: IE explorer reveals signaling message contents

The IE explorer supports: Latest 3GPP and 3GPP2 standards Organized Layer 3 information elements Checked information element for selective display Global and Local keyword search Quick reference and signaling message encyclopedia for RF engineers and expert users

To make the analysis complete, drive test data can be correlated with Ericsson Traffic Recordings (UETR) and IP traces (LibPcap). The data from all different sources will be synchronized.

4.1.7

Message Flow Diagram

The message flow diagram enhances the capability to analyze the radio signaling by presenting the uplink and downlink signaling as a flow chart including time delays and response times. 26

NT11-5751, 1.0,3/31/2011

[Classification]

Figure 16: Message flow diagram

NT11-5751, 1.0, 3/31/2011

27

[Classification]

4.1.8

Highly Automatic Batch Printing

Select any configuration of metrics for map view display or for a specific chart type Apply any configuration to any specific mobile device Use an unlimited number of mobile/configuration pairs Send your output to an electronic *.pdf file format, or to a regular printer

With this useful function you can:

Figure 17: Automatic batch printing

28

NT11-5751, 1.0,3/31/2011

[Classification]

4.1.9

Extensive Data Sharing Across the Organization

The sharing of processed data across the organization is handled via a designated public folder. TEMS Discovery provides: One-click publishing (upload) and data access (download) Remote collaboration via peer-to-peer data sharing Instant packaging and un-packaging of documents, project, dataset, GIS data, and network configuration data, for effortless data sharing A broad spectrum of configurations

Figure 18: TEMS Discovery document and configuration sharing across the organization. Contents of redcolored configurations can be further set to read-only or hidden for intellectual property rights (IPR) protection.

NT11-5751, 1.0, 3/31/2011

29

[Classification]

4.2

Analysis Views

In this section we will highlight some of the views that will assist you in analyzing your network. The intention is not to provide a comprehensive description of all details but to give you a taste of the capability of TEMS Discovery.

4.2.1

Map View

The map view is a multi-layer display that can display multiple datasets, multiple cell configurations, and multiple GIS in the same view. To display data in the map view, you simply drag the data object from the Data Explorer and drop it into the map view.

Figure 19: Map view presenting multiple types of data (drive tests, GIS, indoor floor print, cell configuration) in multiple synchronized or non-synchronized sub-views, multi-metrics displayed with offset, and floating legends

TEMS Discovery supports terrain elevation data, raster image data, and vector files. You can download free high-resolution aerial images and terrain elevation data directly from several GIS servers worldwide. Multiple synchronized sub-views can easily be created for extensive geographical comparison and analysis. Cell sites can then be plotted on the map. Cell names, identities, or any other label can be presented next to the cell site symbol. Clicking a site displays information about it. 30
NT11-5751, 1.0,3/31/2011

[Classification]

The information loaded into the map view can also be displayed in Google Maps or Microsoft Bing Maps.

Figure 20: Indoor drive test data can also be displayed with high-resolution satellite image as background

Among all the useful functions of the map view, a few are listed below: Spider movement tool Displays ray lines that link the data point to the appropriate sector for serving and neighboring sites. Sector coverage tool Makes it possible to click on a sector to view its coverage. IntelliSense tool Displays the information of a data object in a tool tip while moving the mouse over that data object. Neighbor list IntelliSense tool Displays ray lines that link to neighboring sectors, when moving the mouse over a sector. Antenna pattern viewer tool Makes it possible to click on a sector to view its antenna pattern. Terrain path profile tool Displays the terrain path profile when clicking and holding to draw a path.

In addition, the map view display can be captured as an image file or be exported as a TIFF file or GIS package. You can also generate a PDF file or print the map view display.

NT11-5751, 1.0, 3/31/2011

31

[Classification]

4.2.2

Time Chart View

The time chart displays how the values of radio parameters evolve over time. Several parameters can be plotted in the same chart to enable quick inspection of correlation. Important time chart features include: Zooming and panning Events shown Multiple (up to 6 x 5) synchronized sub-views in each chart

Figure 21: Time chart displaying multiple metrics and events. Coloring indicates changes in active set membership

Color coding of the metrics displayed Possibility to place a label with user defined text in the chart The time chart display can be printed and saved as an image file

32

NT11-5751, 1.0,3/31/2011

[Classification]

4.2.3

Message View

The message view contains two panels. The left-side panel is a spreadsheet that lists the messages in time sequence, and the right-side panel displays detailed information of the selected message in the left panel.

Figure 22: Message view listing filtered messages and detailed information

In the message view, you can: Open a Layer 3 IE explorer Decide on the most interesting information for display in the KeyInfo column Apply suitable colors to your messages, for easier viewing Filter the messages: By mobile ID By type of information By selected message By KeyInfo

Export the messages to a text file

NT11-5751, 1.0, 3/31/2011

33

[Classification]

4.2.4

Point Detail View

The point detail view provides a convenient way to overview detailed information from a particular time or location. By moving the cursor into the map view and time chart, or by changing the row selection in the spreadsheet of the message view and table view, the detailed information will be displayed as shown in the picture below.

Figure 23: The point details view displays detailed information about a specific measurement sample or message

You control what to display by selecting a specific user configurable metric group from the configuration combo box. You can also edit or sort the displayed metric group. The point detail view can also be displayed in the map view as tool tip information.

Figure 24: The tool tip displays detailed information about a specific measurement

34

NT11-5751, 1.0,3/31/2011

[Classification]

4.2.5

Instant Chart View

The instant chart view is a user-configurable view for graphical display of a set of array data. Features include: Multiple configurations Instant bar chart view with optional table view Multiple chart space and multiple metrics Fixed or metric-based coloring Scanner or phone data: Ec/Io and RSCP for all pilots on one or multiple UARFCNs Transport channel information: Configuration, state, and throughput of concurrent channels Adjacent channel analysis: Graphic visualization of the channel strength of adjacent channels

Examples of usage:

Figure 25: Instant chart view

NT11-5751, 1.0, 3/31/2011

35

[Classification]

4.2.6

Metric Correlation View

Metric correlation enables the indication of a linear/non-linear relationship between two metrics. You simply drag a metric data object from the Data Explorer and drop it into the correlation view, then drag another metric data object and drop it into the same correlation view. The relationship between these two metrics is then established with the least squares fitting mathematical procedure.

Figure 26: Metric correlation view showing relation between metrics

36

NT11-5751, 1.0,3/31/2011

[Classification]

4.2.7

Problem Summary View

This view lists the problem summary of devices based on predefined or user configurable problem sets (dropped calls, handover failures, etc.). You drag and drop devices into the view and if a device has problems, its background color will change from white to orange. You can decide to display all devices or only those with problems. You can view the details of a problem of a particular device or analyze the device. All problem information can be saved to Excel. From the problem summary view you can open the problem file with an analysis set designed for analysis of the specific problem at hand.

Figure 27: Problem summary view enabling easy analysis of devices with problems

NT11-5751, 1.0, 3/31/2011

37

[Classification]

4.2.8

Report View

The report view provides a view for a particular mobile device or dataset based on a predefined report template. Simply right-click on a mobile device or dataset and select Send to Report View, and TEMS Discovery will generate a report (in Office Excel XLS format) based on the selected report template from the target data. You also have the option to define your own report template or to specify what you want included in a report, with the help of the very flexible Report Builder. This eliminates the need to request customized report generation from another tool vendor, or to manipulate data manually. The Report Builder: Provides drag-and-drop access to all metrics and events absolutely no SQL, Macro, or VB script knowledge required Is capable of creating very demanding and advanced reporting templates with complicated device filtering criteria Supports all frequently used statistical parameters Supports per-file and per-sector statistics

Figure 28: With the Report Builder you create your own templates and define how to display your data

The available report types using the Report Builder are: Single values of metrics with statistical parameters such as count, mean, min, max, linear average, standard deviations, variance, sum, first, duration, unique count, and more Histogram chart with statistical parameters such as % of total, % meeting condition, count, unique count, linear average, mean, min, max, sum, first, duration, unique, and more Trend chart with periodicity of hour, day, week, and month Map view with option of including cell configuration, GIS data, and output area range Sector-by-sector statistics File-by-file statistics
NT11-5751, 1.0,3/31/2011

38

[Classification]

Correlation statistics

NT11-5751, 1.0, 3/31/2011

39

[Classification]

4.2.9

Histogram View

The histogram view is for graphical display of metric data showing the proportion of data that falls into each specific plot band. The graphical display of metric data can be shown as a bar graph, a 2D pie chart, or a 3D pie chart. All options can be freely converted from one to the other.

Figure 29: The histogram view displaying metric data in various charts

40

NT11-5751, 1.0,3/31/2011

[Classification]

TEMS Discovery: Drilling Down Into Measurement Data

TEMS Discovery is designed for in-depth study of your measurement data. It gives fast and full access to already processed data. A generous set of data presentation views helps you to visualize the quality and performance of the network. TEMS Discovery uses a high-performance geographic information system (GIS), supporting approximately 100 different map formats. TEMS Discovery uses synchronizable views such as maps, time charts, messages, tables, and point details to display data collected at the same time (for drive test data playback). There are also data summary views such as histograms, metric correlation, reports, batch PDF views and problem summary views to present statistic data in various formats. The problem summary view, for example, provides an easy way to pinpoint problems and drill down among user configurable analysis sets, to find the cause. Some usage examples are found in section 5.2, Further Examples of How to Use TEMS Discovery.

Layer 3 message listing

Figure 30: TEMS Discovery user interface

5.1

Contents and Characteristics

All of the data in TEMS Discovery is well organized, and, unlike competing tools where you need to load raw log data in every new session, TEMS Discovery loads the data once and saves the processed data permanently until removed. Several projects may be active at the same time. Each project has its own workspace where all views belonging to the project are kept together. This coherence makes it very easy to work with several projects without losing track of what views belong together. View sizes can be freely adjusted.

NT11-5751, 1.0, 3/31/2011

41

[Classification]

All views in a project are synchronized. Selecting a new item in one project view automatically highlights the corresponding item in all other views. A dataset is created by importing one or several raw drive test files. All of the processed data are organized according to certain attributes, including the original file names, device names, mobile IDs, labels, etc. Processed data from one or more datasets of a project can be logically combined into composite datasets. A typical practice is to group the processed data by one attribute, such as mobile IDs or functional labels (long call, short call, PS call, etc.). An analysis set is a set of view layouts that includes precise configuration settings describing the specific names of the metrics to be displayed in a given view. You can send a whole set of metrics defined in an analysis set from a selected data source with a single click.

42

NT11-5751, 1.0,3/31/2011

[Classification]

5.2

Further Examples of How to Use TEMS Discovery

The illustrations given so far in chapter 4 mainly served to support the description of the user interface components. This section provides further examples of data presentations and analysis.

5.2.1

Dropped Call Analysis

Figure 31: The reason behind a dropped call is analyzed. It appears that the SIR target cannot be reached because of weak signal power. With the help of Google Maps, one can conclude that the call was dropped inside a building.

NT11-5751, 1.0, 3/31/2011

43

[Classification]

5.2.2

Positioning of Indoor Measurements

Figure 32: Indoor measurements from TEMS Pocket, for example, can be positioned within the building where the measurements were performed. The TEMS Pocket *.zip file containing the indoor measurements and the floor plan is imported just as a regular drive test data file. When any data is dragged and dropped into the map view, the floor plan appears with the selected data samples plotted. To position these measurements in relation to the actual building, you right-click the floor plan in the explorer and GIS/coverage map tab and select image rectification. Then you simply mark the corners of the floor plan and the corresponding corners of the building, and the positioning is done. The result is displayed in the next figure.

Positioning of indoor measurements is done and the result is shown in figure 33 below:

44

NT11-5751, 1.0,3/31/2011

[Classification]

Figure 33: After geo-rectification, the indoor measurement data can be displayed like normal outdoor drive test data along with other GIS and cell configuration data

NT11-5751, 1.0, 3/31/2011

45

[Classification]

5.2.3

Sector Based Statistics

One-click generation of multiple KPIs on a sector-by-sector basis Color coding of sector icons with drive test KPIs for instantaneous, graphical visualization of network performance Any combination of two arbitrary KPIs can be presented simultaneously

Statistics can be generated and displayed per sector. Functions include:

Figure 34: Statistics easily generated per sector, displaying clearly the selected KPIs

46

NT11-5751, 1.0,3/31/2011

[Classification]

6
6.1
Function

Appendix:
Supported Operating Systems
Replay X X X X X X Standard X X X X X X Professional X X X X X X

Windows XP (SP 3) Windows Vista (SP 2) Windows 7 (32 bit) Windows 7 (64 bit) Windows Server 2005 Windows Server 2008 R2

6.2
Function

Logfile Support
Replay* X X X X X Standard** X X X X X Professional X X X X X X X X X

TEMS Investigation 8.0 13.0 TEMS Pocket 7.3 -10.0 TEMS Automatic 7.2 8.3 TEMS Symphony TEMS Monitor Master Nemo JDSU Ericsson UETR LibPcap IP trace * TEMS Discovery Replay has three options
o TEMS Discovery Replay, Option 1

TEMS Pocket 7.3 (Sony Ericsson, Nokia) logfiles TEMS Pocket 10.x (Sony Ericsson) TEMS Investigation logfiles TEMS Automatic logfiles

Logfile extension: .log .lzz (deflate compressed file log) .lzm (lzma compressed file log) .zip (.log and .pcap, lzma compressed library)

TEMS Discovery Replay, Option 2 TEMS Pocket 8.0 & 8.1

Logfile extension: .tmz

TEMS Discovery Replay, Option 3 TEMS Pocket 9.0 logfiles TEMS Symphony logfiles

NT11-5751, 1.0, 3/31/2011

47

[Classification]

TEMS Monitor Master trace files

Logfile extension: .qmd .qmz

**TEMS Discovery Standard (bundled with TEMS Investigation) supports the following log file formats:
TEMS Pocket 7.3 (Sony Ericsson, Nokia) logfiles TEMS Pocket 10.x (Sony Ericsson) TEMS Investigation logfiles TEMS Automatic logfiles

Logfile extension: .log .lzz (deflate compressed file log) .lzm (lzma compressed file log) .zip (.log and .pcap, lzma compressed library)

6.3
Function

Supported Technologies
Replay X X Standard X X X X X X X Professional X X X X X X X

GSM/GPRS/EGPRS WCDMA/HSPA/HSPA+ CDMA (IS-95/CDMA 2000 1x/EV-DO rev 0 & rev A) TD-SCDMA FDD-LTE TD-LTE (scanner only) WiMAX

6.4
Function

Cell File Format

Replay
X X

Standard
X X

Professional
X X X X X X X X

Ascom TEMS .XML Ascom TEMS .cel ASSET XML Actix Celref Atoll XML. Generic cell file import (txtxt, csv, tab) Cell file export to TEMS XML format Import of Ericsson cell file data (Bulk CM)

48

NT11-5751, 1.0,3/31/2011

[Classification]

6.5
Function

Handover Matrix
Replay Standard Professional
X

Alcatel-Lucent

6.6
Function

GIS
Replay X Standard X Professional X

Supports more than 110 different GIS data formats, including many free or low-cost high resolution terrain data, satellite images, and vector data GIS data: terrain elevation, clutter, raster image, vector data Automatic merging and re-projection of data from different sources Cell site linking with drive test data point Interactive linking between cell explorer and cell icons on map view Directly import GIS data from multiple free online GIS data sources Integrated Google Earth / Map / Satellite /Terrain Integrated Microsoft Bing Map / Map / satellite /terrain Display of neighbor relations Antenna pattern viewer Co- and adjacent channel highlighter 3D map view Terrain profile tool

X X X X

X X X X

X X X X X X X X X X X X

6.7
Function

Reporting
Replay Standard X Professional X

Service KPI report FTP DL FTP UL UDP DL UDP UL HTTP E-mail MMS SMS Streaming Telephony Video telephony
NT11-5751, 1.0, 3/31/2011

49

[Classification]

GSM RAN tuning report WCDMA RAN tuning report Report template builder Report template export Report template import

X X

X X X X X

6.8
Function

License Options
Replay X X X Standard X X Professional X X X X X X X X X

Local license Floating license HW dongle licensing Technology option Automatic data processing option Google Map option Bing Map option Report and Script Builder option Third-party logfile option

6.9
Function

Features
Replay X X Standard X X X X Professional X X X X X X X X X X X X X X X X X X X X X X X
NT11-5751, 1.0,3/31/2011

Single logfile analysis Multi logfile analysis TEMS cell file support (.cel, .xml) Cell configuration multi-version support Import and export of network configuration data with flexible parameter mapping Cell file export to TEMS XML format Export of single metric to MapInfo mif/mid, delimited text files Export of single metric to Google kml/kmz Export of multiple metrics to MapInfo mif/mid, delimited text files, Excel files Export of image files, PDF files, GeoTiff files Map view Histogram view Message summary and detailed view Message flow diagram Time-series XY chart Point details view Table view Instant chart view Metric correlation view Delta metrics Sector statistics view Problem summary view Troubleshooting workflow

X X X X X X X X X X X X X X X

50

[Classification]

Advanced Script Builder Powerful report template builder Summary PDF view Batch printing of multiple metrics Custom data import by plug-in API Interactive neighbor list editing Neighbor list work order export Versatile data binning Automatic data processing Highly automatic batch printing Data organization and management Extensive data sharing across organization Powerful data filtering Google Map Bing Map

X X X X X X X X X X X X X X X

NT11-5751, 1.0, 3/31/2011

51