2016 2nd International Conference on Frontiers of Signal Processing

Quality of Experience Estimation for VoLTE Services

Alessandro Vizzarri
Dept. of Enterprise Engineering, University of Rome Tor Vergata, Rome, Italy
Radiolabs Research Consortium, Rome, Italy
e-mail: alessandro.vizzarri@uniroma2.it

Abstract-4G wireless standard, Long Term Evolution (LTE), Several innovative features also characterize LTE system.
promises to guarantee delivering of band-consuming Architecture is more flexible and interoperable. It is
applications. In this context data-based services as web composed by radio access interface called Evolved UTRAN
browsing with equipped video and video streaming are the
(E-UTRAN) and a Core Network called Evolved Packet
most requested services by end user. In order to be able to use
Core (EPC).
all LTE innovative features, Mobile Network Operators (MNO)
Due to LTE innovative features, Mobile Network
need to also guarantee both an opportune Quality of Service
(QoS) both an acceptable Quality of Experience (QoE)
Operators (MNOs) are currently deploying LTE networks
perceived by end user. End-to-end approach for QoS is with a strong focus not only from a coverage side but also
strongly recommended not only for data-based services but from a capacity side. This is achieved by efficient
also for delay sensitive services as Voice over LTE (VoLTE). mechanisms for guaranteeing acceptable QoS perceived by
This work presents a method for QoE estimation of a VoLTE end user. These mechanisms are essentially based on two key
service in realistic situations basing on QoS informations. points: one from a network point of view and the other from
Multiuser and multiservice scenarios are modeled with VoLTE a user point of view. The flrst key point is constituted by an
application delivered in conjunction with HTTP web browsing
end-to-end approach to Quality of Service (QoS). MNOs
application. An IP c10ud is used for modeling network
analyze and monitor continuously the main network
impairments in terms of additive delay and IP packet loss.
parameters (Key Performance [ndicators, KPI) at network
Simulations are performed using OPNET modeler 17.5. A final
comparison of simulation results is provided in order to
level. The second key point is from a user point of view.
identity the best mathematical models for QoE estimation for Based on monitored network KP[s, MNOs try to estimate
VoLTE application. Quality of Experience (QoE) perceived by end user at
application level. Link between the two key points is
Keywords-long term evolution; LTE; VoIP; VoLTE; end-to constituted by a QoS/QoE bottom-up approach. It is based on
end QoS; QoE; LTE network performance; LTE KPIs; OPNET; the identification of mathematical models able to map the
IP cloud
QoS features at network layer with QoE features at
application layer. QoS guaranteeing is strongly
I. INTRODUCTION recommended not only for data-based services but also for
Telecommunication technologies are characterized by an delay sensitive services as Voice over LTE (VoLTE). This
impressive growth rate in the last years. Number of work presents a method for QoE estimation of a VoLTE
worldwide mobile subscriptions was 7,100 in 2014 and 7,400 service in realistic situations. Multiuser and multiservice
in 2015. [t is expected to be around 9, I00 by 2021. [I] [n scenarios are modeled and simulated using OPNET modeler
particular LTE mobile subscriptions passed from 500 million 17.5 simulation software tool. Analysis and discussion of
(2014) to 1,000 million (2015) and it is expected to reach obtained QoS/QoE mapping functions are presented together
4,100 million by 2021 with a 25% CAGR. From a traffk with a flnal comparison of them.
point of view, total monthly mobile data traffic was 3.2
EB/month in 2014, it reached 5.3 EB/month in 2015 and it is 11. QoS/QoE MAPPING FUNCTIONS
expected to be around 51 EB/month by 2021, with a 45% Bottom-up approach to QoS/QoE mapping is widely
CAGR. From a traffic point of view, band-consuming treated in scientiflc literature. Several mathematic models are
applications as web browsing with equipped video and video proposed for QoS/QoE mapping [3]. [n particular QoS is
streaming are the most requested services for end user.
related to QoE as source of disturb. QoS and QoE are mainly
Long Term Evolution (LTE) technology for 4G wireless
separated by different layers interacting in three zone, as
systems promises to satisty this massive request for
shown in Fig. 1:
bandwidth and throughput. LTE is the flrst 3GPP cellular
zone 1: no distortion, user satisfled
standard full [P-based. It is able to offer to end users a
zone 2: user feels disturbance
download data rate up to 100 Mbps and an upload data rate
zone 3: user gives up
up to 50 Mbps [2].

978-1-5090-3815-2/16/$31.00 20161EEE 131

 Management Entity (MME), Policy and Charging Rules
Function (PCRF). IMS Core Network nodes are: Horne
Subscriber Server (HSS), Interrogating Call Session Control
Function (I-CSCF), Serving Call Session Control Function
(S-CSCF), Media Gateway Control Function (MGCF), IMS
Media Gateway (lMS-MGW), Media Resource Function
(MRF), Telephony Application Server (TAS), Border
Gateway Control Function (BGCF).

Figure l. The mapping curve between QoE and QoS.

After the description of MOS as indicator of QoE and

network KPIs (delay, jitter and packet loss rate) as indicators
of QoS, authors present different types of mapping functions
able to correlate QoE to QoS. In [4] fuzzy-logic approach is
proposed for QoS/QoE mapping. In [5] a bottom-up
Figure 2. Logical architecture for VoLTE service.
approach is presented for IPTV application. QoS/QoE
mapping is carried out correlating Mean Opinion Score After successfully completing both LTE network attach
(MOS) as QoE parameter to network KPI as QoS parameter. procedure both dedicated EPS bearer establishment
In particular, Delay, Jitter and Packet Loss Rate (PLR) are procedure, end user can send a service request for a VoLTE
considered as KPIs. This work is mainly focused on three service according to QoS Channel Identifier (QCI)
QoS/QoE mapping models: logarithmic, exponential and requirements reserved for VoLTE service (QCI equal to I).
polynomial functions. A comparison of them will is Since it is an IP-based service, VoLTE is delivered in
described in order to identity the best fitting curve of the best effort modality. This implies VoLTE service needs for
simulation results [6] [7]. Analyzed mathematical models are an effective service management in order to guarantee both
centered on following formulas: an acceptable end-to-end QoS at network layer both
Logarithmic function (Weber-Fechner Law) acceptable QoE perceived by VoLTE end users.

(1) All major standardization entities already treated the QoS

QoE = a*ln (*QoS)+y
issue in LTE through an end-to-end approach. In [5] ETSI
Exponential function (lQX Hypothesis) provides end-to-end QoS reference architecture for LTE and
(*QaS) a description of relative management functions. If these
QoE=a*e +y (2)
standard requirements are mandatory to be implemented,
Polynomial function QoS policies and strategies focused on how manage all
users' traffic flows are left to MNOs.
QoE=a*QoS+y (3)
IV. QOE ESTIMATION FOR VOLTE ApPLICATION

111. QOS IN VOLTE ApPLICATION Mean Opinion Score (MOS) usually represent QoE of a

Since LTE is fully IP-based wireless standard, it only voice application. It indicates a level of service acceptance

enables entire wireless transmission over Packet Switching by the end user. MOS is a scalar term. Its values are limited

(PS) paths using Internet Protocol (IP) protocol as network in the range from 1 (worst case) to 5 (best case) [13]. Table I

protocol. All applications delivered over LTE systems are show the relationship between MOS values and Quality of

IP-based, included voice applications as Voice Over LTE speech perceived by end user.

(VoLTE) [8], [9]. In case of VoLTE application (Fig. 2), the

TALE I. MOS VALUES
LTE system integrates IP Multimedia Sub System (IMS) [10]
[11]. It means Session Initiation Protocol (SIP) is used as MOS Quality Jmpairment
VoLTE Signaling Protocol [12]. LTE logical architecture 5 Excellent Imperceptible
supporting VoLTE service is shown in Fig. 2. It is composed
by four main sections: VoLTE User Equipment (UE), 4 Good Perceptible but not annoying

Evolved Universal Terrestrial Radio Access Network (E 3 Fair Slightly annoying

UTRAN), Evolved Packet Core (EPC) and IMS Core
2 Poar Annoying
Network. UE is user's terminal, while E-UTRAN section
includes eNodeB. EPC includes Serving Gateway (S-GW), 1 Bad Very annoying
Packet Data Network Gateway (PDN-GW), Mobility

132
 MOS parameter is strictly related to R factor provided by performing an HTTP web browsing session. Traffic tlow is
ITU E-Model [14]. E-Model combines a number of different mixed: VoLTE and HTTP web browsing services are
impairments to be considered for an overall quality measure. performed by UEs. Scenarios trom n.25 to n.36 (Fig. 3c) are
QoS assessment of a VoLTE service can be characterized similar to scenario n. 1: UE_1 is performing a VoLTE call to
by three parameters called Key Performance [ndicators UE_2, but link among them is affected by insertion of [P
(KPIs): end-to-end Delay, Packet Loss and Jitter. Table 11 cloud. It addicts both 1% packet discard ratio both 0.1
shows main quality parameter measures for a generic Vo[P seconds delay between caller (UE_I) and callee (UE_2).
application [15]. Scenarios from n.37 to nA8 (Fig. 3d) is sirnilar to scenario n.
2: UE_[ and UE_2 are performing a VoLTE call using a
TABLE 11. VolP QUALTTY PARAMETER MEASURES direct link interrupted by IP cloud, UE_3 is performing
Network Parameter Good Acceptable Poor HTTP web session. Simulation area is a typical campus area
End-ta-end Delay [ms] 0-150 150-300 > 300 (100 Km2).
Jitter [ms] 0-20 20-50 > 50

Packet Lass [%] 0 - 0.5 0.5 - 1.5 > 1.5

Throughput[Mbps] 0-50 50 - 144 > 144

Delay is represented as the amount of time it takes a

packet sent by source (caller) to reach destination (callee).
An excessive value of delay can make an audio conversation
very difficult to perform. [t can happen that both caller both
callee start to talk at the same moment or interrupt each other.
A second issue caused by a higher value of delay is
constituted by the generation of Packet Loss. If an IP voice
packet is not able to go trom the caller to the callee (and
(a)
viceversa), it will be dropped. Jitter is the variation in the
time between packets arriving, caused by network congestion
or route changes [16], [17]. Negative effects of Delay and
Jitter are voice echoes, while high value of PLR can produce
overlapping of words with a strong negative impact on voice
intelligibility.

V. SIMULATION

Main purpose of this work is to identity mathematical

models for QoS/QoE mapping in different VoLTE realistic (b)
scenarios [18]. In order to identity the best mathematical
model for QoS/QOE mapping curve fitting techniques are
implemented. Realistic scenarios are simulated on the basis
of network impairments as disturb to VoLTE QoS/QoE.
[mpairments are represented by:
Mixed traffic: VoLTE application is delivered over
LTE network together with HTTP web browsing
application
Insertion of [P cloud: additive delay and [P packet
discard ratio are produced across entire end-to-end
(c)
transmission chain.
This situation is typical when a backbone network section
is involved in service delivering. All scenarios are simulated
using LTE network model provided by OPNET 17.5 PL6.

A. Scenarios
Number of simulated scenarios is 48. Each of them is
modeled by a different LTE network topology (with or
without IP cloud) and traffic flows (single or mixed), as
shown in Fig. 3. Scenarios trom n.1 to n.12 (Fig. 3a) are
characterized by two UEs: UE_l (caller) is performing a (d)
VoLTE call to UE_2 (callee) using a direct link. Traffic tlow
Figure 3. LTE netwark tapalagy simulated far VoLTE applicatian. One
is single. Scenarios from n.13 to n.24 (Fig. 3b) are UE far VoLTE withaut IP claud (a), twa UEs far VoLTE and HTTP
characterized by three UEs and one HTTP web server: UE_[ browsing withaut IP claud (b), One UE for VaLTE with IP claud (c), twa
and UE 2 are performing a VoLTE call while UE 3 is UEs far VoLTE and HTTP brawsing with IP claud (d).

133
 Table 111 resumes the mam characteristics for each VI. ANALYS IS OF RESULTS
simulated scenario.
Simulated values are compared and fitted by formulas (l ),

TALE II!. SCENARIO CONFIGURATION (2) and (3) presented in Section 11. Table V shows function
coefficients for each mathematic model: polynomial,
Impairments exponential and logarithmic. Each function is used for
SI eNB due to IP Cloud
LTE correlating MOS with one KPI.
Scenario Link Bandwidt Packet
Service Packet
No. Capacity h Discard
Type Latency TALE V. CURVE FITTING MODELS
{%! {MHz! Ratio
[sec}
[%1 Fit POLY EXP LOG
100; 75; Not Not
1-12 VoLTE 5; 10; 20 model a P l' a P l' a P l'
50;30 present present
VoLTE + 100; 75; Not Not MOS
13-24 5; 10; 20 vs
IP cloud 50;30 present present
end-to- -13.2 - 5.0 7.2 3.5 -1.2 -2.3 1 -1.5
VoLTE +
100; 75; end
25-36 HTTP 5; 10; 20 1 0.1
50;30 Delay
Browsing
VoLTE + MOS
HTTP 100; 75; vs -12.2 - 4.7 10.2 1.6 -5.3 -1.8 I -0.7
37-48 5; 10; 20 1 0.1 litter
rowsing 50;30
+ IP Cloud MOS
vs -8.3 - 3.3 9.4 I -6.1 -0.5 I I
B. Simulation Settings PLR
In particular, UE's antenna gain is -I dBi with a receiver
sensitivity of -200dBm. eNodeB uses l OMHz LTE Main statistical indicators are detailed in Table VI. In
bandwidths and FDD Duplex Mode. Link type among LTE particular: Sum of Squares due to Error (SSE), coefficient of
network nodes is PPP D3, with a data rate of 44.736Mbps. determination (R-square), Adjusted Coefficient of
VoLTE application is characterized by GSM EFR Voice Determination (Adjusted R-square) and Root Mean Square
Codec and one voice frame per packet. As requested by Error (RMSE) are calculated.
3GPP LTE standard, the same VoLTE application is carried
TABLEVI. STATlSTlCAL PARAMETERS
out over EPS bearer with QCI I (GBR) and Allocation and
Retention Priority (ARP I ). VoLTE application is launched
Relation Fit Model SSE R-square
Adjusted
RMSE
with a start offset of 20 seconds till the end of simulation R-square

period. HTTP application is the second application POLY 2.1680 0.9330 0.9316 0.2171
MOS
considered for modeling a multiuser and multiservice vs E XP 2.1128 0.9347 0.9333 0.2143
scenario [scenarios trom n.25 to n.48]. Through the HTTP e2e Delay
LOG 2.0086 0.9379 0.9352 0.2113
application, UE_2 can download I KB web page, n. 5
POLY 1.9953 0.9384 0.9370 0.2083
medium images with dimension up to 2KB and two short MOS
videos with dimension up to 350 KB. HTTP application is vs E XP 1.9250 0.9405 0.9379 0.2068
litter
launched with a start offset of 40 seconds. Since modeled LOG 3.1988 0.9012 0.8990 0.2637
profiles add a start offset around 40 seconds, VoLTE and
POLY 5.5553 0.8284 0.8246 0.3475
HTTP applications start after 80 seconds from simulation MOS
initiation. Simulation period is equal to 3 minutes for all vs E XP 3.1962 0.9012 0.8969 0.2665
PLR
scenanos. LOG 3.0900 0.9045 0.9025 0.2592

C. Results
Fig. 4 gives a graphical representation of results. Both
Network KPIs as QoS parameters are: end-to-end Delay, simulated points provided by simulation both fitting curves
Jitter and Packet Loss Rate (PLR). QoE parameter is MOS. are plotted in the same figure and compared. Fitting curves
Table IV shows simulation results both for each QoS KPI are polynomial, exponential and logarithmic. Fig. 4a regards
calculated both for correspondent MOS. mapping between MOS and end-to-end Delay, Fig. 4b MOS
and Jitter. Fig. 4c shows mapping between MOS and Packet
TALE IV. SIMULATlON RESUL TS
Loss Rate (PLR).
Service performance results In the first correlation (MOS and end-to-end Delay),
Scenario logarithmic function is the best fitting curve, with the highest
e2eDelay Isl Jitter /si PLR MOS flI-f5J
No. Adjusted R-square (0.9352) and RMSE (0.2113). In the
1-12 0.11-0.12 0.06-0.11 0.005 -0.002 3.7 - 3.46 second correlation (MOS and Jitter), exponential function is
13-24 0.13 0.09-0.13 0.012 -0.014 3.5 -2.9 the best fitting curve, with the highest Adjusted R-square
(0.9379) and RMSE (0.2068). In the last correlation (MOS
25-36 0.19 -0.21 0.15- 0.19 0.074 -0.089 2.5 - 2.26
and PLR), logarithmic function is the best fitting curve, with
37-48 0.26 -0.27 0.21-0.27 0.216 -0.261 1.7 -1.45 the highest Adjusted R-square (0.9025) and RMSE (0.2592).

134
 square and RMSE. In the second case polynomial and
exponential functions have the same fitting properties but not
weil as those of logarithmic curve. In the second case
logarithmic curve is the best fitting curve. In the last case
exponential and logarithmic models are quite similar but
logarithmic function results the best fitting curve. These
results evidence a nonlinear behavior of MOS (as QoE
parameter) varying with network KPIs (as QoS parameters),
especially in case of realistic scenarios.
In this paper, mathematical models for QoS/QoE
(a) mapping have been identified for a VoLTE application in
realistic scenarios. Nonlinear models are more suitable in
order to analyze VoLTE QoE perceived by end user in
realistic scenarios. Future works are going to perform a
cluster analysis and a deep investigation of network
improvements across entire LTE transmission chain.
Efficient techniques able to enhance QoS management (e.g.
queue management, user priority) and then QoE perceived
by end user will be investigated and analyzed.

ACKNOWLEDGMENT

The author would like to give an extended

(b)
acknowledgement to OPNET Riverbed Team for allowing
the use of OPNET Modeler software for educational and
research activities at University of Rome Tor Vergata.

REFERENCES

[I] "Ericsson Mobility Report", Ericsson Ud, 2015.

(c)
Figure 4. Fitting curves for performed simulations. MOS vs end-to-end
Delay (a), MOS vs Jitter (b), MOS vs Packet Loss Rate (c).
VII. CONCLUSION
VoLTE is a crucial service for LTE networks. It is the
basic voice application fully managed by MNOs. For this
reason, MNOs are forced to guarantee acceptable levels of
QoS and QoE perceived by end user. In case of a voice
application, delay of information exchanged by end users has
a strong impact on QoE. This negative effect increases for
IP-based service as Voice over (VoIP) services or VoLTE
due to their best effort transmission modality.
In order to able to evaluate the VoLTE QoE perceived by
end user, MNOs can measure QoS infonnations at network
layer (KPIs) and then to evaluate QoE perceived by end user
(at application level) through mathematical model
QoS/QoE mapping. Scientific literature introduced linear,
exponential and logarithmic function for correlating them.
In case of VoLTE a better behavior of logarithmic
function is evidenced when MOS is correlated with end-to
end Delay. In case of MOS correlated with Jitter and PLR
exponential function is the best fitting curve. In the first case,
three mapping models are quite similar but logarithmic
function fits best the obtained data in terms of Adjusted R-
[2] 3GPP, Release 8 VO.O.3, "Overview of 3GPP Release 8: Summary of
all Release 8 Fea-tures," November 2008.
[3] M. Alreshoodi, J. Woods, "Survey on QoE/QoS correlation models
for multimedia services", International Journal of Distributed and
Parallel Systems (IJDPS) Vol. 4, No. 3, May 2013.
[4] M. Alreshoodi, J. Woods, "An empirical study based on a Fuzzy
Logic System to Assess the QoS/QoE Corelation for Layered Video
Streaming", Proc. 2013 IEEE International Conference on
Computational Intelligence and Virtual Environments for
Measurement Systems and Applications (CIVEMSA), 15-17 July
2013, Milan, Italy.
[5] T.H Truong, Tai-Hung Nguyen, Huu-Thanh Nguyen, "On
relationship between Quality od Experience and Quality of Service
metrics for IMS-based IPTV networks", Proc. 2012 IEEE RIVF
International Conference on Computing and Communication
Technologies, Research, Innovation, and Vision for the Future
(RIVF), Feb. 27 2012-March I 2012, Ho Chi Minh City, Vietnam.
[6] S. Khorsandroo, R. Md Noor, S. Khorsandroo "Stimulus-Centric
versus Perception-Centric Relations in Quality of Experience
Assessment", Proc. Wireless Telecommunications Symposium
(WTS), pag. 1-6, 18-20 April 2012, London, UK.
[7] M. Fiedler, T. Hossfeld, P. Tran-Gia "A Generic Quantitative
Relationship between Quality of Experience and Quality of Service",
IEEE Network , Volume: 24,lssue: 2, pp. 36-41, March-April 2010.
[8] 3GPP TS 23.002 "3rd Generation Partnership Project; Technical
for
Specification Group Services and Systems Aspects; Network
architecture".
[9] S. Forconi, A. Vizzarri "Review of Studies on End-to-End QoS in
LTE Networks", Proc. AEIT Congress 2013, Mondello, Italy.
[10] 3GPP TS 29.228 "Digital cellular telecommunications system (Phase
2+); Universal Mobile Telecommunications System (UMTS); LTE;
IP Multimedia (IM) Subsystem Cx and Dx Interfaces; Signalling
flows and message contents".
[11] 3GPP TS 32.260 "3rd Generation Partnership Project; Technical
Specification Group Services and System Aspects;

135
 Telecommunication management; Charging management; IP [15] J. Yu and I. AI-Ajarrneh, "Call admission control and traffic
Multimedia Subsystem (IMS) charging". engineering of VoIP", Proc. The Second International Conference on
[12] IETF RFC 4028, "Session Timers in the Session Initiation Protocol Digital Telecommunications (ICDT 2007) in San Jose, Califomia,
(SIP)". USA, July 2007. pp. 11-16.

[13] A. Vizzarri, "Analysis of VoLTE end-to-end quality of service using
OPNET", Proc. EMS 2014, pag. 452 - 457, 21-23 Oct. 2014, Pisa,
Italy.
[14] ITU Recommendation G.109 "Definition of categories of speech
transmission quality".
[16] IETF RFC 5481, "Packet Delay Variation Applicability Statement "
[17] IETF RFC 3550, "RTP: A Transport Protocol for Real-Time
Applications".
[18] A. Vizzarri, "Analysis of VolP Over LTE End-To-End Performances
in Congested Scenarios", Proc. AIMS2014, pag. 393-343, 18-20 Nov.
2014, Madrid, Spain.

136