Quality of experience measurementsTechnologies and who knows what

Jörgen GustafssonEricsson Research

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 2

Are the horizontal lines parallel?

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 3

Yes they are!

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 4

How much darker is square A than square B?

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 5

….

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 6

….

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 7

….

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 8

Not at all!

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 9

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 10

Subjective test

x 24

Mean Opinion Score

x 250

›

5 excellent4 good3 fair2 poor1 bad

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 11

Capturing perception

Codec: signaling

Non-linear dependency between perceived quality and IP and application

layer measurements

QoE models:

MOS = f(x, y, z, …)

Combining in a non-linear way

Audiovisual quality (MOS)

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 12

Parametric model P.1201Parameterextraction

video

audio

Audio-visual

V-mos

a-mos

a/v-mos

c1

c2

c3

…

Buffering

IP headers

Stream info

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 13

› ITU-T Study Group 9 and 12

› Recently approved P.1201 and P.1202 recommendations for UDP based video

› New work items for progressive download (YouTube) and adaptive streaming (DASH)

QoE model Standardization

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 14

Measurement accuracy

Asking the manon the bus

Modeling human perception

Transport layermeasurements

How close to real perception

Accuracy of method

Ideal

Binary: Good or bad

Detailed comparison possible

Medium accuracy QoS

QoE

estim

atio

n

Rea

l Q

oE

Not useful

Action?

Useful

Good

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 15

Serviceprovider

CDN (Content Delivery Network)

End user

ISP (Internet Service Provider)

Media client reports

IP level measurement data

IP and access network data

Quality of Experience!

Ultimate QoE measurement data set

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 16

› Is the quality of media services (in Sweden, today) good enough?

› What QoE measurements are done today and what is missing?› What accuracy of the QoE measurements is desirable?› What are the reasons to share QoE measurement with other actors?

› Who does a user call when there are quality problems?› What are the end-users willing to pay for in terms of quality?

› What new business models can emerge using novel QoE measurement technologies?

Panel discussion

Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 17

› Human perception is utterly complex…

› …but we can handle that with QoE models

› A lot of QoE measurement data is available

› …but no one has access to all the data

› Potential for new business models

Summary