Nomad - avdm.at€¦ · SPIRENT Nomad | User Experience Analytics System for Voice Services AERIAS...
4
www.spirent.com Nomad User Experience Analytics System for Voice Services VoLTE Speech Delay in US Operator Live Network (ms) Accelerating VoLTE Readiness: Getting to the Root of Issues Is Your VoLTE Service the Best? HD, OTT and VoLTE technologies are breathing new life into the traditional voice services market. For VoLTE to succeed, it’s got to deliver voice services that are perceived by customers to be as good as or better than legacy and OTT voice service alternatives. There’s only one way to know if VoLTE is ready to launch: measure the user experience and compare it to competitive options. LTE Quality of Service: Ready or Not? Years after the first LTE networks launched, VoLTE voice services are finally rolling out. That means LTE’s quality of service (QoS) features, which manage the priority of VoLTE packets, are about to receive their first wide-scale commercial test. How well QoS works in the real-world will directly impact how the user experience of VoLTE compares to alternative services. Where Do Problems Come From End-to-End? Excessive packet delay and loss can occur anywhere in the end-to-end service delivery path, from the IMS core to the device. That makes it more difficult than ever to isolate QoS issues that impact user experience. For example, excessive packet delay may relate to IMS configuration issues, dynamic jitter buffer performance, eNB resource scheduling or many other factors. Improving VoLTE By Answering “Why?” With legacy voice services, the industry needed answers to questions like: “does my device or service have the best speech quality?” and “which smartphone drops the fewest calls?” With the transition to VoLTE, the industry also needs answers to new questions like: “why was the speech quality poor?” and “what were the root causes?” With its new IP Analytics module, Nomad HD delivers the analytics needed to answer all the above questions and more - helping to identify user experience issues, isolate root causes and improve VoLTE services. Highlights • Understand the launch readiness of new VoLTE services, devices and network infrastructure • Compare the user experience of VoLTE, HD, Over-the-Top and 2G/3G voice services • Measure with any mobile device in the lab or live network • Accelerate root cause analysis of IP-related issues that impact speech quality, audio delay and call performance • Pre-test devices to accelerate Spirent Fit4Launch submissions and carrier acceptance Are Your VoLTE Services Ready? User Experience Analytics by Spirent Figure 1: VoLTE Launch Readiness Analytics: Delay > 200ms degrades the user experience. User Experience Analytics by Spirent Nomad is part of a suite of systems that provide an unmatched range of user experience analytics including: Speech Call Web Browsing File Transfer Video Battery Life
Transcript of Nomad - avdm.at€¦ · SPIRENT Nomad | User Experience Analytics System for Voice Services AERIAS...
www.spirent.com
NomadUser Experience Analytics Systemfor Voice Services
VoLTE Speech Delay in US Operator Live Network (ms)
Accelerating VoLTE Readiness: Getting to the Root of Issues
Is Your VoLTE Service the Best? HD, OTT and VoLTE technologies are breathing new life into the traditional voice services market. For VoLTE to succeed, it’s got to deliver voice services that are perceived by customers to be as good as or better than legacy and OTT voice service alternatives. There’s only one way to know if VoLTE is ready to launch: measure the user experience and compare it to competitive options.
LTE Quality of Service: Ready or Not? Years after the first LTE networks launched, VoLTE voice services are finally rolling out. That means LTE’s quality of service (QoS) features, which manage the priority of VoLTE packets, are about to receive their first wide-scale commercial test. How well QoS works in the real-world will directly impact how the user experience of VoLTE compares to alternative services.
Where Do Problems Come From End-to-End? Excessive packet delay and loss can occur anywhere in the end-to-end service delivery path, from the IMS core to the device. That makes it more difficult than ever to isolate QoS issues that impact user experience. For example, excessive packet delay may relate to IMS configuration issues, dynamic jitter buffer performance, eNB resource scheduling or many other factors.
Improving VoLTE By Answering “Why?” With legacy voice services, the industry needed answers to questions like: “does my device or service have the best speech quality?” and “which smartphone drops the fewest calls?” With the transition to VoLTE, the industry also needs answers to new questions like: “why was the speech quality poor?” and “what were the root causes?” With its new IP Analytics module, Nomad HD delivers the analytics needed to answer all the above questions and more - helping to identify user experience issues, isolate root causes and improve VoLTE services.
Highlights
• Understand the launch readiness of new VoLTE services, devices and network infrastructure
• Compare the user experience of VoLTE, HD, Over-the-Top and 2G/3G voice services
• Measure with any mobile device in the lab or live network
• Accelerate root cause analysis of IP-related issues that impact speech quality, audio delay and call performance
• Pre-test devices to accelerate Spirent Fit4Launch submissions and carrier acceptance
Are Your VoLTE Services Ready?
User Experience Analytics by Spirent
Figure 1: VoLTE Launch Readiness Analytics: Delay > 200ms degrades the user experience.
User Experience Analytics by Spirent
Nomad is part of a suite of systems that provide an unmatched range of user experience analytics including:
Speech
Call
Web Browsing
File Transfer
Video
Battery Life
SPIRENT Nomad | User Experience Analytics System for Voice Services
2 | www.spirent.com
Nomad: User Experience Analytics for VoLTE, HD, 3G and more
Consistent Metrics on Any Mobile Device. Nomad measures the user experience of voice services with a consistent approach across any mobile device platform. That enables true apples-to-apples comparisons of voice services across device models, network element releases and service types (i.e. VoLTE, HD, 3G, OTT and more). Nomad enables comparative ranking across device makers and network providers and provides quantitative data to help guide performance improvement programs.
Measure VoLTE Three Ways. Nomad measures VoLTE user experience using three approaches: mobile-to-mobile, mobile-to-VoLTE server and mobile-to-cloud server. The mobile-to-mobile approach is quick and easy to setup; however, isolating issues to a particular up or downlink is not possible. The mobile-to-VoLTE server approach is more complex to setup but provides full visibility of up and downlink performance. Both approach 1 and 2 provide full support for HD codecs. Approach 3 is also easy to setup, but only enables testing of VoLTE calls to a PSTN-connected cloud server. This approach doesn’t allow HD codec testing as the PSTN only supports µ-law narrowband content.
High Resolution VoLTE Audio Delay. Nomad measures ear-to-mouth audio delay with millisecond-level accuracy. Quickly assess if delay levels exceed the ITU recommendation of 200 ms – the point at which audio delay begins to degrade the user experience for conversational speech.
Support for HD Speech. Nomad fully supports HD speech quality analysis with up to 20 kHz audio bandwidth and support for the wideband-ready POLQA perceptual speech quality algorithm. Test any HD service, including OTT services, by performing mobile-to-mobile calls. See the preceding section for additional options for testing HD VoLTE services.
Cloud-Based Test Infrastructure. Cloud-based servers for testing narrowband voice services are available in many countries in North America, EMEA and Asia-Pacific including the US, China, Japan, Germany, UK, Taiwan and more. The servers connect to the mobile core network via the PSTN.
Troubleshoot Issues with IP Analytics. After tests are completed, user experience metrics may be synchronized with IP logs collected on the mobile device and/or HD voice server. Users may then access detailed charts and reports for the combined logs including the following analyses: MOS and RTP jitter, MOS and RTP packet delay, MOS and RTP throughput and lost RTP packets.
Measure in the Lab or Live Network. Nomad may be deployed for both lab and live network testing. Furthermore, Nomad is integrated to Spirent’s CS8 Network Emulator for combined network emulation and user experience evaluation in the lab. For more information on CS8, please go to www.spirent.com.
Figure 2: Nomad enables direct comparisons of speech quality for HD Voice and legacy services.
Figure 3: Nomad enables user experience comparisons across voice service providers.
Mobile Downlink Voice Quality
SPIRENT
www.spirent.com | 3
Nomad | User Experience Analytics System for Voice Services
Nomad System Architecture
Nomad Desktop Agent. The desktop agent consists of a portable device controller hardware unit, PC-based agent software and the IP analytics module. The device controller hardware unit interfaces with up to four mobile devices simultaneously using audio jacks and/or Bluetooth. The PC-based agent software manages the device controller to measure MOS, audio delay, call setup time, initiation, retention and more. The desktop agent supports both mobile-to-mobile calls and mobile-to-server calls. The desktop agent automatically downloads uplink speech quality results from Nomad Voice Server. In addition, the desktop agent merges user experience metrics with IP logs connected at the server or device and creates IP analytics based on the combined logs.
Nomad Voice Server. The Nomad voice server enables isolated uplink and downlink testing of call performance and speech quality for narrowband codecs. The server is hosted by Spirent in the Nomad Cloud and interfaces to the mobile network via the PSTN. Nomad voice servers connect to the PSTN via an E1 or T1 digital primary rate interface. Nomad voice server will support narrowband voice calls from VoLTE, 2G/3G or OTT services (note: the PSTN does not support wideband codecs).
Nomad VoLTE Server. The Nomad VoLTE server enables isolated uplink and downlink testing of call performance and speech quality for VoLTE services. The VoLTE server connects to the operator’s IMS core using SIP and supports the WB AMR (g.722.2) codec.
SPIRENT Nomad | User Experience Analytics System for Voice Services
AMERICAS 1-800-SPIRENT | +1-818-676-2683 | [email protected]
EUROPE AND THE MIDDLE EAST +44 (0) 1293 767979 | [email protected]
ASIA AND THE PACIFIC +86-10-8518-2539 | [email protected]
© 2014 Spirent Communications, Inc. All of the company names and/or brand names and/or product names and/or logos referred to in
this document, in particular the name “Spirent” and its logo device, are either registered trademarks or trademarks pending registration
in accordance with relevant national laws. All rights reserved. Specifications subject to change without notice. Rev. A 02/14
Screenshots and Example Outputs
The correlation of RTP packet statistics and user experience data provides key insight to accelerate the identification of the root causes of poor experience. Following are two examples of Nomad’s IP Analytics capabilities.
Figure 4: Excessive packet delays of 60 ms or more may lead to jitter buffer overflows, packet loss and degraded speech quality.
Figure 5: Determine when speech quality degradations relate to excessive RTP packet delay.
Distribution of RTP Relative Delay
RTP Relative Delay
Duration (ms)
Time (s)
Coun
tD
elay
(ms) M
OS
