Rubedo Case Study 2014-04-22 NSN (perziurai)
Transcript of Rubedo Case Study 2014-04-22 NSN (perziurai)
NSN case study
Nokia Solutions and Networks
cFRAME
At NSN, multiple wireless communication product testing teams must verify theirsystems-under-test against a selected set of KPIs in the shortest time possible andwithout inhibiting each other with resource locks while ensuring low test-retest variability.
For this, they need a tool capable of managing complete lab equipped with remoteRF channel emulation devices (faders, attenuators, RF analyzers), core and supportingnetwork elements, data simulation (IPERF), tra�c analysis (SmartBits), radio accessnodes (NB, BTS, RNC), and user endpoints. Test output needs to be preserved inthe form suitable for external processing. The complete solution must be lightweightin terms of integration costs while keeping total cost of ownership down.
End-to-end network testing automation solution specifically designed with GSM, GPRS,CDMA, UMTS, WiFi, WiMax, and LTE networks in mind, which simplifies test bench controland automates test case execution.
After deploying cFRAME, engineers can organize remote test objects into arbitrarycollaborating groups responsible for unattended automatic execution of user-defined testscenarios under supervision of the master agent. Generated test output is automaticallycollected, normalized, and uploaded to a predefined place where it can be picked up bya preferred analysis tool.
CLIENT
PRODUCT
CHALLENGE
RESULT
DL_UDP_TEST1DL_TCP_TEST2
DL_UDP_TEST3DL_TCP_TEST4
UL_UDP_TEST3UL_TCP_TEST4
Throughput Testing Automation Example
Throughput testing is intrinsically labor-intensive, hence perfect candidate for automation. In the above example4 tests were used to automatically emulate full spectrum of channel conditions for data download/upload overTCP and UDP and produced 6 performance measurements indicative of maximum sustained and peak measuredthroughput.
504
12
12 34 24
15
Throughput
AttachHARQLatency
SensitivityUL Power
RPT Test Cases• automated cases• non automated cases
Total: 601Automated: 83%
Mbit/s70
52.5
35
17.5
020 30 40 50 100 150 dB
NSN case study
Conventional approachA typical E2E test bed consists of multiplenetwork and supporting elements whichare individually controlled.
cFRAME approachcFRAME acts as the universal remote controlfor most RF channel emulation devices, tra�canalysis tools, etc.
Conventional approachTest planning and controlled executionrequires considerable shared resources.
cFRAME approachcFRAME allows defining ad-hoc subnetswith required network nodes & resourcesand running custom test scripts.
Conventional approachSignificant e�ort required to collect andorganize test output data generated by di�erent tools.
cFRAME approachcFRAME can collect, organize, and uploadtest output data to the specified FTP addressfor subsequent o�ine analysis.
Test Planning and Automated Execution
Test Output Management
E2E Test Bed Control
Ease of Use• No more terminal windows overhead• No more manual input to remote user applications• No more manual scheduling of user applications• No server administration to join new nodes
to the map
• Low test-retest variability (repeatablemeasurements)
• Reduced HW/SW tools cost due to better reuse• Reduced labor cost due to less running time
Key benefits
Quality and Cycle-time
Contact UsRUBEDO SISTEMOSJovarų g. 2, 47193 Kaunas, Lithuania / +370 686 34807 / [email protected] / www.rubedos.comLINAS VAITULEVICIUS / Sales Representative+370 37 220 280 / [email protected]
TESTIMONIAL
NSN case study
“cFRAME took our LTE E2E throughput testing automation to a newlevel. We breezed through building a communication map of cFRAMEagents which allowed multiple users to monitor lab equipment poolstatus in real-time time, making dedicated test bench reservationintuitive and overlap free. Great feature!
Another cool feature – the Toolbox – allowed us to develop test scriptsindependently from specific test bench configuration, ending up withhuge time and resource savings. We called it ‘100% test scripttransparency!’
Choice of C# as a scripting language is well-thought, too, because itpromotes reuse of existing 3rd party software tools. As a result, over80% of RF performance TPUT test cases were automated in about3 months’ time.
We are looking forward to cFRAME extensions towards supportof passive agents, hands-free updates, and auto-generation of testscripts. Rubedo Sistemos provides us with the dedicated customersupport and is willing to tailor new cFRAME features in line with ourpriorities and time lines.”
Thank You!
KĘSTUTIS JASINEVIČIUSLead Engineer, RF Performance & AutomationNokia Solutions and Networks / MBB SC
x