Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks...

18
Sentinel IP Short Message Gateway Benchmarks TAS-046-Issue 2.7.0-Release 1 April 2018

Transcript of Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks...

Page 1: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks

TAS-046-Issue 2.7.0-Release 1

April 2018

Page 2: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

Notices

Copyright © 2017 Metaswitch Networks. All rights reserved.

This manual is issued on a controlled basis to a specific person on the understanding that no part of the Metaswitch Networks product code or

documentation (including this manual) will be copied or distributed without prior agreement in writing from Metaswitch Networks.

Metaswitch Networks reserves the right to, without notice, modify or revise all or part of this document and/or change product features or

specifications and shall not be responsible for any loss, cost, or damage, including consequential damage, caused by reliance on these materials.

Metaswitch and the Metaswitch logo are trademarks of Metaswitch Networks. Other brands and products referenced herein are the trademarks or

registered trademarks of their respective holders.

2

Page 3: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

Contents

1 Sentinel IP Short Message Gateway Benchmarks......................................................................................................... 4

1.1 Topics........................................................................................................................................................................................................... 4

2 Benchmark Scenarios....................................................................................................................................................... 5

2.1 MO Submission............................................................................................................................................................................................ 5

2.2 CS Delivery...................................................................................................................................................................................................7

3 Hardware and Software.....................................................................................................................................................9

3.1 Hardware...................................................................................................................................................................................................... 9

3.2 Software........................................................................................................................................................................................................9

3.3 Configuration.............................................................................................................................................................................................. 10

4 Benchmark Results......................................................................................................................................................... 11

4.1 Benchmarks................................................................................................................................................................................................11

4.2 Detailed metrics.......................................................................................................................................................................................... 12

4.2.1 Call Rate....................................................................................................................................................................................... 12

MO-Submission...........................................................................................................................................................................12

CS-Delivery................................................................................................................................................................................. 13

4.2.2 Rhino CPU usage......................................................................................................................................................................... 14

4.2.3 Rhino Heap usage........................................................................................................................................................................ 15

4.2.4 Rhino Activities............................................................................................................................................................................. 16

4.2.5 Scenario latencies.........................................................................................................................................................................17

MO-Submission...........................................................................................................................................................................17

CS-Delivery................................................................................................................................................................................. 18

3

Page 4: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

1 Sentinel IP Short Message Gateway Benchmarks

This book contains performance benchmarks using the Sentinel IP Short Message Gateway.

1.1 Topics

Benchmark Scenarios Descriptions of each of the benchmark scenarios, and notes on the benchmark methodology

used

Hardware and Software Details of the hardware, software, and configuration used for the benchmarks

Benchmark Results Summaries of the benchmarks and links to detailed metrics.

Other documentation for the Sentinel IP Short Message Gateway can be found on the Sentinel IP Short Message Gateway product page .

4

Page 5: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

2 Benchmark Scenarios

This page describes the scenarios and methodology used when running the benchmarks.

2.1 MO Submission

In this scenario, the SCSCF sends a SIP message containing a short message to the IP-SM-GW, which then sends an MO-ForwardSM request

to the SMSC. The Opencloud Scenario Simulator performs the role of SMSC and SCSCF. For details of the message processing, see MO

Submission Flows

1. The SCSCF sends a SIP Message containing a valid RP-Data payload to the IP-SM-GW.

2. The IP-SM-GW responds to the SCSCF with a 202 Accepted message.

3. The IP-SM-GW sends a TCAP OpenRequest to the SMSC.

4. The SMSC replies with an OpenAccept.

5. The IP-SM-GW sends an MO-ForwardSM request to the SMSC.

6. The SMSC replies with an MO-ForwardSM response, and closes the TCAP dialog.

7. The IP-SM-GW sends a SIP Message containing an RP-ACK to the SCSCF.

8. The SCSCF replies with a 200 OK.

5

Page 6: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

6

Page 7: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

2.2 CS Delivery

In this scenario, the SMSC delivers a MT SMS to the IP-SM-GW, which then sends the message over the CS network. The OpenCloud Scenario

Simulator performs the role of SMSC, MSC, and HLR. For details of changes made to proxied messages and details of message processing, see

MT Delivery Flows .

1. The SMSC sends an OpenRequest containing a SendRoutingInfoForSM request to the IP-SM-GW.

2. The IP-SM-GW proxies that message to the HLR.

3. The HLR replies with a SendRoutingInfoForSM response.

4. The IP-SM-GW proxies that response to the SMSC, and closes the dialog to the SMSC.

5. The SMSC sends an OpenRequest containing an MT-ForwardSM request to the IP-SM-GW.

6. The IP-SM-GW sends an empty OpenRequest to the MSC.

7. The MSC response with an OpenAccept

8. The IP-SM-GW sends the MT-Forward-SM request to the MSC on the established dialog

9. The MSC closes the dialog

10. The IP-SM-GW sends an OpenAccept to the SMSC, and closes the dialog.

7

Page 8: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

8

Page 9: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

3 Hardware and Software

This page describes the hardware and software used when running the benchmarks.

3.1 Hardware

3.2 Software

Vendor Software Version

9

Page 10: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

OpenCloud Sentinel IP Short Message Gateway 2.6.0.3

OpenCloud Rhino 2.5.0.2

OpenCloud Scenario Simulator 2.3.0.10

OpenCloud IN Scenario Pack 1.5.0.4

OpenCloud SIP Scenario Pack 1.0.3.9-M1

Apache Apache Cassandra 2.0.17

Oracle Java 1.7.0_71

3.3 Configuration

Parameter Value

heap_size 6144M

new_size 1536M

gc_type cms

gc_max_pause 50

gc_pause_interval 250

CMSOccupancyFraction 60

SurvivorRatio 16

MaxTenuringThreshold 2

10

Page 11: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

4 Benchmark Results

This page contains the results for the Sentinel IP-SM-GW benchmarks, with both summaries on page and detailed metrics on page 12 .

Context for these results are provided by the benchmark scenarios description on page 5 .

4.1 Benchmarks

Call rate on page 12 1000 messages per second, evenly split across the MO-Submission and CS-Delivery call flows.

CPU usage on page 1300% across 12 cores

Maximum theoretical CPU usage is 2400%.

Heap usage on page 2300MB average heap

Scenario Latencies on page

17Scenario 50th

percentile90thpercentile

95thpercentile

99thpercentile

MO-Submission 7.4ms 9.7ms 16.7ms 71.1ms

CS-Delivery 7.0ms 9.4ms 15.5ms 72.3ms

11

Page 12: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

4.2 Detailed metrics

4.2.1 Call Rate

MO-Submission

12

Page 13: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

CS-Delivery

13

Page 14: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

4.2.2 Rhino CPU usage

14

Page 15: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

4.2.3 Rhino Heap usage

15

Page 16: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

4.2.4 Rhino Activities

16

Page 17: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

4.2.5 Scenario latencies

MO-Submission

17

Page 18: Sentinel IP Short Message Gateway Benchmarks€¦ · Sentinel IP Short Message Gateway Benchmarks (V2.7.0)2 Benchmark Scenarios This page describes the scenarios and methodology used

Sentinel IP Short Message Gateway Benchmarks (V2.7.0)

CS-Delivery

18