Melrose Labs

SMS Load Test Report
from Melrose Labs

Test Title:SMS Load Test
Test ID:sample
Test Reference:Peter Bloggs <peter.bloggs@melroselabs.net>
Test start:2020-01-10T13:01:27+00:00
Test end:2020-01-10T13:01:43+00:00
Test duration (secs):15.8
Description:

The SMPP SMS Load Test measures the rate at which the SMSC / SMS gateway / SMS server (SUT - Server Under Test) can process SMS submissions from a simulated application. The test also measures the latency for submit_sm/submit_sm_resp operations under load.

Messages are submitted by one or more client connections (SMPP TX binds) to the SUT, within the constraint of the max window size, for up to 2-minutes. SMPP v3.4 is used for testing.

Note: The pre-test sends only 1000 messages using a single client connection.

SMPP Account Details


  • Host: 194.247.82.149:2775 (non-TLS)
  • System ID: alphabet
  • System Type:

Load Test Parameters


  • Max window size: 25 SMS
  • Message quantity: 1000 SMS
  • Client connections to SUT: 1

Message Profile


  • Source address: 5.1.MELROSE
  • Destination address: 1.1.447700000000 - 1.1.447700100000
  • Short message: Melrose Labs testing
  • Data coding: 0
  • Protocol ID: 0
  • Registered delivery: NO

Test Results


Submission Latency

Submission latency is the time between the submit_sm being sent to the SMSC and the time the submit_sm_resp response is received back from the SUT (Tsubmit_sm_resp - Tsubmit_sm).

Average Latency
339 ms
Minimum Latency
167 ms
Maximum Latency
740 ms

Submission Latency Summary

The blue line shows the submit time (x-axis) and latency of submit_sm_resp (y-axis) for each message in the test. The red line shows the submit time (x-axis) and message number/ID (y-axis). This graph allows zooming into a range of time within the graph. The green line shows the trend of the latency.


Submission Latency Detailed

The blue line shows the submit time (x-axis) and latency of submit_sm_resp (y-axis) for each message in the test. The red line shows the submit time (x-axis) and message number/ID (y-axis). This graph allows zooming into a range of time within the graph. The start of the test is displayed as midnight.


Submission Latency Histogram

The following shows the distribution of messages by latency.


Submission Latency Histogram for Message No. Range

Use slider to select range of messages for which to display latency histogram. Slider selects by message number (ID).


Submission Rate

The rate is the number of submit_sm_resp responses received from the SUT each second. This uses the time a submit_sm_resp was received from the SMSC (Tsubmit_sm_resp). The window size, round-trip latency between client and server, and submit_sm processing time of the SUT will impact the achievable submission rate.

Average SMS Rate
63.3 SMS/sec
Minimum SMS Rate
43 SMS/sec
Maximum SMS Rate
72 SMS/sec

Submission Rate Histogram (SMS/sec)

Each column in the histogram represents a second during the test. The length of the column indicates the number of submit_sm_resp received during that second (i.e. SMS/sec).

SMS Window Usage Tracking

The number of SMS for which a submit_sm_resp is pending is limited by the max window size. For this test this has been configured to 25.

Where the max window size is set too low, the submission rate will be limited. Where it is set too high, the SUT may become overloaded or start to reject messages.


Fri Jan 17 19:00:00 2020 UTC