×
Community Blog EMQ Helps the Apsara Luoshen Cloud Network Platform Develop Network Load Balancer (NLB)

EMQ Helps the Apsara Luoshen Cloud Network Platform Develop Network Load Balancer (NLB)

This article explains how the Apsara Luoshen Cloud Network Platform integrates with NLB to support millions of concurrent connections and requests per second.

By EMQ

In the Artificial Intelligence of Things (AIoT) era, quantitative changes brought about by data are being replaced by qualitative changes brought about by connected devices. The key to building a successful IoT solution in more diverse Internet of Things (IoT) scenarios is the ability to connect a vast number of devices to the cloud and generate insights from these connections.

EMQ Yingyun Technology (EMQ) is a leading provider of open-source IoT infrastructure software. EMQ provides out-of-the-box and highly reliable one-stop IoT data solutions that support high concurrency and provide high performance. EMQ helps enterprises and partners build an IoT infrastructure base that supports cloud-edge integration through real-time retrieval, movement, processing, and analysis of massive amounts of cloud-edge-device data.

EMQX (an MQTT broker provided by EMQ for large-scale distributed IoT) is integrated with Alibaba Cloud Compute Nest. EMQX is also integrated with Lindorm to provide an end-to-end data solution. This time, EMQX is integrated with the Apsara Luoshen Cloud Network Platform to provide NLB that supports hundreds of millions of concurrent connections and millions of requests per second.

Performance Tests That Verify Core Metrics

EMQX (an MQTT broker provided by EMQ for large-scale distributed IoT) is used to verify the core metrics of a single NLB instance, including over 100 million concurrent connections and over 100 Gbit/s of throughput. EMQX can manage over 100 million devices and support the smooth scale-out of services for each NLB instance. EMQX is also used to verify the performance of NLB in scenarios that have high requirements (such as Internet of Vehicles (IoV) and Industrial Internet of Things (IIoT) scenarios).

Performance tests used to verify the core metrics of NLB are completed. The staging environment is deployed in the Germany (Frankfurt) region of Alibaba Cloud. The following figure describes the network topology:

1

  • The EMQX client cluster consists of 35 Elastic Compute Service (ECS) instances of the g5ne.8xlarge specification. These ECS instances are deployed in Frankfurt Zone B. An MQTT client stress testing program is installed to simulate client requests.
  • The EMQX server cluster consists of 36 ECS instances of the g5ne.8xlarge specification. These ECS instances are deployed in Frankfurt Zone B. An MQTT broker service program is installed to process requests.
  • An internal-facing NLB instance is deployed in Frankfurt Zone A and Frankfurt Zone B. This implements disaster recovery and load balancing across zones. Cross-zone request forwarding is enabled.

-The EMQX control cluster consists of three ECS instances of the hfc6.16xlarge specification. These ECS instances are deployed in Frankfurt Zone B and used to manage configuration changes and monitor traffic. They do not forward requests.

Over 100 Million Concurrent and Persistent Connections

The EMQX client establishes persistent MQTT connections at a rate of 35,000 new connections per second. After 50 minutes, the monitoring data in the NLB console shows that the number of concurrent connections reaches 100 million. The following figure shows the monitoring data:

2

The monitoring data on the dashboard of EMQX also shows the number of concurrent connections is maintained at 100 million.

3

Stress tests are performed to verify that the throughput of each NLB instance reaches 100 Gbit/s. The following figure of the NLB console shows that the throughput of a single NLB instance reaches over 320 Gbit/s.

4

NLB Provided by the Apsara Luoshen Cloud Network Platform

The Apsara Luoshen Cloud Network Platform is an ultra-large-scale virtual network built based on the global infrastructure of Alibaba Cloud to improve network reliability, connectivity, and elasticity.

After more than ten years of development, the Apsara Luoshen Cloud Network Platform supports millions of virtual private clouds (VPCs) in each region, millions of compute nodes in each VPC, 51.2 Tbit/s of bandwidth for connections between on-premises networks and Alibaba Cloud, 35 million MPS for eRDMA, service delivery within minutes for 200 GbE networks, and SLB instances that can scale to process up to millions of queries per second. With these capabilities, the Apsara Luoshen Cloud Network Platform supports various types of connections from global users in different industries.

NLB is a new generation load balancing service provided by the Apsara Luoshen Cloud Network Platform for the Internet of Everything (IoE). NLB provides ultra-high performance and auto scaling capabilities. Users do not need to specify or modify the specifications of NLB instances because NLB instances automatically scale to meet business requirements. NLB instances adopt a multi-level disaster recovery architecture to ensure service availability. After users connect to the cloud, NLB balances the load to ensure network elasticity. NLB helps users build secure IoT platforms and applications that support high concurrency.

NLB is used in various IoT scenarios (such as IoV, smart homes, smart parking, and video surveillance). As a service ingress, NLB supports high concurrency, SSL offloading for TCP traffic, and connection rate throttling. These capabilities ensure the security and reliability of IoT services.

EMQX: A Highly Scalable and Cloud-Native MQTT Broker

EMQX is an open-source MQTT broker provided by EMQ for the IoT. With over 10 million downloads, EMQX provides a one-stop solution for connecting devices to the cloud. EMQX connects over 100 million IoT devices to the cloud in a scalable, secure, and reliable manner and moves and processes massive amounts of data in real-time. EMQX is one of the most scalable open-source MQTT brokers in the world. Each cluster of EMQX supports 100 million devices, millions of messages per second, and message distribution within milliseconds.

EMQ has developed the following services based on EMQX: HStreamDB (a cloud-native streaming database that supports the storage and real-time analysis of large-scale streaming data), NanoMQ (an ultra-lightweight MQTT broker running at the edge of the IoT), Neuron (an industrial gateway software for industrial protocol parsing and conversion), and eKuiper (a lightweight IoT edge analysis and streaming engine that can run on various resource-constrained edge devices). These services constitute the future-oriented IoT data infrastructure of EMQ.

In the future, EMQ will continue to work with the Apsara Luoshen Cloud Network Platform to explore in-depth IoT infrastructure solutions in key scenarios (such as the IoV) and help the Apsara Luoshen Cloud Network Platform serve enterprises better and build secure and reliable IoT applications that support high concurrency.

0 2 1
Share on

Alibaba Cloud Community

940 posts | 217 followers

You may also like

Comments

Alibaba Cloud Community

940 posts | 217 followers

Related Products