ApsaraMQ for Kafka is a fully managed and O&M-free distributed message queue service that is fully compatible with open source Apache Kafka. ApsaraMQ for Kafka supports Apache Kafka versions 0.10.x to V2.6.x and allows you to seamlessly migrate business from Apache Kafka to Alibaba Cloud without code modification.
Out-of-the-box
ApsaraMQ for Kafka is fully compatible with open source Apache Kafka and allows you to seamlessly migrate business from Apache Kafka to Alibaba Cloud.
High compatibility: ApsaraMQ for Kafka is fully compatible with open source Apache Kafka. You can use Apache Kafka clients to connect to ApsaraMQ for Kafka. ApsaraMQ for Kafka supports open source Apache Kafka versions 0.10.x to 2.6.x.
Seamless migration: You can migrate your business that is developed on the open source Apache Kafka ecosystem to ApsaraMQ for Kafka without code modification.
Zero O&M and high observability
ApsaraMQ for Kafka provides an experienced and professional O&M team and an advanced O&M system.
HouseKeeping: This component checks the status of the core links of ApsaraMQ for Kafka, scans and diagnoses clusters at an interval of one minute, and then generates alerts for unhealthy instances. HouseKeeping also provides daily overall inspection reports to help O&M engineers monitor the health status of ApsaraMQ for Kafka instances.
NoteIf an unhealthy instance is detected during health inspection, the risk items are displayed on the Instance Risks tab of the Instance Details page.
Service monitoring and alerting: The system monitors message accumulation in each consumer group and generates alerts for exceptions. This helps you detect issues at the earliest opportunity.
API operations: ApsaraMQ for Kafka provides a complete set of API operations for you to manage resources and perform O&M operations.
Diversified data ecosystem
ApsaraMQ for Kafka provides fully managed and O&M-free components to implement the extract, transform, and load (ETL) feature and supports functions for programming. This helps you manage data in a flexible manner.
ApsaraMQ for Kafka allows you to use connectors to connect to various Alibaba Cloud services and other services in the big data ecosystem. This facilitates data integration and computing.
High performance
ApsaraMQ for Kafka provides a deeply optimized kernel to resolve the pain point of open source Apache Kafka that performance is compromised if data is written into thousands of partitions. ApsaraMQ for Kafka allows you to write data into tens of thousands of partitions without decreasing performance.
ApsaraMQ for Kafka supports scaling in seconds.
ApsaraMQ for Kafka supports a maximum of 2 GB of write traffic.
High availability
The development and performance optimization teams of Alibaba Cloud messaging services have optimized the open source Apache Kafka to provide excellent services.
Data persistence: Professional teams help ensure higher availability. Messages are persistently enqueued. This helps ensure high data reliability and service availability.
High throughput: ApsaraMQ for Kafka ensures high cluster throughput even if a large number of messages are accumulated.
Tens of thousands of topics: ApsaraMQ for Kafka can concurrently read data from and write data to tens of thousands of topics to ensure the high throughput of clusters.
High SLA
ApsaraMQ for Kafka provides optimized write performance in scenarios such as phased updates, service upgrades, and cold data reads.
ApsaraMQ for Kafka provides automatic inspection and O&M capabilities. The service availability of ApsaraMQ for Kafka can reach 99.9%, and the data reliability can reach 99.999999%.
Data security
ApsaraMQ for Kafka supports the authentication and authorization mechanisms and allows you to grant different permissions to Resource Access Management (RAM) users. This ensures enterprise-level security and protection.
Permission management: ApsaraMQ for Kafka supports Alibaba Cloud accounts, RAM users, blacklists, whitelists, and Security Token Service (STS) for permission management. This allows you to grant permissions to a RAM user or another Alibaba Cloud account.
Access security: ApsaraMQ for Kafka works with the Alibaba Cloud account system and uses the Simple Authentication and Security Layer (SASL) mechanism to authenticate the identity of a user. ApsaraMQ for Kafka also uses SSL to encrypt connections to prevent data from being intercepted or tampered with during data transmission.
Alibaba Cloud VPC: ApsaraMQ for Kafka allows access over the Internet and in virtual private clouds (VPCs). You can fully manage your VPC. For example, you can specify CIDR blocks and configure route tables and gateways for your VPC. You can also deploy Alibaba Cloud resources such as Elastic Compute Service (ECS) instances, ApsaraDB RDS instances, and Server Load Balancer (SLB) instances in your VPC.
Optimization based on open source Apache Kafka
ApsaraMQ for Kafka supports concurrent read and write operations on tens of thousands of topics and second-level scaling and provides reliable storage. This cost-efficient service also provides the HouseKeeping component and the business monitoring and alerting features to help you troubleshoot issues at the earliest opportunity. For more information, see Comparison between ApsaraMQ for Kafka and open source Apache Kafka.