Alibaba Cloud Logstash is a server-side data processing pipeline that is fully compatible with open-source Logstash. It dynamically collects and transforms data from multiple sources and stores it in your preferred location. With input, filter, and output plugins, Logstash can process and transform any type of event.
Why choose Alibaba Cloud Logstash
In addition to the official built-in plugins, Alibaba Cloud Logstash offers a plugin center that provides plugins for various scenarios, such as logstash-input-sls, logstash-input-oss, and logstash-output-oss. These plugins provide powerful data processing and migration capabilities and integrate with the cloud data ecosystem.
The Alibaba Cloud ELK (Elasticsearch, Logstash, and Kibana) stack is widely used for real-time log processing, full-text search, and data analytics. Within this ecosystem, Elasticsearch acts as a real-time distributed search and analytics engine, Logstash provides data collection, transformation, optimization, and output capabilities, and Kibana offers a powerful visualization interface.
Alibaba Cloud Logstash provides a managed service based on open-source Logstash, and its features are consistent with those of the open-source version. If you encounter any service-related issues, you can contact us by submitting a ticket.
We are not responsible for business losses caused by bugs in Logstash or its third-party components, or by improper configuration and use. If you encounter such issues, we recommend that you first consult the official Logstash documentation or seek help from the community.
Logstash data transmission principle
Data collection and input: Logstash supports various inputs and can collect data as a continuous stream from sources such as logs, metrics, web applications, and data stores.
Real-time parsing and data transformation: Logstash uses filters to parse each event, identify named fields to build a structure, and transform the events into a common format before transmitting the data to a repository.
Storage and data exporting: Logstash provides multiple output options to send your data to your preferred destination.
Product features
Feature | References |
Fast deployment, easy management, simplified O&M, and flexible scale-out. | |
You can deploy instances in a logically isolated virtual private cloud (VPC) to improve product security. | |
You can upload and manage custom extension files. | |
Provides an open and flexible plugin center that integrates all official Input, Output, and Filter plugins. This plugin center also supports input and output plugins for Alibaba Cloud products such as Simple Log Service (SLS) and OSS. | |
You can connect to the Internet by configuring a NAT Gateway. | |
You can manage pipelines centrally using configuration files. After you configure a pipeline, you can view its output in the console. |