In addition to various languages and stream computing consumption methods, Log Service also allows you to use Logstash to consume log data. You can configure the Logstash input plug-in to obtain log data from Log Service and write the data to other systems, such as Kafka and Hadoop Distributed File System (HDFS).

Features

  • Distributed collaborative consumption: Multiple servers can be configured to consume log data in a Logstore at the same time.
  • Robust performance: If you use the Java consumer group, the consumption speed of a single-core CPU can reach up to 20 MB/s.
  • High reliability: Log Service saves the consumption progress. If a server is recovered from an exception, it can continue to consume log data from the last consumption checkpoint.
  • Automatic load balancing: Shards are automatically allocated based on the number of consumers in a consumer group. Log Service can automatically rebalance the shards if consumers join or leave the consumer group.