Log Service allows you to collect data from multiple sources, such as servers, applications, open source software, IoT devices, mobile devices, and Alibaba Cloud services. You can also collect data that is transferred over standard protocols. This topic describes the data sources that are supported by Log Service.

Data sources

The following table describes the sources from which Log Service can collect data.

CategorySourceCollection methodReferences
ApplicationProgram outputLogtailNone
Access logLogtailCollect and analyze NGINX access logs
Trace dataNone
Metric dataNone
Programming languageJavaNone
Log4J AppenderNone
LogBack AppenderLogBackNone
CLog Service SDK for CNone
PythonLog Service SDK for PythonNone
Python LoggingNoneNone
PHPLog Service SDK for PHPNone
.NetLog Service SDK for csharpNone
C++Log Service SDK for C++None
GoNone
Node.jsSDK for Node.jsNone
JavaScriptJavaScript/Web trackingNone
Operating systemLinuxLogtailNone
WindowsLogtailNone
macOS/UNIXNative CNone
Docker fileLogtailNone
Docker outputLogtailNone
DatabaseMySQL binary logLogtailNone
MySQL query resultLogtailNone
SQL Server query resultLogtailNone
PostgreSQL query resultLogtailNone
Mobile deviceiOS and AndroidNone
Web pageJavaScript/Web trackingNone
Intelligent IoTLog Producer Library for CNone
Standard protocolHTTPLogtailCollect and analyze NGINX monitoring logs
SyslogLogtailNone
KafkaLog Producer SDK for KafkaNone
OpenTelemtryOpenTelemetryNone
Imported dataMaxCompute dataData importNone
Object Storage Service (OSS) dataData importNone
MySQL dataData importNone
Elasticsearch dataData importNone
CloudMonitor dataData importNone
GCP Pub/Sub messageData importNone
FlinkUse Flink to write data to Log ServiceRegister a Log Service project
Third-party softwareLogstashLogstash and Kafka protocolNone
FlumeUse Flume to consume log dataNone
Beats Kafka protocolNone
FluentdKafka protocolNone
TelegrafKafka protocolNone
Alibaba Cloud serviceServices such as Elastic Compute Service (ECS) and OSSAlibaba Cloud service logsNone

Endpoints

Log Service provides the following types of endpoints:

  • Internal endpoint: If you select an internal endpoint, Log Service can be accessed by other Alibaba Cloud services in the same region over the classic network or a virtual private cloud (VPC), which is reliable.
  • Public endpoint: If you select a public endpoint, Log Service can be accessed over the Internet, and the data transmission speed varies based on network conditions. To ensure secure data transmission, we recommend that you use HTTPS.

For more information, see Endpoints.

FAQ

  • Which network type do I need to select if I use Express Connect together with Log Service?

    We recommend that you select the internal network type.

  • Can I obtain public IP addresses when I collect data from the Internet?

    Yes, you can turn on Log Public IP for your Logstore to obtain public IP addresses. For more information, see Create a Logstore.

  • Which network type do I need to select if I want to collect ECS logs from Region A to a Log Service project in Region B?

    We recommend that you select the Internet type and specify the region name of Region B in the command that is used to install Logtail on your ECS instance in Region A. This way, Logtail can access the project in Region B over the Internet. For more information about how to select a network type in other scenarios, see Select a network type.

  • How do I check whether an endpoint is accessible?

    You can run the following command to check whether an endpoint is accessible. If output is returned, the endpoint is accessible.

     curl $myproject.cn-hangzhou.log.aliyuncs.com
    • $myproject: the name of the project.
    • cn-hangzhou.log.aliyuncs.com: the endpoint.