Document Center

    Log Service

    • Product Introduction
      • What is Log Service?
      • Architecture
      • Benefits
        • Features
        • Comparison between Log Service and the ELK stack in log query and analytics scenarios
        • Query solution comparisons
      • Scenarios
      • Basic concepts
        • Overview
        • Logs
        • Log groups
        • Projects
        • Logstore
        • Shards
        • Log topics
      • Limits
        • Basic resources
        • Data read and write
        • Search, analytics, and visualization
        • Reserved fields
    • Pricing
      • Pay-as-you-go
      • Cost optimization
      • Overdue payments
      • View consumption details
      • FAQ
        • Save indexing fees
        • Billing-related FAQ
        • Disable Log Service
    • Quick Start
      • Quick start
    • Data Collection
      • Log collection methods
      • Preparation
        • Log Service console homepage
        • Preparations
        • Manage a project
        • Manage a Logstore
        • Manage shards
      • Collection acceleration
        • Overview
        • Enable the global acceleration feature
        • Configure log collection acceleration for Logtail
        • Disable the global acceleration feature
      • Logtail collection
        • Overview
          • Logtail overview
          • Log collection process of Logtail
          • Logtail configuration files and record files
        • Select a network type
        • Install
          • Install Logtail in Linux
          • Install Logtail in Windows
          • Configure the startup parameters of Logtail
        • Machine Group
          • Overview
          • Configure an account ID for a server
          • Create an IP address-based machine group
          • Create a custom ID-based machine group
          • Manage machine groups
          • Manage collection configurations
        • Text logs
          • Overview
          • Collect logs by line
          • Use the full regex mode to collect logs
          • Collect DSV formatted logs
          • Collect JSON logs
          • Collect NGINX logs
          • Collect IIS logs
          • Collect Apache logs
          • Time formats
          • Configure a log topic
          • Import historical logs
        • Container log collection
          • Overview
          • Install Logtail
          • Use the console to collect Kubernetes text logs in the DaemonSet mode
          • Use the console to collect Kubernetes stdout and stderr logs in the DaemonSet mode
          • Use CRDs to collect Kubernetes container logs in the DaemonSet mode
          • Use CRDs to collect Kubernetes container logs in the Sidecar mode
          • Use the console to collect Kubernetes container logs in the Sidecar mode
          • Collect logs from standard Docker containers
          • Collect Kubernetes events
        • Customize Logtail plug-ins to collect data
          • Overview
          • Collect MySQL binary logs
          • Collect MySQL query results
          • Collect HTTP data
          • Collect syslog logs
          • Collect data from Beats and Logstash
          • Collect systemd-journald logs
          • Collect Docker events
          • Collect Windows event logs
          • Process data
        • Logtail limits
      • Cloud product collection
        • Cloud service logs
        • API Gateway access logs
        • MNS logs
        • OSS access logs
          • Overview
          • Collect OSS access logs
          • Query OSS access logs
          • Log fields
        • SLB Layer 7 access log
        • DDoS log collection
          • Overview
          • Collection procedure
          • Log analysis
          • Log Report
          • Billing method
        • Logs of BGP-line Anti-DDoS Pro
          • Overview
          • Manage log storage space
          • Log fields
          • Log analysis
          • Log reports
          • Enable or disable log collection
        • TDS logs
          • TDS logs
        • WAF logs
          • Real-time log analysis
          • Activate WAF Log Service
          • Billing method
          • Log collection
          • Log Analyses
          • Log Reports
          • Fields in the log entry
          • Advanced settings
          • Grant log query and analysis permissions to a RAM user
          • Manage log storage
        • Cloud Firewall logs
          • Overview
          • Enable the log analysis service
          • Collect the log
          • Log analysis
          • Fields in the log entry
          • Advanced Settings
          • Export log entries
          • Authorize RAM user accounts with Log Analysis function
          • Manage log storage
          • Log analysis billing method
        • Anti-Bot logs
          • Enable Log Service for Anti-Bot
          • Log field description
        • ActionTrail access logs
          • Overview
          • Procedure
        • Inner-ActionTrail
          • Overview
          • Activate Inner-ActionTrail
          • Inner-ActionTrail fields
        • RDS SQL execution logs
          • Overview
          • Procedure
          • Log fields
        • NAS access logs
          • Overview
          • Procedure
        • ApsaraDB for Redis logs
          • Activate Log Service
          • Query audit logs
          • Query slow query logs
      • Other collection methods
        • Use web tracking to collect logs
        • Kafka protocol
        • Collect data by using Syslog
        • Logstash
          • Install Logstash
          • Create a Logstash collection configuration
          • Configure Logstash as a Windows service
          • Advanced features
          • Logstash error handling
        • SDK collection
          • Producer Library
          • Log4j Appender
          • Logback Appender
          • C Producer Library
          • Go Producer Library
        • Common log formats
          • Log4j logs
          • Python logs
          • Node.js logs
          • WordPress logs
          • Unity3D logs
          • Use Logstash to collect IIS logs
          • Use Logstash to collect CSV logs
          • Use Logstash to collect other logs
      • Best practices
        • Collect IoT or embedded development logs
        • Collect logs through Web Tracking
        • Collect Container Service logs
        • Build a service to read logs from mobile apps directly
        • Collect data over the public network
        • Collect data from multiple channels
        • Manage logs
        • Use logging handlers to automatically upload Python logs
      • FAQ
        • Basic questions for Logtail
        • Do I need to update Logtail settings after the network type is changed?
        • Query local collection status
        • What are the differences between LogHub and Kafka?
        • What are the differences among log collection agents?
        • Why am I unable to collect SLB access logs?
        • How do I set the time format?
        • Troubleshoot log collection exceptions in containers
        • Log management
        • Basic questions
    • Index and query
      • Overview
      • Real-time analysis
      • Enable and configure the index feature for a Logstore
      • Query logs
      • Export logs
      • Overview
      • Data type of index
        • Text type
        • JSON type
        • Numeric type
      • Query
        • Query syntax
        • Use LiveTail to monitor and analyze logs
        • Use LogReduce to group log data
        • Perform a context query
        • Save a query statement as a saved search
        • Quick analysis
        • Other functions
      • Analysis grammar
        • General aggregate functions
        • Security check functions
        • Map functions
        • Estimating functions
        • Mathematical statistic functions
        • Mathematical calculation functions
        • String functions
        • Date and time functions
        • URL functions
        • Regular expression functions
        • JSON functions
        • Type conversion functions
        • IP functions
        • GROUP BY syntax
        • Window functions
        • HAVING syntax
        • ORDER BY syntax
        • LIMIT syntax
        • CASE WHEN and IF syntax
        • Nested subquery
        • Arrays
        • Binary string functions
        • Bitwise functions
        • Interval-valued comparison and periodicity-valued comparison function
        • Comparison functions and operators
        • Lambda functions
        • Logical functions
        • Column aliases
        • JOIN operations between Logstores and ApsaraDB for RDS instances
        • Geospatial functions
        • Geo functions
        • Join syntax
        • UNNEST function
      • Machine learning syntax and functions
        • Overview
        • Smooth function
        • Multi-period estimation function
        • Change point detection function
        • Maximum value detection function
        • Prediction and anomaly detection functions
        • Sequence decomposition function
        • Time series clustering functions
        • Frequent pattern statistical function
        • Differential pattern statistical function
        • Correlation analysis functions
        • Kernal density estimation functions
        • Root cause analysis function
      • Advanced analysis
        • Case study
        • Optimized queries
        • Time field conversion examples
      • Analyze logs by using JDBC
      • Best practices
        • Display query and analysis results on multiple pages
        • Query MNS logs
        • Query and analyze AppLogs
        • Perform association query and analysis on logs and the data from databases
        • Perform association query and analysis on logs and tables from OSS
        • Analyze sales system logs
        • Analyze website logs
        • Analyze Nginx monitoring logs
        • Analyze NGINX access logs
        • Analyze vehicle track logs
        • Analyze access logs of Layer-7 Server Load Balancer
      • FAQ
        • What are the differences between LogHub and LogSearch?
        • How do I resolve common errors returned in log query and analysis?
        • FAQ about log query
        • What can I do if no log data is found?
        • What can cause an inaccurate query result to return?
    • Data Transformation
      • Overview
      • Concepts
      • Processing principles
      • Configure an AccessKey pair
      • Quick Start
      • Create processing rules
      • Manage processing tasks
      • Data processing syntax
        • Language introduction
        • Syntax introduction
        • Data structures
        • Basic syntax
        • Global processing functions
          • Function overview
          • Flow control functions
          • Event processing functions
          • Field processing functions
          • Value assignment function
          • Value extraction functions
          • Data mapping and enrichment functions
          • Task configuration function
        • Expression functions
          • Function overview
          • Event check functions
          • Operator functions
          • Conversion functions
          • Arithmetic functions
          • String functions
          • Date and time functions
          • Regular expression functions
          • Grok function
          • Structured data functions
          • Encoding and decoding functions
          • List functions
          • Resource functions
          • Table functions
          • Dictionary functions
        • General reference
          • Status monitoring and alerting
          • Date and time formatting directives
          • Time zone list
          • Grok patterns
          • JMESPath syntax
          • Field extraction modes
          • Query string syntax
          • Regular expressions
      • Authorize a RAM user to transform data
      • Data transformation dashboard
      • Performance guide
      • Cost optimization guide
      • Best practices
        • Call functions
        • Use functions to check events
        • Process date and time
        • Mask sensitive log data
        • Dispatch data to multiple target Logstores
        • Aggregate data from multiple source Logstores
        • Text parsing
          • Transform complex JSON data
          • Parse NGINX logs
          • Transform logs in specific text formats
          • Parse log entries in a CSV-format log file
          • Extract dynamic key-value pairs from a string
          • Parse syslog messages in standard formats
        • Data enrichment
          • Build dictionaries and tables for data enrichment
          • Enrich complex data by using search-based mapping functions
          • Obtain data from an ApsaraDB RDS for MySQL instance for data enrichment
          • Pull data from another Logstore to enrich log data during the data pull from a Logstore
          • Pull data from OSS objects to enrich log data
      • FAQ
        • Troubleshooting overview
        • Startup errors of the data transformation engine
        • Errors in reading data from the source Logstore
        • Errors in data transformation rules
        • How can I fix data pull errors?
        • How can I fix errors that occur during data outputs to the target Logstore?
        • How can I fix errors that occur when I pull Logstore data (dimension table)?
        • How can I fix errors that occur during data pulls from OSS?
        • How can I fix errors of the syntax used to pull data from ApsaraDB RDS for MySQL?
    • Query and visualization
      • Analysis graph
        • Overview
        • Table
        • Line chart
        • Column chart
        • Bar chart
        • Pie chart
        • Area chart
        • Individual value plot
        • Progress bar
        • Map
        • Flow diagram
        • Sankey diagram
        • Word cloud
        • Treemap chart
      • Dashboard
        • Dashboard overview
        • Create and delete a dashboard
        • Configure the display mode of a dashboard
        • Edit a dashboard
        • Subscribe to dashboards
        • Configure drill-down analysis for a chart of a Logstore
        • Configure and use a filter on a dashboard of a Logstore
        • Markdown chart
      • Alarm
        • Alarm function overview
        • Configure an alert
        • Configure the alert notification method
        • Grant a RAM user alerting permissions
        • Modify an alert
        • View history alerts
        • Manage an alert
        • Upgrade an alert
        • Relevant syntax and fields for reference
          • Set an alarm condition expression
          • Alarm log fields
        • Best practices
          • Configure an alert
        • FAQ
          • Alarm configuration examples
    • Log consumption and shipping
      • Data shipping
        • Overview
        • Manage log shipping tasks
        • Ship logs to OSS
          • Ship logs to OSS
          • JSON storage format
          • CSV storage format
          • Parquet storage format
          • Snappy compression
          • Use RAM to authorize Log Service to access OSS
        • Ship data to MaxCompute
          • Ship data to MaxCompute through DataWorks
        • Send logs to an SIEM system
          • Introduction
          • Send logs to an SIEM system over HTTPS
          • Send logs to an SIEM system over Syslog
          • Alibaba Cloud Log Service Add-on for Splunk
        • Best practices
          • Connect to a data warehouse
      • Real-time subscription and consumption
        • Overview
        • Consume logs
        • Consumption by consumer groups
          • Use consumer groups to consume logs
          • View the status of a consumer group
          • Create an alert rule to monitor a consumer group
        • Use Fuction Compute to cosume LogHub Logs
          • Configure Function Compute log consumption
          • Development guide
        • Use Storm to consume LogHub logs
        • Use Flume to consume log data
        • Use open source Flink to consume log data
        • Use Logstash to consume LogHub logs
        • Use Spark Streaming to consume log data
        • Use Realtime Compute to consume LogHub logs
        • Use CloudMonitor to consume LogHub logs
        • Use Go consumer groups to consume LogHub logs
        • Best practices
          • Use a consumer library to consume logs in high reliability mode
          • Build a monitoring system
          • Consume metering and billing logs
          • Cleanse data through ETL
          • Use Function Compute to cleanse log data
    • Application
      • Log Audit Service
        • Overview
        • Configure log collection
        • Perform audit operations
        • Authorize log collection
        • Log field details
        • View global data
        • Use Terraform to configure log audit
        • Log collection policies
      • Analysis of the epidemic situation of novel coronavirus
        • Overview
        • Application operation and management
    • Developer Guide
      • API Reference
        • Overview
        • Service endpoint
        • AccessKey
        • Public request header
        • Public response header
        • Request signature
        • Common error codes
        • Project interfaces
          • CreateProject
          • DeleteProject
          • UpdateProject
          • GetProject
          • ListProject
          • GetProjectLogs
        • Logstore related APIs
          • CreateLogstore
          • DeleteLogstore
          • UpdateLogstore
          • GetLogstore
          • ListLogstore
          • ListShards
          • SplitShard
          • MergeShards
          • GetCursor
          • GetCursorTime
          • PullLogs
          • PutLogs
          • GetShipperStatus
          • Retryshippertask
          • GetLogs
          • GetHistograms
          • UpdateIndex
          • CreateIndex
          • DeleteIndex
          • GetIndex
          • PutWebtracking
        • Logtail machine group related interfaces
          • Createmachinegroup
          • DeleteMachineGroup
          • UpdateMachineGroup
          • ListMachineGroup
          • GetMachineGroup
          • ApplyConfigToMachineGroup
          • RemoveConfigFromMachineGroup
          • ListMachines
          • GetAppliedConfigs
        • Logtail configuration related interfaces
          • CreateConfig
          • ListConfig
          • GetAppliedMachineGroups
          • GetConfig
          • DeleteConfig
          • UpdateConfig
        • Consumer group interfaces
          • UpdateConsumerGroup
          • ListConsumerGroup
          • CreateConsumerGroup
          • DeleteConsumerGroup
          • HeartBeat
          • UpdateCheckPoint
          • GetCheckPoint
        • External Storage
          • External Store overview
          • External Store related APIs
        • RAM/STS
          • Overview
          • Resource list
          • Action list
          • Authentication rules
          • Use STS to enable cross-account access to Log Service resources
        • Common resources
          • Data model
          • Data encoding method
          • Logstore
          • Shard
          • Logtail configuration
          • Machine group
      • SDK Reference
        • Overview
        • Configurations
        • Exception handling
        • Procedure
        • Procedure
      • Command line interface
      • Access control RAM
        • Overview
        • Configure permission assistant
        • Authorize a RAM user to connect to Log Service
        • Assign a RAM role to a trusted entity
        • Use custom policies to grant permissions to a RAM user
        • Authorize a RAM role to read logs
      • Monitor Log Servic
        • Monitor Log Service
        • Service log
          • Overview
          • Enable, modify, and disable the service log feature
          • Log types
          • Service log dashboards
        • Log moniroring by CloudMonitor
          • Monitoring metrics
          • Use CloudMonitor to configure alert rules
        • Best practices
          • Activate, monitor, and consume service logs
      • Other visualization methods
        • Embed console pages into web pages
        • Set console page embedment parameters
        • OpenTracing implementation of Jaeger
        • Use JDBC to count and visualize logs
        • Connect Log Service with DataV
        • Interconnection with Grafana
    • Practices
      • Best Practices
        • Typical scenarios
        • Collection
          • Collect IoT or embedded development logs
          • Collect logs through Web Tracking
          • Collect Container Service logs
          • Collect data over the public network
          • Collect data from multiple channels
          • Manage logs
          • Analyze IIS access logs
          • Build a service to read logs from mobile apps directly
          • Collect and analyze NGINX access logs
          • Analyze Log4j logs
          • Use logging handlers to automatically upload Python logs
          • Analyze Apache access logs
          • Collect ECS logs
          • Collect Kubernetes logs
        • Query and analysis
          • Display query and analysis results on multiple pages
          • Query MNS logs
          • Query and analyze AppLogs
          • Perform association query and analysis on logs and the data from databases
          • Perform association query and analysis on logs and tables from OSS
          • Analyze sales system logs
          • Analyze website logs
          • Analyze NGINX monitoring logs
          • Analyze vehicle track logs
          • Analyze access logs of Layer-7 Server Load Balancer
          • Analyze NGINX access logs
        • Consumption
          • Use Function Compute to cleanse log data
          • Build a monitoring system
          • Consume metering and billing logs
          • Use a consumer library to consume logs in high reliability mode
          • Cleanse data through ETL
        • Shipping
          • Connect to a data warehouse
        • Operations logs
          • Activate, monitor, and consume operations logs
        • Alerting
          • Configure an alert
    • FAQ & Troubleshooting
    • General Reference
      • Guidelines for the use of documentation
        • Alibaba Cloud documentation
        • Instructions for open source documentation
          • Open-Source Documentation Code of Conduct
          • Editing Open-Source Documentation
      • Alibaba Cloud console
      • Regions and zones
      • Service limits
      • Create an AccessKey
      • ICP Filing
      • Glossary
 
All Products
Search
  • Document Center
  • Log Service
  • Data Collection
  • Other collection methods
  • SDK collection
  • C Producer Library

This Product

  • This Product
  • All Products

    C Producer Library

    Document Center
    Product Details Download PDF

    C Producer Library

    Edit in GitHub
    Last Updated: Apr 05, 2020 Edit in GitHub

    In addition to Java Producer Library, LogHub supports C Producer Library and C Producer Lite Library. LogHub provides an end-to-end, cross-platform log collection solution that features simplicity, high performance, and minimal resource consumption.

    For more information about GitHub projects, visit:

    • C Producer Library (recommended for servers)
    • C Producer Lite Library (recommended for IoT and smart devices)
    Previous: Logback Appender Next: Go Producer Library

    How helpful was this page?

    What might be the problems?

      More suggestions?

      Thank you! We've received your feedback.
      Free Trial Free Trial