All Products
Search
Document Center

Simple Log Service:Processing during ingestion (ingest processor)

Last Updated:Jul 09, 2025

Ingest processors let you preprocess logs before they are written to a logstore. You can use ingest processors to filter data, extract fields, extend fields, and mask data.

How it works

image

Scenarios

  • Field extraction: Extract new fields from raw log fields using parsing methods such as regular expressions, Key-Value format, and JSON.

  • Field extension: Add new fields to raw logs.

  • Field deletion: Delete specific fields from raw logs.

  • Data masking: Mask sensitive information in raw logs.

  • Data filtering: Discard specific data from raw logs.

Limits

  • For quota limits such as the number of ingest processors and length of SPL statements, see Ingest processor.

Billing

Ingest processors are billed based on the amount of computing resources consumed during data processing. The billing unit is OCUs.

Observability Capacity Units (OCUs) are a new billing unit used on Alibaba Cloud Cloud Native Observability Platform. The number of OCUs is automatically calculated based on the resource usage per hour.

Alibaba Cloud plans to gradually implement metered billing on the compute-intensive capabilities of Simple Log Service. The billing unit is OCUs, which measure the actual usage of computing resources. An OCU can be used to offset the fee of 0.5 CPU cores, 2 GB of memory, or 3,000 IOPS. During fee calculation, the system calculates the numbers of OCUs based on the number of consumed cores, size of consumed memory, and IOPS consumption. Then, the system uses the largest number for billing.

For example, a compute job consumes 1 core, 2 GB of memory, and 3,000 IOPS. In this example, 2 OCUs are consumed. In a billing cycle of 1 hour, approximately one-third of the OCUs are consumed when an ingest processor processes 1 GB of data. Then, about one-third of the OCUs are consumed when the new version of data transformation processes 1 GB of data. Approximately 0.3 OCUs are consumed when rule-based data consumption processes 1 GB of data.

For billing information about OCUs, see Billable items of pay-by-ingested-data and Billable items of pay-by-feature.