Ingest processors preprocess logs before they are written to a Logstore. For example, you can use ingest processors to filter data, extract fields, extend fields, or mask data. This topic describes how to manage ingest processors in the Simple Log Service console.
Create an ingest processor
-
Log on to the Simple Log Service console.
-
Go to the Data Processor page.
-
In the Projects section, click the target project.
-
In the navigation pane on the left, choose .
-
-
On the Ingest Processor tab, click Create. In the Create Processor panel, configure Processor Name, SPL, and Error Handling, then click OK. The following table describes the parameters.
Parameter
Description
Processor Name
The name of the ingest processor.
Description
The description of the ingest processor.
SPL
The SPL statement. For more information about SPL syntax, see SPL syntax.
Failed
The action to take when SPL processing fails:
-
Retain Raw Data
-
Discard Raw Data
Note-
This setting applies only to SPL execution failures, such as operator exceptions caused by invalid data. It does not apply to SPL syntax errors.
-
If parsing fails due to an SPL syntax configuration error, raw data is retained by default.
-
Delete or modify an ingest processor
On the tab, view the list of created processors. Click Modify or Delete to manage a specific ingest processor.
-
If the ingest processor is already associated with a Logstore, updated settings take effect within one minute. Newly generated logs are preprocessed according to the latest configuration before being written to the Logstore.
-
If you delete an ingest processor that is associated with a Logstore, newly generated logs skip preprocessing and are written directly to the Logstore as raw data.
Associate an ingest processor with a Logstore
-
On the target project page, click the
icon in the navigation bar on the right. Hover over the target Logstore and click 
> Modify.
-
On the Logstore Attributes page, click Modify in the lower-right corner. In edit mode, set Ingest Processor to the processor you want to associate, then click Save in the lower-right corner.
NoteAfter you associate an ingest processor with a Logstore, it takes effect for newly generated logs. Wait about one minute for the change to apply.
Disassociate an ingest processor from a Logstore
On the Logstore Attributes page, click Modify in the upper-right corner. In edit mode, click the 
icon to clear the configured ingest processor, then click Save in the upper-right corner.
After disassociating an ingest processor from a Logstore, wait about one minute. Newly generated raw logs are then written directly to the Logstore.
