Enable monitoring and alerts for data transformation

After you enable monitoring and alerts for a data transformation job, Simple Log Service sends alert notifications when exceptions occur, helping you identify issues quickly.

Prerequisites

A data transformation job is created. Create a data transformation job.

Background

SLS automatically creates a Data Transformation Troubleshooting dashboard for each data transformation job. Monitor the following metrics on this dashboard:
- System metrics: data consumption latency for stream processing and errors.
- Business metrics: processed log lines and output log lines.
These metrics are available on the Data Transformation Dashboards.
SLS provides built-in alert rules, a built-in action policy, and a built-in alert template for data transformation.
- These rules trigger alerts without SQL queries, such as alerts for data consumption latency, exceptions, and job failures.
- The action policy specifies notification channels and the alert template.
- The alert template defines the notification content.

Step 1: Configure an action policy

The built-in alert rules use the SLS built-in action policy for data transformation by default. Configure the notification channels in this policy first.

Log on to the Simple Log Service console.
Navigate to the Action Policy page.
1. In the Projects section, click the project you want.
2. In the left-side navigation pane, click Alerts.
3. On the Alert Center page, choose Notification Management > Action Policy.
On the Action Policy tab, find the Simple Log Service built-in action policy for data transformation and click Modify in the Actions column.
In the Edit Action Policy dialog box, under Primary Action Policy, change the Request URL for DingTalk-Custom to your DingTalk chatbot webhook URL. Keep other default settings and click Confirm.

Get the DingTalk chatbot webhook URL from DingTalk-Custom. You can also configure other Notification channels.

Step 2: Enable an alert rule

Enable the built-in alert rule templates for your business needs.

On the Alert Center page, go to the Alert Rules tab. Click the arrow next to Create Alert and select Create from Template.
In the Create from Template panel, click SLS Data Transformation and select a template.
On the Create Alert page, configure the parameters and click OK. Create an alert rule.

After the alert rule is enabled, SLS monitors all data transformation jobs in the Project in real time.

To monitor only a specific job, click Edit next to Query Statistics on the Create Alert page. In the Query Statistics dialog box, click the Advanced Settings tab and specify the data transformation job ID in the Search editor.

Related operations

Actions	Description
Add an alert rule	Add a new alert rule to monitor a specific data transformation job.
Disable an alert rule	Disabling a rule prevents it from triggering alerts and changes its Status to Disabled. You can re-enable it later without re-entering the parameters.
Pause an alert rule	Pauses the alert rule for a specified period. No alerts trigger during this time.
Resume an alert rule	Resumes a paused alert rule.
Delete an alert rule	Permanently deletes the alert rule and its configuration. To monitor the job again, create a new rule.
Reconfigure an alert rule	Modifies an existing alert rule's parameters, such as the rule name, job ID, monitoring threshold, action policy, and alert severity.