This topic describes how to manage a data transformation task in the Log Service console. You can view the details and status of a task in the console. You can also start, stop, modify, and delete the task and configure alerts.

View the details of a task

  1. Log on to the Log Service console.
  2. In the Projects section, find the project to which the task belongs and click the project.
  3. In the left-side navigation pane, choose Jobs > Data Transformation.
  4. In the data transformation task list, find and click the task.
  5. On the Data Transformation Overview page, view the details of the task.
    Data transformation task
    Parameter Description
    Source Logstore The name of the Logstore from which data is read for transformation.
    Status The status of the task. For more information, see View the status of a task.
    Task ID The ID of the task.
    Time Range The time range within which the task is run.
    Rule Modified At The time when the transformation rule was last modified.
    Task End Time The time when the task ends.
    Note If you do not set End Time when you create the task, the value of this parameter is empty.
    Storage Target The name of the storage destination, the name of the Logstore where transformed data is stored, and the name of the project to which the Logstore belongs.
    Consumption Progress The data consumption progress of the task.
    Status The dashboard that is provided by Log Service to display the statistics about the execution of the transformation rule. The statistics include the overall information, transformation rate, consumption latency, consumption rate, active shards, and exceptions. For more information, see Data transformation dashboard.

View the status of a task

You can view the status of a data transformation task on the Data Transformation Overview page. The following table lists the task states and the operations supported in each state.
State/Action Stop the task Start the task Rerun the task Modify the task Delete the task
Starting Not supported Not supported Not supported Supported Supported
Running Supported Not supported Supported Supported Supported
Stopping Not supported Not supported Not supported Supported Supported
Terminated Not supported Supported Supported Supported Supported
Success Not supported Not supported Supported Supported Supported
Failed Not supported Not supported Supported Supported Supported

Stop a task

If a task is in the Running state, you can click Stop on the Data Transformation Overview page of the task.
Note If a data transformation task is stopped, the system records the checkpoint at which the task is stopped. If the task is started again, data transformation is resumed from this checkpoint. If you want to resume data transformation from the beginning, you must rerun the task. For more information, see Rerun a task.

Start a task

If a task is in the Terminated state, you can click Start on the Data Transformation Overview page of the task.

Rerun a task

You can rerun a task regardless of the task status. You can choose More > Rerun on the Data Transformation Overview page of the task.
Note If you rerun a task, the task is run from the beginning. If you want to continue with a task from the checkpoint at which the task was stopped, you must stop the task and then start the task.

Modify a transformation rule

Note After you modify a transformation rule:
  • If you want to use the new transformation rule to continue with the task, you must stop the task and then start the task.
  • If you want to use the new transformation rule to rerun the task, you must run the task from the beginning. For more information, see Rerun a task.
  1. On the Data Transformation Overview page, click Edit Rules.
  2. Modify the transformation rule based on your business requirements.
    For more information about the rule syntax, see Language introduction.
  3. Preview transformation results.
    1. Select Quick.
      You can select either Quick or Advanced. For more information, see Preview mode overview.
    2. Click Preview Data.
    3. View the results.
      • If data fails to be transformed because the syntax of the transformation rule or configured permissions are invalid, troubleshoot the failure as prompted.
      • If the transformed data is returned as expected, go to 4.
  4. Click Modify Processing Rule.
  5. Modify the settings and click OK.
    For more information about the parameters, see Create a data transformation task.

Delete a task

Warning After you delete a data transformation task, the task cannot be recovered. Exercise caution when you delete a task.
You can delete a task by using one of the following methods:
  • In the data transformation task list, move the pointer over the task that you want to delete and choose More > Delete.
  • On the Data Transformation Overview page, choose More > Delete.

Configure alerts

In the Data Transformation Troubleshooting dashboard of the Data Transformation Overview page, you can view the metrics of the data transformation task, subscribe to the dashboard, or configure monitoring and alerts for the metrics. For more information, see Configure alerts to monitor data transformation tasks.