This topic describes how to manage a data transformation task in the Log Service console. You can view the details and status of a task, and start, stop, modify, and delete a task in the console.

View task details

  1. Log on to the Log Service console.
  2. In the Projects section, click the target project.
  3. In the left-side navigation pane, click Data Transformation - 001 to enter the Data Transformation page.
  4. Click the target transformation task. On the Data Transformation Overview page, view the details of the transformation task.
    View a transformation task
    Parameter Description
    Source Logstore The name of the Logstore where data is to be transformed.
    Status The status of the data transformation task. For more information, see View task status.
    Task ID The ID of the task.
    Time Range The receiving time range of the data that you need to transform.
    Rule Modified At The time when the data transformation rule was last modified.
    Task End Time The time when the data transformation task ends.
    Note If you do not set End Time when you create the task, the value of this parameter is null.
    Storage Target The logical names of storage targets and the names of the Logstores and projects where the targets are stored.
    Consumption Progress The log consumption progress of the transformation task.
    Status The execution status of the transformation task. This status is indicated by several metrics and displayed on the dashboard that is automatically created when the task is executed. The metrics include the overall information, transformation speed, consumption delay, consumption speed, active shards, and exceptions. For more information, see Data transformation dashboard.

View task status

You can view the status of a transformation task on the Data Transformation Overview page.

The following table lists the available task status and the actions that you can take on tasks of each status.
Status/Action Stop the task Start the task Rerun the task Modify the task Delete the task
Starting Not supported Not supported Not supported Supported Supported
Running Supported Not supported Supported Supported Supported
Stopping Not supported Not supported Not supported Supported Supported
Terminated Not supported Supported Supported Supported Supported
Successful Not supported Not supported Supported Supported Supported
Failed Not supported Not supported Supported Supported Supported

Stop a task

If a task is in the running state, you can click Stop on the Data Transformation Overview page of the task to stop the task.
Note If a transformation task is stopped, the data transformation feature records the checkpoint at which the task is stopped. If the task is started again, data transformation is resumed from this checkpoint. To re-transform data from the position that corresponds to the specified start time, see Rerun a task.

Start a task

If a task is in the Terminated state, you can click Start on the Data Transformation Overview page of the task to rerun the task.
Note After you modify a transformation rule:
  • If you need to use the new transformation rule to continue with the transformation task, you can stop the task and then resume the task.
  • If you need to use the new transformation rule to rerun the task, see Rerun a task.

Rerun a task

You can rerun a task regardless of the task status. On the Data Transformation Overview page of the task, choose More > Rerun.
Note If you rerun a task, the task is run from the beginning. If you need to continue with a transformation task from the checkpoint at which the task was stopped, stop the task and then resume the task.

Modify a rule

  1. On the Data Transformation Overview page of a task, click Edit Rules.
  2. Modify the rule of the task.
    For more information, see Data transformation syntax.
  3. Click Preview Data to preview the data transformation result.
  4. Click Modify Processing Rule.
  5. Modify the rule settings, and then click OK.

Delete a task

Notice After you delete a data transformation task, the task cannot be recovered. Exercise caution when you delete a task.
To delete a data transformation task, perform one of the following operations:
  • In the data transformation task list, find the target task, and choose More > Delete.
  • In the data transformation task list, click the target task. In the upper-right corner of Data Transformation Overview page, choose More > Delete.