After you create a data transformation job in Simple Log Service, you can view job details, check job status, and perform operations such as stopping, starting, rerunning, modifying, or deleting the job. You can also configure alert rules to monitor the job.
View job details
Log on to the Simple Log Service console.
In the Projects section, click the project that you want to manage.
In the left-side navigation pane, choose Job Management > Data Transformation.
Click the data transformation job that you want to manage.
On the Data Transformation Overview page, review the job details. The following table describes the parameters on this page.
Parameter Description Source Logstore The Logstore from which data is read for transformation. Status The current state of the job. For more information, see Job states and supported operations. Job ID The unique identifier of the job. Time Range The time range within which the job runs. Job Created At The time when the job was created. Job Modified At The time when the job was last modified. Job Ended At The time when the job ends. This field is empty if you did not set the Processing End Time parameter when you created the job. Storage Destination The name of the storage destination, the destination Logstore, and the project to which the Logstore belongs. Consumption Progress The data consumption progress of the job. Status (dashboard) A built-in dashboard that displays execution statistics, including overall information, transformation rate, consumption latency, consumption rate, active shards, and exceptions. For more information, see Data transformation dashboard.
Job states and supported operations
The Data Transformation Overview page displays the current state of the job. The following table lists each state and the operations it supports.
| State | Stop | Start | Re-run | Modify | Delete |
|---|---|---|---|---|---|
| Starting | -- | -- | -- | Supported | Supported |
| Running | Supported | -- | Supported | Supported | Supported |
| Stopping | -- | -- | -- | Supported | Supported |
| Stopped | -- | Supported | Supported | Supported | Supported |
| Success | -- | -- | Supported | Supported | Supported |
| Failed | -- | -- | Supported | Supported | Supported |
Stop a job
To stop a running job, choose Actions > Stop on the Data Transformation Overview page.
When you stop a job, the system records the current checkpoint. If you start the job again, it resumes from that checkpoint. To restart processing from the beginning, rerun the job instead. For more information, see Re-run a job.
Start a job
To start a stopped job, click Start on the Data Transformation Overview page.
Re-run a job
To rerun a job from the beginning regardless of its current state, choose Actions > Re-run on the Data Transformation Overview page.
Rerunning a job restarts it from the beginning. To resume from the last checkpoint, stop the job and then start it instead.
Modify the transformation rule
After you modify the transformation rule, apply the change by using one of the following methods:
To continue from the current progress with the new rule, stop the job and then start it.
To reprocess all data with the new rule, rerun the job. For more information, see Re-run a job.
On the Data Transformation Overview page, click Edit Rule.
Modify the transformation rule as needed. For more information about rule syntax, see Language introduction.
Preview the data.
Select Quick. You can select Quick or Advanced. For more information, see Preview mode overview.
Click Preview Data.
Review the results.
If transformation fails due to invalid syntax or permissions, troubleshoot based on the error message.
If the transformed data looks correct, proceed to the next step.
Click Modify Transformation Settings.
Update the parameters and click OK. For more information about the parameters, see Create a data transformation job.
Delete a job
A deleted job cannot be restored. Proceed with caution.
To delete a data transformation job, use either of the following methods:
In the job list, click Delete in the Actions column of the target job.
On the Data Transformation Overview page, choose Actions > Delete.
Configure alert rules
The Data Transformation Overview page includes the Data Transformation Troubleshooting dashboard, where you can view job metrics, subscribe to the dashboard, and configure alert rules for monitoring. For more information, see Enable monitoring for data transformation jobs.