This topic describes how to manage a data transformation job (new version) in the Simple Log Service console. You can view the details and status of a job in the console. You can also start, stop, modify, and delete the job.
View the details of a data transformation job
Log on to the Simple Log Service console.
In the Projects section, click the project that you want to manage.
In the left-side navigation pane, choose .
In the list of data transformation jobs, find and click the data transformation job that you want to manage.
On the Data Processing Overview(New Version) page, view the details of the data transformation job.
Parameter
Description
Display Name
The display name of the data transformation job.
Job Name
The name of the data transformation job, which is unique in a project.
Job ID
The ID of the data transformation job.
Source Logstore
The name of the Logstore from which data is read for transformation.
Job Status
The status of the data transformation job. For more information, see ETL.
Job Created At
The time when the data transformation job was created.
Job Modified At
The time when the data transformation job was last modified.
Time Range for Data Transformation(Data Receiving Time)
The time range within which the data transformation job is run.
Storage Destination
The destination to which data transformation results are written, including the name of the storage destination, the name of the project to which the Logstore belongs, the name of the Logstore in which the transformed data is stored, and the result set written to each destination.
View the status of a data transformation job
You can view the status of a data transformation job on the Data Transformation Overview(New Version) page. The lifecycle and status of a data transformation job are related to job configurations and operations. For more information, see ETL. The following list describes the job states and the operations that are supported in each state.
If you do not specify an end time (data receiving time) for a data transformation job, the data transformation job does not stop. Running instances continue consuming log data and the job remains in the Running state.
If you specify an end time (data receiving time) for a data transformation job, instances exit after all data written before the end time is processed. After all instances exit, the job changes to the Successful state.
A job enters the Stopped state when it is stopped and enters the Error state when it encounters errors such as an invalid Structured Process Language (SPL) statement. The job continues to consume the log data from checkpoint at which the job is stopped after the job is restarted.
Stop a data transformation job
To stop a data transformation job that is in the Running state, choose on the Data Transformation Overview(New Version) page of the job.
If a data transformation job is stopped, the system records the checkpoint at which the job is stopped. If the job is started again, data transformation is resumed from this checkpoint. If you want to resume data transformation from the beginning, you must rerun the job. For more information, see Rerun a data transformation job.
Start a data transformation job
To start a data transformation job that is in the Stopped state, click Start on the Data Transformation Overview(New Version) page of the job.
Modify the transformation rule of a data transformation job
After you modify a data transformation job (new version), restart the job for the new job configurations to take effect.
On the Data Transformation Overview(New Version) page, click Edit Rule.
Modify the transformation rule based on your business requirements.
For more information about the rule syntax, see SPL instructions.
Preview transformation results.
On the Raw Data tab, click Add Test Data. You can also manually enter test data on the Test Data tab.
Click
to debug the SPL statement. For more information, see Debug SPL rules.
Click Modify Transformation Settings.
Modify the parameter settings and click OK.
For more information about the parameters, see Create a data transformation job.
Delete a data transformation job
After you delete a data transformation job, the job cannot be restored. Proceed with caution.
You can delete a data transformation job by using one of the following methods:
In the list of data transformation jobs, move the pointer over the data transformation job that you want to delete and choose
> Delete. On the Data Transformation Overview(New Version) page, choose .
Rerun a data transformation job
You can rerun a data transformation job regardless of the job status. To rerun a data transformation job, choose on the Data Transformation Overview(New Version) page of the job.
If you rerun a data transformation job, the job is run from the beginning instead of the checkpoint at which the job was stopped.