The feature for shipping data from Simple Log Service to MaxCompute has been upgraded. The new version allows you to start shipping data as soon as a shipping task is created and supports shipping historical data. You can also create multiple MaxCompute shipping tasks per logstore. We recommend using this new version.
Feature comparison
|
Aspect |
MaxCompute shipping (legacy version) |
MaxCompute shipping (new version) |
|
Time range for data shipping |
Supports shipping data immediately after the shipping task is created. |
|
|
Number of tasks |
You can create only one MaxCompute shipping task per logstore. |
You can create multiple MaxCompute shipping tasks per logstore. |
|
Not supported |
Supported |
|
|
Tags |
Not supported |
Supported |
|
Time zone in DateTime mapping |
Not supported |
Supported |
|
Dashboard |
Not supported |
Supported |
|
Monitoring and alerting |
Not supported |
Supported |
|
Task suspension and resumption |
Not supported |
Supported |
|
Time partition format |
Uses the Class SimpleDateFormat format. |
Uses the strftime format. |
|
Invalid field |
The invalid field is displayed as null. |
If a field does not allow null values, Simple Log Service discards the entire row of data. |
Migrate to the new version
The legacy and new versions of MaxCompute shipping tasks can run in parallel and are configured from the same entry point. To migrate to the new version, follow these steps:
-
Stop the legacy MaxCompute shipping task.
-
Create a MaxCompute shipping task (new version).
ImportantWhen you configure the Start At parameter for the new task, we recommend setting the start time 5 to 15 minutes earlier than when you stop the legacy task. The exact time buffer depends on the Shipping Interval of the legacy task. This configuration helps prevent data loss but may result in a small amount of duplicate data.
For example, if the Shipping Interval for the legacy task is 300 seconds and you stop the task at 12:00:00 on December 20, 2023, we recommend setting the Start At time for the new task to 11:55:00 on December 20, 2023.
Supported regions
This feature is available in the following regions.
|
Regions |
|
|
China (Beijing) |
Japan (Tokyo) |
|
China (Chengdu) |
Singapore |
|
China (Hangzhou) |
Malaysia (Kuala Lumpur) |
|
China (Hong Kong) |
Indonesia (Jakarta) |
|
China (Shanghai) |
Germany (Frankfurt) |
|
China (Shenzhen) |
UK (London) |
|
China (Zhangjiakou) |
UAE (Dubai) |
|
US (Silicon Valley) |
US (Virginia) |