This topic compares the old and new versions of the data shipping feature for MaxCompute. This topic also describes how to update the data shipping feature of the old version to the data shipping feature of the new version.
Comparison between the new and old versions
| Item | Data shipping feature for MaxCompute (old version) | Data shipping feature for MaxCompute (new version) |
|---|---|---|
| Time range for data shipping | Data that is generated at and after the time when a data shipping job is created can be shipped. |
|
| Job quantity | You can create only one data shipping job in a Logstore to ship data to MaxCompute. | You can create multiple data shipping jobs in a Logstore to ship data to MaxCompute. |
| MaxCompute V2.0 data type edition | Not supported. | Supported. |
| Tags | Not supported. | Supported. |
| Time zone in DateTime mapping | Not supported. | Supported. |
| Dashboard | Not supported. | Supported. |
| Monitoring and alerting | Not supported. | Supported. |
| Job suspension or resumption | Not supported. | Supported. |
| Time partition format | The Class SimpleDateFormat format is used. | The strftime format is used. |
| Invalid field | Null is displayed for invalid fields. | If Null is not allowed, the entire row is discarded. |
Update to the new version
The old and new versions of data shipping jobs can run at the same time. You can use the same procedure to create a data shipping job of the new version and a data shipping job of the old version. To update to the new version, perform the following steps:
- Stop the data shipping job of the old version.
- Create a data shipping job of the new version.
For more information, see Create a data shipping job of the new version to ship data to MaxCompute.Important When you configure the Start At parameter for a data shipping job of the new version, we recommend that you set the start time to a point in time that is 5 to 15 minutes earlier than the time when the data shipping job of the old version is stopped. The time depends on the Shipping Interval parameter in the data shipping job of the old version. This setting can help you prevent data loss but may cause a small amount of duplicate data to be shipped.
For example, if the Shipping Interval parameter in the data shipping job of the old version is set to 1800s and you stop the job at 12:00:00 on December 20, 2021, we recommend that you set the Start At parameter in a data shipping job of the new version to 2021-12-20 11:55:00.