New Features

MaxCompute - Enhances Data Writes to OSS External Tables

Feb 08 2021

MaxCompute
MaxCompute allows you to use the multipart upload feature to write data to an external table for Object Storage Service (OSS). The data is directly written to the table directory, excluding the .odps subdirectory.
Content

Target customers: developers, users who want to export data, and users who use third-party engines to read exported data. Features released: If you perform INSERT operations to write data to OSS external tables, MaxCompute allows you to use the multipart upload feature of OSS to make data writes more efficient. In addition, the data written from MaxCompute to an OSS external table is stored in the .odps folder in the LOCATION directory, and a .meta file is maintained to ensure data consistency. The data in the .odps folder can be handled only by MaxCompute. If the data is read by other engines, errors may occur. The odps.sql.unstructured.oss.commit.mode attribute is added to MaxCompute. The default value is false. If the value is true, MaxCompute uses the multipart upload feature to write data and two-phase commit to ensure data consistency. In this case, no .odps directories or .meta files are generated. This allows other data processing engines to read the data.

7th Gen ECS Is Now Available

Increase instance computing power by up to 40% and Fully equipped with TPM chips.
Powered by Third-generation Intel® Xeon® Scalable processors (Ice Lake).

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.