MaxCompute - External Tables Support the Compression Formats of Snappy and LZO
Mar 16 2021
MaxComputeContent
Target customers: developers. Features released: Your data file is stored in OSS in a TEXTFILE format, such as JSON. You want to use external tables to read and write this file and want the file to be compressed. To achieve this, MaxCompute now allows the external tables that store data in open source formats to read and write files in the Snappy and LZO formats. If your file is an LZO file, external tables determine the compression algorithm based on the file name extension and read the data. To write data in the LZO format into an external table, you must add LZO configuration items when you create the table. If your file is a Snappy file, external tables use Hadoop-Snappy, the default decompression algorithm of Hadoop, to read data. To write data in the Snappy format into an external table, you must add Snappy configuration items when you create the table. You can also use the raw Snappy compression algorithm to read and write files in the raw Snappy format.