| 2021-02-23 |
Example of how to use a Python 2 UDTF to read resources from MaxCompute |
New example |
An example of how to use a Python 2 user-defined table-valued function (UDTF) to read
resources from MaxCompute is added.
|
Python 2 UDFs |
| 2021-02-23 |
Example of how to use a Python 3 UDTF to read resources from MaxCompute |
New example |
An example of how to use a Python 3 UDTF to read resources from MaxCompute is added.
|
Python 3 UDF |
| 2021-02-23 |
External files referenced by Spark jobs |
New description |
The description that Spark jobs reference external files is added. |
Set up a Spark on MaxCompute development environment |
| 2021-02-20 |
Example of how to use a UDTF with LATERAL VIEW |
New example |
An example of how to use a UDTF with LATERAL VIEW is added. |
UDTF usage |
| 2021-02-09 |
Deletion of user permissions |
New description |
The description of deleting user permissions is added. |
User management |
| 2021-02-07 |
Removal of the limit that only constants can be used in VALUES |
Updated description |
The limit that only constants can be used in VALUES is removed. |
VALUES |
| 2021-02-07 |
Multipart upload of OSS external tables |
New description |
The multipart upload feature of Object Storage Service (OSS) is supported. This feature
allows you to perform the INSERT operation to write data to OSS external tables.
|
Output data to OSS |
| 2021-02-07 |
ARRAY_INTERSECT and SORT_ARRAY functions
|
New description |
The ARRAY_INTERSECT function is added to calculate the intersection of two arrays.SORT_ARRAY function. This parameter specifies whether to sort the given arrays in ascending
or descending order. The default value of this parameter is True, which indicates
that given arrays are sorted in ascending order.
|
Other functions |
| 2021-02-07 |
Filter expressions and the COUNT_IF function
|
New description |
Filter expressions are supported. You can specify filter conditions for an aggregate
function in a SELECT clause. This helps you separately control the data range of the aggregate function
in an aggregate statement. The COUNT_IF function is added to count the number of data records that meet the IF condition.
|
Aggregate functions |
| 2021-02-07 |
Support for the DATE and TIMESTAMP data types by date functions DATEADD, DATE_ADD, DATEDIFF, DATEPART, and DATETRUNC |
New description |
The date functions DATEADD, DATE_ADD, DATEDIFF, DATEPART, and DATETRUNC are enhanced to support the DATE and TIMESTAMP data types.
|
Date functions |
| 2021-02-07 |
BASE64, UNBASE64, and PARSE_URL functions
|
New description |
The string function PARSE_URL is added to parse URLs. The BASE64 and UNBASE64 functions are added to implement conversions between binary strings and Base64-encoded
strings.
|
String functions |
| 2021-02-07 |
Disabling of header display in the MaxCompute command line to facilitate shell calls
|
New description |
In a shell window or in the Windows command line, you may need to use the dynamic
return value that is obtained by executing the odpscmd -e SQL statement. The variable of shell can obtain this dynamic return value and then run
subsequent jobs in shell. This scenario requires that the return value not contain
additional information such as the running information or a table header. You can
run set odps.sql.select.output.format={needHeader:false,fieldDelim:""}; to disable header display and export the standard output from the calculation result
to the destination handle.
|
MaxCompute client |
| 2021-02-07 |
Data export from MaxCompute to OSS by using UNLOAD |
New feature |
MaxCompute allows you to export data to OSS by using the UNLOAD command. This way,
you can use OSS to store structured data and use other computing engines in OSS to
process and analyze the data exported from MaxCompute.
|
UNLOAD |
| 2021-02-07 |
SKEWJOIN HINT |
New feature |
If two tables that you want to join contain hot key values, a long tail may occur.
In this case, SKEWJOIN HINT can be used to automatically or manually extract hot key
values from the two tables, separately calculate the join results of the hot key values
and non-hot key values, and then join the calculated data. This accelerates the JOIN
operation.
|
SKEWJOIN HINT |
| 2021-02-07 |
Reading and writing Hologres data by using the JDBC driver |
New feature |
You can use external tables of MaxCompute to access data of Hologres data sources
by using the Java Database Connectivity (JDBC) driver provided by PostgreSQL. You
can create a Hologres external table in MaxCompute to query data of a Hologres data
source by using the JDBC driver provided by PostgreSQL. This method prevents redundant
data storage and allows you to obtain query results at a fast speed without the need
to import or export data. Reading and writing data of Hologres external tables is
in the public preview stage. Data computing is free of charge but the Service Level
Agreement (SLA) is not guaranteed.
|
MC-Hologres external tables |
| 2021-02-01 |
Change records of Mars V0.6.3 |
New description |
Change records of Mars V0.6.3 are added. |
Version updates |