All Products
Search
Document Center

Data Management:Release notes

Last Updated:Jan 04, 2024

This topic describes the release notes for Data Management (DMS) and provides links to the relevant references.

Release notes

2023

November

Feature

Change type

Description

References

Configuration item for unauthorized approval

New feature

The configuration item of allowing unauthorized users to approve tickets for workflows is added. After you enable this configuration item, you can authorize specific users who do not have the required permissions to approve the specified types or all types of tickets.

Configuration management

August

Feature

Change type

Description

References

Unsubscription

New feature

You can unsubscribe from the billable features provided by the new version of DMS in the DMS console or on the Unsubscribe page in User Center.

Unsubscribe from billable features

July

Feature

Change type

Description

References

Configure approval processes

New feature

DMS supports transferring an approval ticket to others and adding an approval node before or after an approval node.

Support for configuring approval processes

June

Feature

Change type

Description

References

Task orchestration

New feature

When the scheduling cycle is set to Hour, you can schedule tasks within a specified time range.

Overview

May

Feature

Change type

Description

References

Data archiving

New feature

The data archiving feature of DMS allows you to perform multiple operations. For example, you can regularly archive the data of large tables to other databases, delete the data from source tables, and optimize the storage usage of source tables.

System database blocking in DMS

New feature

You can block system databases by configuring custom security rules in DMS. After the system databases are blocked, DMS does not collect the metadata of the blocked databases and you cannot view or search for these databases in DMS.

Block system databases in DMS

April

Feature

Change type

Description

References

Management of data archived in dedicated storage

New feature

You can delete the archived data from dedicated storage.

Delete the archived data from dedicated storage

February

Feature

Change type

Description

References

Instance management

Optimized feature

  • The Add Instance dialog box is optimized from the following aspects:

    • Data sources are divided into the following two types: Alibaba Cloud databases such as an ApsaraDB RDS for MySQL instance, and databases hosted on third-party clouds or self-managed data warehouses such as a ClickHouse data warehouse.

    • You can view the description message that appears if you move the pointer over a control mode. The message indicates the description or scenarios of the control mode.

  • In the instance list, you can filter instances by instance source.

January

Feature

Change type

Description

References

Classification and grading templates

Feature update

This feature is fully released with a number of interaction updates.

Manage DMS classification and grading templates

2022

December

Feature

Change type

Description

References

Instance registration

Optimized feature

You can add instances of the Lindorm HBase database type to DMS.

Sensitive data management

New feature

You can configure DMS classification and grading templates and modify the description of detection rules.

Log export

New feature

You can export operation logs to Alibaba Cloud Log Service in the DMS console. This allows you to perform statistical analysis on the DMS operation logs in Log Service.

Export the operation logs of DMS to Log Service

August

Feature

Change type

Description

References

Simple mode

New feature

The console in the simple mode is tidy and easy to navigate. You can search for database instances without the need to switch to the console homepage.

Simple mode

July

Feature

Change type

Description

References

Data watermark

New feature

Watermark embedding and watermark extraction are supported.

  • Watermark embedding: Identification information is embedded into data or a file as a watermark to identify the data or file.

  • Watermark extraction: DMS provides the watermark extraction feature that allows you to check whether files are embedded with unperceivable watermarks.

Use data watermarks

Permission template

New feature

Resources such as instances, databases, and tables that have the same business attributes can be added to a permission template, and one or more users can be authorized to manage the resources in the permission template. By using a permission template, you no longer need to find the required users and resources one by one from a large number of users and resources or perform repeated operations to authorize the users to manage the resources.

Create a permission template

March

Feature

Change type

Description

References

Console of DMS Personal Edition

Discontinuation

The console of DMS Personal Edition is discontinued and replaced by DMS console V5.0 after March 31, 2022.

[Notice] Service discontinuation of the old version of DMS Personal Edition on July 31, 2023

Previous version of the DMS console

Discontinuation

The previous version of the DMS console is discontinued and replaced by DMS console V5.0 after July 31, 2023.

What is DMS?

February

Feature

Change type

Description

References

Database migration

New feature

Service solutions can be encapsulated by using the database migration feature to migrate databases, perform checks, and delete the migrated source databases. In addition, the names of destination databases can be changed, whether database migration requirements are met before migration or whether the data in the source and destination databases is consistent after migration can be checked, and the migrated source databases can be deleted. This ensures the integrity of database migration throughout the lifecycle.

Database migration

Data warehouse development

New feature

Projects can be managed by workspace, business scenario, and task flow. Data warehouses can be managed at the layer level by using the data warehouse development feature. This facilitates data warehouse management in specific business scenarios and meets the complex requirements for data warehouse development and management.

Create a workspace

January

Feature

Change type

Description

References

Sensitive data audit

New feature

The sensitive data audit feature is supported to record the use of sensitive data in DMS.

Audit sensitive data

Progress of a lock-free schema change

New feature

The progress of a lock-free schema change can be viewed.

View the execution progress of a lock-free change task

Dependency check nodes in task orchestration

New feature

Dependency check nodes can be configured to allow a task flow to depend on the result of its previous cycle or another task flow.

Configure a dependency check node for a task flow

2021

November

Feature

Change type

Description

References

Custom layout and style of the DMS console

New feature

You can configure the skin and interaction interface of the DMS console.

Customize the layout and style of the DMS console

Support for Object Storage Service (OSS) buckets

New feature

You can register an OSS bucket with DMS. You can use an OSS bucket as the destination of data output nodes in offline data integration tasks or create cross-database Spark SQL nodes for the OSS bucket in the task orchestration module.

Register an OSS bucket

October

Feature

Change type

Description

References

Sensitive data protection feature

Feature iteration

The sensitive data protection feature is updated and released as a commercial feature. You can use the sensitive data protection feature to scan the metadata of databases to detect, mask, and manage sensitive data.

Overview

September

Feature

Change type

Description

References

Hologres and Db2 databases

New feature

DMS allows you to manage Hologres and Db2 databases and user permissions on the databases.

Supported database types and features

Conditional branch node

New feature

You can use a conditional branch node to perform conditional judgment in a task flow. This allows the task flow to run specific subsequent tasks based on specific conditions.

Configure a conditional branch node

SQL assignment node

New feature

An SQL assignment node can read data and assign the data to an output variable of the node.

Configure an SQL assignment node

August

Feature

Change type

Description

References

DMS V5.0

Feature iteration

The DMS console V5.0 classifies features based on scenarios and integrates the features of Data Transmission Service (DTS).

Switch between the previous and new versions of the DMS console

July

Feature

Change type

Description

References

Offline integration

New feature

The offline integration feature provides a low-code tool that you can use to develop data processing tasks. You can combine various task nodes to form a data stream and configure periodic scheduling to process or synchronize data.

Overview

DevOps

New feature

The DevOps feature allows you to customize R&D processes, advance R&D processes stage by stage, and control the quality of R&D processes.

May

Feature

Change type

Description

References

Script node

New feature

You can use script nodes and Database Gateway to schedule scripts in a unified manner.

Configure a script node

PostgreSQL database

New feature

DMS allows you to manage ApsaraDB RDS for PostgreSQL and AnalyticDB for PostgreSQL databases and user permissions on the databases.

April

Feature

Change type

Description

References

Dameng (DM) database

New feature

DMS allows you to perform various operations on a DM database. For example, you can import, query, change, export, and visualize data for a DM database. In addition, you can provide data services based on a DM database.

Supported database types and features

Category

New feature

The category feature can be used to classify tables. This helps DMS administrators, developers, and O&M engineers better manage and use tables.

Use the asset category feature

Tables page

Optimized feature

DMS allows you to view the technical metadata, business metadata, and management metadata of a table on the Tables page. Technical metadata includes the database instance and database to which the table belongs and the table name and fields. Business metadata includes the business description and tags of the table. Management metadata includes the owner of the table and your permissions on the table. DMS also allows you to perform specific management operations on a table on the Tables page. The Tables page can help you fully understand and efficiently use the data of a table.

Manage table details

Schema read-only role

New feature

In addition to the permissions that a regular user has, a user who is assigned the schema read-only role can query the metadata of a database instance, a database, and a table, to view the details of a table or export the schemas of a database. However, a user who is assigned the schema read-only role must apply for the query permissions to query data.

System roles

March

Feature

Change type

Description

References

Task flow management

Optimized feature

After you configure or modify a task flow, you must publish the latest task flow to an online environment. This effectively prevents the modified task flow from being published before the modifications to the task flow are confirmed.

Publish or unpublish a task flow

SQL result set export

New feature

SQL result sets can be exported at regular intervals. This way, you can configure the system to automatically export relevant data after specified operations are performed.

Export SQL result sets

Syntax prompts for Redis in the SQLConsole tab

Optimized feature

The syntax prompts for Redis are supported in the SQLConsole. In addition, DMS allows you to enable the super SQL mode for ApsaraDB for MongoDB and ApsaraDB for Redis databases.

Overview

SQL review

Optimized feature

You can use the SQL review feature to review the submitted SQL statements and obtain optimization suggestions. This prevents the SQL statements that do not use indexes or do not conform to standards from being published to an online environment. This also reduces the risk of SQL injection attacks.

SQL review

Data analysis

Optimized feature

The data analysis feature allows you to go to the details page of a task in DTS within a few clicks.

Create data warehouses

February

Feature

Change type

Description

References

Data analysis

New feature

You can use the data analysis feature to create an AnalyticDB for MySQL V3.0 data warehouse with a few clicks from an ApsaraDB RDS for MySQL database. You can create reports, run recurring tasks, and visualize data in the data warehouse.

Create data warehouses

Data archiving

New feature

You can use the data archiving feature to periodically archive the data that is stored in ApsaraDB RDS for MySQL or PolarDB for MySQL databases to OSS.

Archive data to OSS buckets connected to DBS

January

Feature

Change type

Description

References

Risk audit report

New feature

DMS allows you to generate risk audit reports for database instances. Risk audit reports collect and assess various risks that are involved in the O&M of database instances. Risk audit reports also provide optimization suggestions for you to improve the security and stability of your instances.

Generate a risk audit report

Schema version management

New feature

In DMS, the schema versions of a table in a database can be saved. After you change the schema of a table in a database in DMS, DMS adds the latest schema to the schema version list of the database. You can download and compare schema versions and restore an earlier schema version in the schema version list.

Manage schema versions

Super SQL mode

New feature

After you enable the super SQL mode as a DMS administrator or a database administrator (DBA), all SQL statements that you execute on the SQLConsole tab are executed without being limited by security rules.

Use the super SQL mode

SQL review

Optimized feature

You can use the SQL review feature to review SQL statements that perform lockless changes and obtain optimization suggestions. This feature is available for the instances that are managed in Flexible Management mode.

SQL review

Data factory

Optimized feature

The SQL editor that is used to edit the code of task nodes in task orchestration and data warehouse development is optimized. The SQL editor supports intelligent code completion.

Configure a task flow

2020

December

Feature

Change type

Description

References

Features in the top navigation bar

New feature

You can add your frequently used features to the top navigation bar. This allows you to use these features with ease.

Customize the layout and style of the DMS console

Shadow table synchronization

New feature

DMS provides the shadow table synchronization feature to automatically create a shadow table based on the schema of a source table. DMS generates the name of the shadow table by attaching a prefix or suffix to the name of the source table. You can use this feature for end-to-end stress testing.

Create shadow tables for synchronization

Validity periods for the maximum number of queries and the maximum number of rows that can be queried

Optimized feature

When you manage users, you can configure the validity periods for the maximum number of queries that a user can perform and the maximum number of rows that can be queried. This allows you to restrict queries in a short time period.

Manage users

SQL template

Optimized feature

SQL templates are provided in the right-side panel of the SQLConsole tab. A large number of common scripts such as SQL statements, programmable objects, and functions are provided.

Overview

User permissions on MariaDB databases

New feature

DMS allows you to manage user permissions on MariaDB databases.

Manage user permissions on MySQL databases

User permissions on AnalyticDB for MySQL databases

New feature

DMS allows you to manage AnalyticDB for MySQL databases and user permissions on the databases.

Manage user permissions on MySQL databases

Schema design

Optimized feature

The GUI that is used for schema design is improved.

Design schemas

Task orchestration

Optimized feature

You can view the status statistics about task flows and the task flow list on the homepage of the Task Orchestration tab. You can also create a task flow from a template.

Configure a task flow

Notification

Optimized feature

By default, the notification feature is enabled. This allows relevant contacts to receive notifications at the earliest opportunity.

Manage notification rules

November

Feature

Change type

Description

References

Operation audit

Optimized feature

DMS provides the operation audit feature in addition to the basic features of operation log management. You can use the operation audit feature to view and manage tickets, logon information, operation logs, and the SQL statements that were executed in the SQLConsole. You can also use the operation audit feature to troubleshoot database issues with ease and audit the operations that were performed on databases.

Audit operations

Optimization suggestions in the SQL review feature

New feature

After you submit SQL statements for data changes or on the SQLConsole tab, DMS reviews the submitted SQL statements based on the specifications in security rules and provides optimization suggestions. This can help you review SQL statements and optimize the submitted SQL statements before data changes are submitted. This can also prevent database exceptions from being caused by SQL statements that have potential issues.

SQL review optimization

ApsaraDB for Lindorm and ApsaraDB for Cassandra databases

New feature

DMS allows you to manage ApsaraDB for Lindorm and ApsaraDB for Cassandra databases in a centralized manner. You can register ApsaraDB for Lindorm and ApsaraDB for Cassandra instances with DMS. You can also manage permissions and sensitive fields, query data by executing SQL statements, and update data in the databases.

Supported database types and features

Alibaba Cloud Security Token Service (STS) token

New feature

You can use STS to assign a token to a self-managed O&M platform. Then, the platform can access databases that are managed in DMS without logon.

N/A

October

Feature

Change type

Description

References

Data import

New feature

You can select the import mode, the file type, or the execution policy as needed. This can improve the efficiency of data import.

Import data

DMS Database Lab on the Alibaba Cloud International site (alibabacloud.com)

New feature

DMS Database Lab is available on the Alibaba Cloud International site (alibabacloud.com).

N/A

September

Feature

Change type

Description

References

Notification

New feature

  • DMS supports a variety of notification methods, such as DingTalk notifications, text messages, emails, and DingTalk chatbot messages.

  • DMS can send notifications about the status updates of tickets and task flows to users.

Manage notification rules

August

Feature

Change type

Description

References

Metadata access control

New feature

After you enable the metadata access control feature for an instance or a database, only authorized users can view metadata of the instance or database. This further enhances data security.

Metadata access control

Sharing of tickets and the SQLConsole tab of databases

Optimized feature

DMS allows you to share the SQLConsole tab of a database or a ticket with other users by generating a share link. This enhances the efficiency of a business team.

Share the SQLConsole tab or a ticket

Database grouping

New feature

DMS allows you to add databases that are of the same engine type and deployed in the same environment to a database group. Then, you can apply a data change or a schema change to the databases at a time.

Database grouping