Data Management (DMS) is a one-stop data management platform that you can use to manage data throughout the lifecycle of the data. DMS can help you mine value from data in an efficient and secure manner and promote the digital transformation of your enterprise.
Left-side navigation pane
You can add or import database instances as a database administrator (DBA) or DMS administrator.
Database instance search
You can search for a database instance by name, database name, endpoint, or database link name.
Top navigation bar
Alibaba Cloud tickets
If an exception occurs when you use DMS, you can submit a ticket.
You can perform multiple operations in the user center. For example, you can add funds to your Alibaba Cloud account, manage renewals, and view orders and bills. You can also activate, renew, and upgrade the services of DMS.
You can configure the language of the DMS console.
You can configure the skin and interaction interface of the DMS console.
You can view the username, UID, role, tenant ID, and tenant name of your account. You can also configure and modify the notification methods and log off from the DMS console. If your Alibaba Cloud account belongs to multiple tenants, you can switch between these tenants.
You can search for a database, a database instance, a table, a feature, or a ticket.
You can easily access the asset dashboard, import or create a database instance, and analyze data.
You can easily go to the My Tickets tab.
You can easily go to the DevOps tab to view the iterations that you create or the iterations in which you participate.
Recently accessed assets
You can easily go to the SQL Console tab of the databases that are recently accessed. You can also view the performance and details of the databases.
Assets on which you have permissions
You can view all permissions that you have. These permissions include the permissions on databases, tables, sensitive columns, database instances, rows. You can release permissions that you no longer need and apply for permissions that are about to expire.
Assets that belong to you
You can easily view the resources that you own and the permissions that each user has on the resources. You can also grant permissions on the resources to a user and revoke permissions on the resources from a user.
Assets that you follow
You can easily access the databases and tables that you follow.
You can search for a database, a database instance, a table, a feature, or a ticket.
You can view the dependencies between tables, between fields, and between tables and fields in SQL statements in diagrams and tables in a clear, visual manner.
You can add database instances, databases, and tables to different categories. This way, DMS administrators, developers, and O&M personnel can manage and use tables in an efficient manner.
Visual operation section
You can view all tables, fields, and indexes of the current database. You can also right-click a table in the database to modify the schema of the table, import data into the table, or export data from the table. You can create, view, execute, and manage programmable objects, such as views, stored procedures, functions, triggers, and events.
SQL execution section
You can write, format, execute, and diagnose SQL statements. You can also modify a result set and update the execution plan of SQL statements. This section provides the intelligent SQL completion prompt feature and allows you to add and manage commonly used SQL statements.
Execution result section
You can view the execution results and execution history of SQL statements. The execution results are displayed as a table. You can export the result set to an EXCEL or a TEXT file and generate INSERT scripts for the result set. You can also copy and download a single row or multiple rows of the result set.
You can view table schemas and indexes and perform operations on tables. For example, you can apply for permissions on tables, apply to be data owners, adjust data owners, view table details, export statements that are used to create tables, export table schemas, archive data, and adjust the sensitivity levels of fields. You can also use a code generator to produce simple code. This way, the code workload of developers is reduced.
You can build an enterprise-level data warehouse with a few clicks. This way, data from ApsaraDB RDS for MySQL instances can be synchronized to AnalyticDB for MySQL V3.0 clusters in real time. AnalyticDB for MySQL V3.0 provides features such as data analysis, report development, periodic scheduling, and data visualization to help you fully extract the value of data.
Database performance analysis
Database Autonomy Service (DAS) provides the quick diagnostics, real-time performance, real-time session, and storage analysis features. These features help you achieve a unified view of database status and troubleshoot existing issues at the earliest opportunity to ensure service security and stability.
You can collect the most recent metadata of a database, such as tables, fields, indexes, and programmable objects. This way, you can manage permissions on tables, fields, and programmable objects based on different security levels.
You can export the data, schemas, and table creation statements of a database.
DMS automatically records each database version in the database version list. You can view the table creation statements for each version. You can also obtain the differences between two versions and generate scripts to fix the inconsistencies. This way, you can manage different database versions in an efficient manner.
You can audit information such as SQL queries, tickets, and logon records for a single database. This way, you can troubleshoot database issues in an efficient manner.
You can identify the risks that are related to metadata, sensitive data, and SQL statements to improve the security and stability of databases.
You can share the URL of the SQL Console tab of a database and the SQL statements on the tab with other users.
Super SQL mode
DMS administrators or DBAs can enable this mode. In this mode, all SQL statements that you submit on the SQL Console tab are executed regardless of the security rules. This mode is suitable for O&M and emergency handling.
You can view the physical databases that comprise the current logical database.
You can query data in databases and tables across database instances in a convenient manner.
You can follow the settings of an R&D process to design schemas that meet the R&D specifications for specific databases and tables. You can customize R&D processes for different lines of business based on your business requirements to ensure the consistency of schemas among multiple environments, such as the development environment, test environment, and production environment.
You can compare the schemas of different databases and generate scripts that can be executed in a specific database to fix inconsistencies. You can use this feature to compare and synchronize the schemas of databases in different environments, such as databases in a production environment and a test environment, databases in different test environments, or databases in different production environments.
Shadow table synchronization
DMS can automatically create a shadow table based on the schema of a source table. DMS attaches a prefix or a suffix to the name of the source table to generate the name of the shadow table. You can use this feature for end-to-end stress testing.
Empty database initialization
You can synchronize the schemas of the source database to an empty database that does not contain tables. This way, you can efficiently synchronize schemas between databases. You can use this feature to synchronize the schemas of databases that are deployed across multiple regions and units.
Table consistency repairing
You can compare the schemas of tables in different environments, such as the test environment and production environment, find the differences between the schemas, and execute scripts in the specified environment to fix the inconsistencies. You can also use the table consistency repairing feature to ensure consistency between logical databases. For example, you can select a table as the baseline table and check whether other table shards have the same schema as the baseline table.
Regular data change
You can execute SQL statements such as INSERT, UPDATE, DELETE, and TRUNCATE statements to update data in databases. You can modify normal data in scenarios such as data initialization, historical data deletion, troubleshooting, and feature testing.
You can use the lock-free change feature that is based on DML to split a single SQL statement into multiple batches for execution in the DMS console. This can better meet the requirements for large-volume data changes, such as historical data deletion and field updates in a full table. This also ensures execution efficiency and reduces the impact on database performance and database space. You can use the lock-free change feature that is based on DDL to change schemas without the need to lock tables. You can use this feature to prevent business interruptions that can be caused by table locking during schema changes. You can also use this feature to prevent latency for data synchronization between primary and secondary database instances. The latency occurs when schemas are changed by using native online DDL operations.
Historical data deletion
You can periodically delete historical data based on the lockless change feature to prevent an accumulation of historical data. An accumulation of historical data can affect the stability of the production environment.
You can change stored procedures. DMS provides a standardized management process to control the change operations.
You can quickly import a large amount of data to databases. This way, the costs of labor and material resources are reduced.
SQL result set export
You can write and execute SQL query statements and export the result sets.
You can export a database or specific tables. You can also export only the schemas of a database or specific tables or export table data to extract data for analysis.
SQL review tickets
DMS reviews the submitted SQL statements based on security rules and provides optimization suggestions. This feature eliminates SQL statements that do not use indexes or do not conform to database development standards. This feature also helps protect against SQL injection attacks. You can customize SQL specifications in security rules. For example, you can specify that a table must have a primary key, the data type of a primary key column must be restricted, or the number of primary key columns must be restricted.
You can replicate data by cloning databases. You can use this feature to synchronize entire databases or initialize databases across different environments, such as the development environment and test environment.
Test data generation
DMS provides powerful algorithm engines that you can use to generate a large amount of test data, such as random values, region names, and virtual IP addresses. This way, the efficiency of preparing test data is greatly improved.
Data tracking tickets
The data tracking feature can help you find data changes that are made in a specific period of time and export rollback scripts in batches as needed. Then, you need to submit a data change ticket to run the rollback scripts to restore data in a database.
You can use the DevOps feature to customize R&D processes and manage the quality of these processes. This way, the R&D processes are effectively implemented, accidental operations are reduced, and data is protected. The DevOps feature allows you to advance an R&D process stage by stage. You can create specific types of tickets in each iterative stage, which facilitates collaborative development and improves the efficiency of R&D processes.
You can view and approve pending tickets, view the tickets that you have submitted and processed, and view ticket status and ticket details.
Data Transmission Service (DTS)
You can use DTS to migrate data between homogeneous and heterogeneous data sources. This feature is suitable for the following scenarios: data migration to Alibaba Cloud, data migration between instances in Alibaba Cloud, and database splitting and scale-out.
You can use DTS to retrieve incremental data from ApsaraDB RDS for MySQL instances, PolarDB for MySQL instances, PolarDB-X instances, self-managed MySQL databases, and self-managed Oracle databases. Then, you can consume the retrieved incremental data based on your business requirements. This feature is suitable for the following scenarios: cache updates, business asynchronous decoupling, real-time synchronization of heterogeneous data, and real-time data synchronization that involves complex extract, transform, load (ETL) operations.
You can use DTS to synchronize data between data sources in real time. This feature is ideal for the following scenarios: active geo-redundancy, geo-disaster recovery, zone-disaster recovery, cross-border data synchronization, query load balancing, cloud business intelligence (BI) systems, and real-time data warehousing.
The batch integration feature provides a low-code development tool that you can use to develop data processing tasks. You can combine various task nodes to form a data flow and configure periodic scheduling to process or synchronize data. You can use this feature to process complex big data in scenarios such as refined enterprise operations, digital marketing, and intelligent recommendation.
You can extract, transform, process, and load streaming data. This feature helps enrich real-time data processing and computing scenarios and promote the digital transformation of enterprises.
You can use the task orchestration feature to orchestrate various types of tasks and then schedule and run the tasks. You can create a task flow that consists of one or more task nodes. This way, you can schedule tasks in complex scenarios and improve the efficiency of data development.
Data warehouse development
You can use the data warehouse development feature to manage projects by workspace, business scenario, and task flow. You can also use this feature to manage data warehouses by layer. This effectively clarifies the data warehouse management requirements in specific scenarios and can fully meet various complex requirements for data warehouse development and management.
DMS provides the data service feature that you can use to export data that is managed by DMS to external environments. You can use this feature to export the data of a specific row or column to external environments. This way, data exposure is minimized, and data security is ensured.
The data visualization feature provides a three-layer model that you can use to visualize data in various forms. The three layers are datasets, charts, and dashboards or big screens. You can display the results of a single SQL statement in regular charts such as line charts, pie charts, column charts, circular charts, table charts, dual Y-axis charts, and funnel charts. Then, you can combine these charts in the specified layout on a dashboard or big screen to visualize business data based on your analysis idea or methodology. Data visualization helps you gain insights into your business and make informed business decisions.
Heterogeneous database migration (ADAM)
The database evaluation feature performs intelligent evaluation and analysis based on the data that is collected from the source database. Then, the feature generates a report that contains multiple factors, such as database migration solution, compatibility of the destination database, migration risks, application transformation suggestions, and migration costs.
Database transformation and migration
This feature provides intelligent tools for database transformation and migration. This facilitates source database comparison, and schema migration and modification based on analysis results.
Application evaluation and transformation
This feature provides application transformation items to migrate databases, such as focus areas and SQL statements, analyzes application frameworks, and provides architecture migration guidelines. This way, you can transform your application in an efficient manner.
This feature allows you to migrate your service to a cloud database after the database evaluation, database transformation and migration, and application evaluation and transformation are complete.
This feature converts the SQL statements of the source database into the SQL statements that can be used in the destination database. This way, the coding workload of developers during database migration is reduced.
Security and compliance
A tenant can apply for specific operation permissions on a specific database instance, database, table, column, or row. After the application is approved, the tenant can perform operations that are allowed in the permissions. The operation permissions include the query, change, and export permissions. The control permissions include logon permissions on database instances, performance view permissions, database permissions, table permissions, sensitive column permissions, data row permissions, and programmable object permissions.
Security rules are a collection of rules that can be used to control databases in a fine-grained manner. When you query, export, or change data in the DMS console, security rules are used to regulate your behavior. This helps create database operation specifications and R&D processes.
Approval processes are associated with security rules. You can select or configure different approval processes for different user behaviors. A single approval node constitutes a stage. DMS allows you to add, edit, and delete approval nodes. You can add one or more approvers to an approval node.
IP address whitelists
IP address whitelists allow you to effectively control the range of users who can access DMS. You can use IP address whitelists to allow only the users from specific trusted network environments to access DMS.
You can query the SQL statements that were executed on the SQL Console tab, tickets, logon records, and operation logs. This way, you can easily troubleshoot database issues and collect data for operation audit.
Sensitive data management
Sensitive data assets
Sensitive data audit
This feature records the usage of sensitive data in DMS. This helps you trace the abnormal usage and data breaches of sensitive data.
This feature allows you to embed watermarks into data or files and extract watermarks from files. This feature is used to trace the source of data during dissemination or distribution.
As the amount of data in your database increases, table queries may slow down and your business may be affected. This feature allows you to archive data of large tables from one database to another database at the scheduled time. You can also use this feature to delete archived data from large tables and recycle the storage that is occupied by large tables.
This feature allows you to create a real-time data warehouse with a few clicks. You can synchronize data to an AnalyticDB for MySQL database within seconds. This helps you obtain accurate and up-to-date information about your business and facilitates business analysis and decision-making. This way, the performance of the business is improved.
T+1 full data snapshots
This feature allows you to create snapshots for a table on an hourly or daily basis.
Intelligent search and recommendation
This feature is a one-stop intelligent search and recommendation service that is provided by Graph Database (GDB). Enterprises can use this feature to quickly increase the number of users for new business, customize solutions to meet different scenario requirements, develop key performance indicators, and facilitate business growth.
This feature allows you to encapsulate service solutions to migrate databases, perform checks, and delete the migrated source databases. In addition, you can change the names of destination databases, precheck whether database migration requirements are met before migration, check whether the data in the source and destination databases is consistent after migration, and delete the migrated source databases. This ensures the integrity of database migration throughout the lifecycle.
You can add and remove DMS users, manage user permissions, and grant and revoke permissions on database instances, databases, tables, rows, and sensitive columns.
You can create SQL tasks and manage existing tasks. In DMS, tasks are generated for SQL statements that are executed in various tickets such as normal data change, schema design, and database or table synchronization. The SQL statements that are executed on the SQL Console tab are not included.
DMS administrators and DBAs can modify system configurations based on their business requirements. For example, they can enable automatic synchronization of database instances in the cloud, enable IP address whitelists for access control, and specify whether to allow DMS administrators and DBAs to act beyond their authority to approve or reject tickets.
DMS provides the notification feature that you can use to send notifications about the status updates of tickets and task flows. You can specify notification recipients based on your business requirements. This way, the recipients can receive notifications at the earliest opportunity.
You can add databases that run the same engine and are deployed in the same environment to a group. After you create a database group, you can load all databases in the group during data changes or schema design. After you submit the ticket, the changes can take effect in all databases in the group.
A hyphen (-) indicates that no features are involved.