All Products
Search
Document Center

Data Management:Overview

Last Updated:Oct 16, 2023

This topic describes the features provided by the database development module of Data Management (DMS). The features include schema change, data change, data export, SQL review, environment setup, data tracking, and DevOps.

Feature

Subfeature

Description

Schema change

Design schemas

You can use this feature to design the schemas of tables in a database based on specific R&D standards. This ensures the consistency of schemas among multiple environments, such as the development environment, test environment, and production environment.

Synchronize schemas

You can use this feature to compare the schemas of two databases or those of specific tables in the databases and generate SQL statements for schema synchronization.

Create shadow tables for synchronization

DMS provides this feature to automatically create a shadow table in a database based on the schema of a source table in the database. Synchronization on a regular basis is supported.

Initialize empty databases

You can use this feature to synchronize the schemas of the source database to an empty database. This way, schemas can be synchronized between databases with ease.

Repair table inconsistency

You can use this feature to compare the schemas of tables, identify schema differences, and generate SQL statements to be executed for the destination table. This ensures schema consistency between different tables.

Perform lock-free DDL operations

You can use this feature to perform lock-free DDL operations. This prevents your business from being affected by table locking. This also prevents the synchronization latency between primary and secondary databases from occurring when your schemas are changed by using native online DDL operations.

Data change

Change regular data

You can update data in databases.

Perform lock-free DML operations

You can use this feature to perform lock-free DML operations in different batches based on the primary key or a unique key that does not accept null values in a table. This ensures high execution efficiency and minimizes the impact on database performance and storage.

Clear historical data

You can create a scheduled task to delete historical data. Historical data is deleted based on the configured rules on a regular basis.

Change programmable objects by using stored routines

You can submit tickets to change programmable objects, such as stored procedures, triggers, functions, and views.

Import data

You can import a large amount of data to a database.

Data export

Export SQL result sets

You can export SQL result sets.

Export databases

You can export databases and tables.

SQL review

N/A

This feature reviews the submitted SQL statements and provides suggestions to optimize the statements. This allows you to maintain high-quality code. For example, you can ensure that SQL statements conform to database development standards and that indexes are used for queries. This also helps reduce the risk of SQL injection attacks.

Environment setup

Clone databases

You can replicate the schema and data of a database or table to another database or table, and initialize databases in multiple environments.

Generate test data

You can use this feature to generate test data based on specified field types and rules.

Data tracking

N/A

You can parse the binary logs of a database, query data change records, and generate SQL statements for data restoration.

DevOps

N/A

You can use this feature to integrate multiple data change tickets such as Normal Data Modify, Lockless change, and Data Import into a single process. This way, you can flexibly combine DML and DDL operations to meet your business requirements.