Data Integration: Online & Offline Data Exchange

Data Integration

Data Integration is an all-in-one data synchronization platform. The platform supports online real-time and offline data exchange between all data sources, networks, and locations.

Contact Sales Console

Overview

Data Integration is a distribution service providing data transmission, data conversion and synchronization based on an advanced distribution architecture with multiple modules (such as dirty data processing and flow control). Data Integration supports multiple features, including support for multiple data sources, fast transmission, high reliability, scalability, and mass synchronization.

{"moduleinfo":{"benefits":"Benefits","outputBuyBtn4Partner":true,"os_count":[{"count_phone":0,"count":0}],"products_count":[{"count_phone":0,"count":0}],"benefits_count":[{"count_phone":4,"count":4}],"news_count":[{"count_phone":0,"count":0}],"floor":"floor1","outputNews4Partner":"false","regions_count":[{"count_phone":0,"count":0}]},"regions":[],"os":[],"products":[],"benefits":[{"icon":"https://img.alicdn.com/tfs/TB1TauxXEY1gK0jSZFMXXaWcVXa-108-108.png","title":"Support For Multiple Disparate Data Sources","content":"Data Integration supports data synchronization between more than 400 pairs of disparate data sources( including RDS databases, semi-structured storage, non-structured storage (such as audio, video, and images), NoSQL databases, and big data storage).  Data Integration also supports real-time data reading and writing between data sources such as Oracle, MySQL, and DataHub."},{"icon":"https://img.alicdn.com/tfs/TB1jdmyXAL0gK0jSZFxXXXWHVXa-108-108.png","title":"Scheduled Tasks","content":"Data Integration allows you to schedule offline tasks by setting a specific trigger time (including year, month, day, hour, and minute). It only requires a few steps to configure periodical incremental data extraction. Data integration works perfectly with DataWorks data modeling. The entire workflow is an integration of operations and maintenance."},{"icon":"https://img.alicdn.com/tfs/TB1oLWyXBr0gK0jSZFnXXbRRXXa-108-108.png","title":"Mass Upload to Cloud","content":"Data Integration leverages the computing capability of Hadoop clusters to synchronize the HDFS data from clusters to MaxCompute. This is called Mass Cloud Upload. Data Integration can transmit up to 5TB of data per day. The maximum transmission rate is 2 GB/s."},{"icon":"https://img.alicdn.com/tfs/TB1GEmtXpT7gK0jSZFpXXaTkpXa-108-108.png","title":"Monitoring and Alarms","content":"With 19 built-in monitoring rules, Data Integration applies to most monitoring scenarios. You can set alarm rules based on these monitoring rules. Additionally, you can pre-define the task failure notification mode for Data Integration."}],"news":[],"$root":{"moduleinfo":{"benefits":"Benefits","outputBuyBtn4Partner":true,"os_count":[{"count_phone":0,"count":0}],"products_count":[{"count_phone":0,"count":0}],"benefits_count":[{"count_phone":4,"count":4}],"news_count":[{"count_phone":0,"count":0}],"floor":"floor1","outputNews4Partner":"false","regions_count":[{"count_phone":0,"count":0}]},"regions":[],"os":[],"products":[],"benefits":[{"icon":"https://img.alicdn.com/tfs/TB1TauxXEY1gK0jSZFMXXaWcVXa-108-108.png","title":"Support For Multiple Disparate Data Sources","content":"Data Integration supports data synchronization between more than 400 pairs of disparate data sources( including RDS databases, semi-structured storage, non-structured storage (such as audio, video, and images), NoSQL databases, and big data storage).  Data Integration also supports real-time data reading and writing between data sources such as Oracle, MySQL, and DataHub."},{"icon":"https://img.alicdn.com/tfs/TB1jdmyXAL0gK0jSZFxXXXWHVXa-108-108.png","title":"Scheduled Tasks","content":"Data Integration allows you to schedule offline tasks by setting a specific trigger time (including year, month, day, hour, and minute). It only requires a few steps to configure periodical incremental data extraction. Data integration works perfectly with DataWorks data modeling. The entire workflow is an integration of operations and maintenance."},{"icon":"https://img.alicdn.com/tfs/TB1oLWyXBr0gK0jSZFnXXbRRXXa-108-108.png","title":"Mass Upload to Cloud","content":"Data Integration leverages the computing capability of Hadoop clusters to synchronize the HDFS data from clusters to MaxCompute. This is called Mass Cloud Upload. Data Integration can transmit up to 5TB of data per day. The maximum transmission rate is 2 GB/s."},{"icon":"https://img.alicdn.com/tfs/TB1GEmtXpT7gK0jSZFpXXaTkpXa-108-108.png","title":"Monitoring and Alarms","content":"With 19 built-in monitoring rules, Data Integration applies to most monitoring scenarios. You can set alarm rules based on these monitoring rules. Additionally, you can pre-define the task failure notification mode for Data Integration."}],"news":[]},"$moduleId":"5015366900"}

Benefits

: Support For Multiple Disparate Data Sources
Data Integration supports data synchronization between more than 400 pairs of disparate data sources( including RDS databases, semi-structured storage, non-structured storage (such as audio, video, and images), NoSQL databases, and big data storage). Data Integration also supports real-time data reading and writing between data sources such as Oracle, MySQL, and DataHub.

: Scheduled Tasks
Data Integration allows you to schedule offline tasks by setting a specific trigger time (including year, month, day, hour, and minute). It only requires a few steps to configure periodical incremental data extraction. Data integration works perfectly with DataWorks data modeling. The entire workflow is an integration of operations and maintenance.

: Mass Upload to Cloud
Data Integration leverages the computing capability of Hadoop clusters to synchronize the HDFS data from clusters to MaxCompute. This is called Mass Cloud Upload. Data Integration can transmit up to 5TB of data per day. The maximum transmission rate is 2 GB/s.

: Monitoring and Alarms
With 19 built-in monitoring rules, Data Integration applies to most monitoring scenarios. You can set alarm rules based on these monitoring rules. Additionally, you can pre-define the task failure notification mode for Data Integration.

{"moduleinfo":{"title":"Features","li_count":[{"count_phone":4,"count":4}]},"li":[{"spm":"Data Source Management","img":"https://img.alicdn.com/tfs/TB18rCxXEH1gK0jSZSyXXXtlpXa-108-108.png","more":[{"p":"By leveraging the data sources and datasets that define the source and destination of data, Data Integration provides two data management plug-ins. The Reader plug-in is used to read data and the Writer plug-in is used to write data. Based on this framework, a set of simplified intermediate data transmission formats is developed to exchange data between arbitrary structured and semi-structured data sources.","tce_rule_count":"1","title":""}],"h1":"Data Source Management","imgAction":"https://img.alicdn.com/tfs/TB10M9JXq61gK0jSZFlXXXDKFXa-108-108.png"},{"spm":"Local Data Collection","img":"https://img.alicdn.com/tfs/TB1_IayXAH0gK0jSZPiXXavapXa-108-108.png","more":[{"p":"Data Integration supports data synchronization in Alibaba Cloud classic networks and VPCs, as well as data collection in local IDCs.","tce_rule_count":"1","title":""}],"h1":"Local Data Collection","imgAction":"https://img.alicdn.com/tfs/TB1tEaJXAL0gK0jSZFxXXXWHVXa-108-108.png"},{"spm":"Full Database Migration","img":"https://img.alicdn.com/tfs/TB1cV1xXET1gK0jSZFhXXaAtVXa-108-108.png","more":[{"p":"Full Database migration is a tool provided by Data Integration, which allows the creation of multiple data synchronization tasks and imports all data tables in a MySQL database to MaxCompute. By using full database migration, you no longer need to create synchronization tasks one at a time.","tce_rule_count":"1","title":""}],"h1":"Full Database Migration","imgAction":"https://img.alicdn.com/tfs/TB1y.aJXAL0gK0jSZFxXXXWHVXa-108-108.png"},{"spm":"Incremental Synchronization","img":"https://img.alicdn.com/tfs/TB1ihixXxn1gK0jSZKPXXXvUXXa-108-108.png","more":[{"p":"By using the WHERE clause, Data Integration supports business data filtering by date. Data with different dates is synchronized to the relevant MaxCompute partition tables. By setting the synchronization interval to 1 hour or 10 minutes, Data Integration is capable of performing quasi-real-time incremental synchronization.","tce_rule_count":"1","title":""}],"h1":"Incremental Synchronization","imgAction":"https://img.alicdn.com/tfs/TB1plmIXEY1gK0jSZFMXXaWcVXa-108-108.png"}],"$root":{"moduleinfo":{"title":"Features","li_count":[{"count_phone":4,"count":4}]},"li":[{"spm":"Data Source Management","img":"https://img.alicdn.com/tfs/TB18rCxXEH1gK0jSZSyXXXtlpXa-108-108.png","more":[{"p":"By leveraging the data sources and datasets that define the source and destination of data, Data Integration provides two data management plug-ins. The Reader plug-in is used to read data and the Writer plug-in is used to write data. Based on this framework, a set of simplified intermediate data transmission formats is developed to exchange data between arbitrary structured and semi-structured data sources.","tce_rule_count":"1","title":""}],"h1":"Data Source Management","imgAction":"https://img.alicdn.com/tfs/TB10M9JXq61gK0jSZFlXXXDKFXa-108-108.png"},{"spm":"Local Data Collection","img":"https://img.alicdn.com/tfs/TB1_IayXAH0gK0jSZPiXXavapXa-108-108.png","more":[{"p":"Data Integration supports data synchronization in Alibaba Cloud classic networks and VPCs, as well as data collection in local IDCs.","tce_rule_count":"1","title":""}],"h1":"Local Data Collection","imgAction":"https://img.alicdn.com/tfs/TB1tEaJXAL0gK0jSZFxXXXWHVXa-108-108.png"},{"spm":"Full Database Migration","img":"https://img.alicdn.com/tfs/TB1cV1xXET1gK0jSZFhXXaAtVXa-108-108.png","more":[{"p":"Full Database migration is a tool provided by Data Integration, which allows the creation of multiple data synchronization tasks and imports all data tables in a MySQL database to MaxCompute. By using full database migration, you no longer need to create synchronization tasks one at a time.","tce_rule_count":"1","title":""}],"h1":"Full Database Migration","imgAction":"https://img.alicdn.com/tfs/TB1y.aJXAL0gK0jSZFxXXXWHVXa-108-108.png"},{"spm":"Incremental Synchronization","img":"https://img.alicdn.com/tfs/TB1ihixXxn1gK0jSZKPXXXvUXXa-108-108.png","more":[{"p":"By using the WHERE clause, Data Integration supports business data filtering by date. Data with different dates is synchronized to the relevant MaxCompute partition tables. By setting the synchronization interval to 1 hour or 10 minutes, Data Integration is capable of performing quasi-real-time incremental synchronization.","tce_rule_count":"1","title":""}],"h1":"Incremental Synchronization","imgAction":"https://img.alicdn.com/tfs/TB1plmIXEY1gK0jSZFMXXaWcVXa-108-108.png"}]},"$moduleId":"5936525170"}

Features

Data Source Management

By leveraging the data sources and datasets that define the source and destination of data, Data Integration provides two data management plug-ins. The Reader plug-in is used to read data and the Writer plug-in is used to write data. Based on this framework, a set of simplified intermediate data transmission formats is developed to exchange data between arbitrary structured and semi-structured data sources.
Local Data Collection

Data Integration supports data synchronization in Alibaba Cloud classic networks and VPCs, as well as data collection in local IDCs.
Full Database Migration

Full Database migration is a tool provided by Data Integration, which allows the creation of multiple data synchronization tasks and imports all data tables in a MySQL database to MaxCompute. By using full database migration, you no longer need to create synchronization tasks one at a time.
Incremental Synchronization

By using the WHERE clause, Data Integration supports business data filtering by date. Data with different dates is synchronized to the relevant MaxCompute partition tables. By setting the synchronization interval to 1 hour or 10 minutes, Data Integration is capable of performing quasi-real-time incremental synchronization.

{"moduleinfo":{"hideForReseller":false,"category_count":[{"count_phone":4,"count":4}]},"category":[{"link":"https://www.alibabacloud.com/help/doc-detail/137718.htm","description":"Create a data sync job","output4Partner":"false","title":"Get Started","target":"_blank"},{"link":"https://www.alibabacloud.com/help/doc-detail/137663.htm","description":"More detail about Data Integration","output4Partner":"true","title":"Product Documentation","target":"_blank"},{"link":"https://www.alibabacloud.com/help/doc-detail/137670.htm","description":"RDBMS,Big Data and OSS etc.","output4Partner":"true","title":"Supported Sources","target":"_blank"},{"link":"https://www.alibabacloud.com/product","description":"See more Alibaba Cloud products","output4Partner":"false","title":"Products","target":"_blank"}],"$root":{"moduleinfo":{"hideForReseller":false,"category_count":[{"count_phone":4,"count":4}]},"category":[{"link":"https://www.alibabacloud.com/help/doc-detail/137718.htm","description":"Create a data sync job","output4Partner":"false","title":"Get Started","target":"_blank"},{"link":"https://www.alibabacloud.com/help/doc-detail/137663.htm","description":"More detail about Data Integration","output4Partner":"true","title":"Product Documentation","target":"_blank"},{"link":"https://www.alibabacloud.com/help/doc-detail/137670.htm","description":"RDBMS,Big Data and OSS etc.","output4Partner":"true","title":"Supported Sources","target":"_blank"},{"link":"https://www.alibabacloud.com/product","description":"See more Alibaba Cloud products","output4Partner":"false","title":"Products","target":"_blank"}]},"$moduleId":"1858164160"}

Get Started for Free

Benefits

Features

Data Source Management

Local Data Collection

Full Database Migration

Incremental Synchronization

Upgraded Support For You

1 on 1 Presale Consultation

24/7 Technical Support

6 Free Tickets per Quarter

Faster Response

Sales Support

Technical Support

Connect & Report Abuse