Mengkueri informasi tentang tugas sinkronisasi versi baru yang dibuat di Data Integration. Jenis tugas sinkronisasi berikut didukung: sinkronisasi pengatur waktu seluruh data di database MySQL ke Gudang Data Real-time.
Coba sekarang
Test
RAM authorization
|
Action |
Access level |
Resource type |
Condition key |
Dependent action |
|
dataworks:* |
get |
*全部资源
|
None | None |
Parameter permintaan
|
Parameter |
Type |
Required |
Description |
Example |
| DIJobId |
integer |
Yes |
ID tugas sinkronisasi. |
11588 |
| WithDetails |
boolean |
No |
Apakah akan mengembalikan informasi konfigurasi detail, termasuk TransformationRules, TableMappings, dan JobPengaturan. Nilai valid: true dan false. Nilai default: true. |
true |
Elemen respons
|
Element |
Type |
Description |
Example |
|
object |
The returned result. |
||
| Data |
object |
The information about the synchronization task. |
|
| ProjectId |
integer |
The workspace ID. |
22 |
| DIJobId |
integer |
The ID of the synchronization task. |
11588 |
| JobName |
string |
The name of the synchronization task. |
mysql_to_holo_sync_445 |
| Description |
string |
The description of the synchronization task. |
Synchronize mysql to hologres |
| MigrationType |
string |
The synchronization type. Valid values:
|
FullAndRealtimeIncremental |
| SourceDataSourceType |
string |
The source type. The value MySQL is returned. |
MySQL |
| DestinationDataSourceType |
string |
The destination type. Valid values: Hologres and Hive. |
Hologres |
| SourceDataSourceSettings |
array<object> |
The settings of the source. Only a single source is supported. |
|
|
array<object> |
|||
| DataSourceName |
string |
The name of the data source. |
mysql_datasource_1 |
| DataSourceProperties |
object |
The properties of the data source. |
|
|
string |
The properties of the source. The properties of a MySQL data source include TimeZone and Encoding. |
TimeZone |
|
| DestinationDataSourceSettings |
array<object> |
The settings of the destination. Only a single destination is supported. |
|
|
array<object> |
|||
| DataSourceName |
string |
The name of the data source. |
holo_datasource_1 |
| DataSourceProperties |
object |
The properties of the data source. |
|
|
string |
The properties of the destination. No properties are returned because DataWorks does not allow you to configure properties for a Hologres data source. |
TimeZone |
|
| ResourceSettings |
object |
The resource settings. |
|
| OfflineResourceSettings |
object |
The resource used for batch synchronization. |
|
| ResourceGroupIdentifier |
string |
The identifier of the resource group for Data Integration used for batch synchronization. |
S_res_group_111_222 |
| RealtimeResourceSettings |
object |
The resource used for real-time synchronization. |
|
| ResourceGroupIdentifier |
string |
The identifier of the resource group for Data Integration used for real-time synchronization. |
S_res_group_111_222 |
| RequestedCu |
number |
The number of compute units (CUs) in the resource group that are used for incremental and full synchronization. |
2.0 |
| TransformationRules |
array<object> |
The list of transformation rules that are applied to the synchronization objects selected from the source. Each entry in the list defines a transformation rule. |
|
|
object |
The transformation rule that is applied to the synchronization objects selected from the source. |
||
| RuleActionType |
string |
The action type. Valid values:
|
Rename |
| RuleExpression |
string |
The expression of the rule. The expression is a JSON string.
|
{"expression":"${srcDatasoureName}_${srcDatabaseName}"} |
| RuleName |
string |
The name of the rule. If the values of the RuleActionType parameter and the RuleTargetType parameter are the same for multiple transformation rules, you must make sure that the transformation rule names are unique. |
rename_rule_1 |
| RuleTargetType |
string |
The type of the object on which the action is performed. Valid values:
|
Table |
| TableMappings |
array<object> |
The list of mappings between rules used to select synchronization objects in the source and transformation rules applied to the selected synchronization objects. Each entry in the list displays a mapping between a rule used to select synchronization objects and a transformation rule applied to the selected synchronization objects. |
|
|
array<object> |
The mapping between a rule used to select synchronization objects in the source and a transformation rule applied to the selected synchronization objects. |
||
| SourceObjectSelectionRules |
array<object> |
The list of rules used to select synchronization objects in the source. |
|
|
object |
The rule used to select synchronization objects in the source. The objects can be databases or tables. |
||
| Expression |
string |
The expression. |
mysql_table_1 |
| ObjectType |
string |
The object type. Valid values:
|
Table |
| TransformationRules |
array<object> |
The list of transformation rules that are applied to the synchronization objects selected from the source. |
|
|
object |
The transformation rule that is applied to the synchronization objects selected from the source. |
||
| RuleActionType |
string |
The action type. Valid values:
|
Rename |
| RuleName |
string |
The name of the rule. If the values of the RuleActionType parameter and the RuleTargetType parameter are the same for multiple transformation rules, you must make sure that the transformation rule names are unique. |
rename_rule_1 |
| RuleTargetType |
string |
The type of the object on which the action is performed. Valid values:
|
Table |
| JobSettings |
object |
The settings for the dimension of the synchronization task. The settings include processing policies for DDL messages, policies for data type mappings between source fields and destination fields, and runtime parameters of the synchronization task. |
|
| ColumnDataTypeSettings |
array<object> |
The settings for data type mappings between source fields and destination fields. The value of this parameter is an array. |
|
|
object |
|||
| SourceDataType |
string |
The data type of a source field. |
bigint |
| DestinationDataType |
string |
The data type of a destination field. |
text |
| DdlHandlingSettings |
array<object> |
The settings for processing DDL messages. The value of this parameter is an array. |
|
|
object |
The processing setting for a specific type of DDL message. |
||
| Action |
string |
The processing policy. Valid values:
|
Critical |
| Type |
string |
The type of the DDL operation. Valid values:
|
AddColumn |
| RuntimeSettings |
array<object> |
The runtime settings. The value of this parameter is an array. |
|
|
object |
The runtime setting. |
||
| Name |
string |
The name of the configuration item. Valid values:
|
runtime.offline.concurrent |
| Value |
string |
The value of the configuration item. |
1 |
| CycleScheduleSettings |
object |
The settings for periodic scheduling. |
|
| CycleMigrationType |
string |
The synchronization type that requires periodic scheduling. Valid values:
|
Full |
| ScheduleParameters |
string |
The scheduling parameters. |
bizdate=$bizdate |
| ChannelSettings |
string |
The channel control settings for the synchronization task. The value of this parameter is a JSON string. |
{"structInfo":"MANAGED","storageType":"TEXTFILE","writeMode":"APPEND","partitionColumns":[{"columnName":"pt","columnType":"STRING","comment":""}],"fieldDelimiter":""} |
| CreatedTime |
integer |
The timestamp when the synchronization task was created. The timestamp is accurate to the second. |
1671516776 |
| CreatedUid |
string |
The ID of the user who creates the synchronization task. |
100000001 |
| UpdatedTime |
integer |
The timestamp when the synchronization task was last modified. The timestamp is accurate to the second. |
1673859985 |
| UpdatedUid |
string |
The ID of the user who last modifies the synchronization task. |
100000001 |
| StartedTime |
integer |
The timestamp when the synchronization task was last started. The timestamp is accurate to the second. |
1673859999 |
| StartedUid |
string |
The ID of the user who last starts the synchronization task. |
100000001 |
| JobStatus |
string |
The status of the synchronization task. Valid values:
|
Finished |
| ErrorMessage |
string |
The error message returned if the value of the JobStatus parameter is Failed. |
error details xxx |
| RunStats |
object |
The information about the running of the synchronization task. |
|
|
string |
The detailed statistics on the running of the synchronization task.
|
StructureMigrationTotalTables |
|
| RequestId |
string |
The request ID. |
0000-ABCD-EFG**** |
Contoh
Respons sukses
JSONformat
{
"Data": {
"ProjectId": 22,
"DIJobId": 11588,
"JobName": "mysql_to_holo_sync_445",
"Description": "Synchronize mysql to hologres\n",
"MigrationType": "FullAndRealtimeIncremental",
"SourceDataSourceType": "MySQL",
"DestinationDataSourceType": "Hologres",
"SourceDataSourceSettings": [
{
"DataSourceName": "mysql_datasource_1",
"DataSourceProperties": {
"key": "TimeZone"
}
}
],
"DestinationDataSourceSettings": [
{
"DataSourceName": "holo_datasource_1",
"DataSourceProperties": {
"key": "TimeZone"
}
}
],
"ResourceSettings": {
"OfflineResourceSettings": {
"ResourceGroupIdentifier": "S_res_group_111_222"
},
"RealtimeResourceSettings": {
"ResourceGroupIdentifier": "S_res_group_111_222"
},
"RequestedCu": 2
},
"TransformationRules": [
{
"RuleActionType": "Rename",
"RuleExpression": "{\"expression\":\"${srcDatasoureName}_${srcDatabaseName}\"}",
"RuleName": "rename_rule_1",
"RuleTargetType": "Table"
}
],
"TableMappings": [
{
"SourceObjectSelectionRules": [
{
"Expression": "mysql_table_1",
"ObjectType": "Table"
}
],
"TransformationRules": [
{
"RuleActionType": "Rename",
"RuleName": "rename_rule_1",
"RuleTargetType": "Table"
}
]
}
],
"JobSettings": {
"ColumnDataTypeSettings": [
{
"SourceDataType": "bigint",
"DestinationDataType": "text"
}
],
"DdlHandlingSettings": [
{
"Action": "Critical",
"Type": "AddColumn"
}
],
"RuntimeSettings": [
{
"Name": "runtime.offline.concurrent",
"Value": "1"
}
],
"CycleScheduleSettings": {
"CycleMigrationType": "Full",
"ScheduleParameters": "bizdate=$bizdate"
},
"ChannelSettings": "{\"structInfo\":\"MANAGED\",\"storageType\":\"TEXTFILE\",\"writeMode\":\"APPEND\",\"partitionColumns\":[{\"columnName\":\"pt\",\"columnType\":\"STRING\",\"comment\":\"\"}],\"fieldDelimiter\":\"\"}\n"
},
"CreatedTime": 1671516776,
"CreatedUid": "100000001",
"UpdatedTime": 1673859985,
"UpdatedUid": "100000001",
"StartedTime": 1673859999,
"StartedUid": "100000001",
"JobStatus": "Finished",
"ErrorMessage": "error details xxx",
"RunStats": {
"key": "StructureMigrationTotalTables"
}
},
"RequestId": "0000-ABCD-EFG****"
}
Kode kesalahan
|
HTTP status code |
Error code |
Error message |
Description |
|---|---|---|---|
| 500 | InternalError.System | An internal system error occurred. Try again later. | |
| 500 | InternalError.UserId.Missing | An internal system error occurred. Try again later. | |
| 429 | Throttling.Api | The request for this resource has exceeded your available limit. | |
| 429 | Throttling.System | The DataWorks system is busy. Try again later. | |
| 429 | Throttling.User | Your request is too frequent. Try again later. |
Lihat Error Codes untuk daftar lengkap.
Catatan rilis
Lihat Release Notes untuk daftar lengkap.