La ressource ALIYUN::SLS::EtlV2 permet de créer une nouvelle version d'une tâche de transformation de données.
Syntaxe
{
"Type": "ALIYUN::SLS::EtlV2",
"Properties": {
"Configuration": Map,
"DisplayName": String,
"Name": String,
"Project": String,
"Description": String
}
}Propriétés
|
Propriété |
Type |
Obligatoire |
Modifiable |
Description |
Contrainte |
|
Configuration |
Map |
Oui |
Non |
Configuration de la tâche. |
Pour plus d'informations, consultez les propriétés de configuration. |
|
DisplayName |
String |
Oui |
Non |
Nom d'affichage de la tâche. |
Aucune. |
|
Name |
String |
Oui |
Non |
Nom de la tâche. |
Aucune. |
|
Project |
String |
Oui |
Non |
Nom du projet Log Service de destination de la tâche. |
Aucune. |
|
Description |
String |
Non |
Non |
Description de la tâche. |
Aucune. |
Syntaxe de configuration
"Configuration": {
"Script": String,
"Sinks": List,
"Parameters": Map,
"ToTime": Integer,
"Logstore": String,
"Lang": String,
"FromTime": Integer,
"RoleArn": String
}Propriétés de configuration
Propriété | Type | Obligatoire | Modifiable | Description | Contrainte |
Logstore | String | Oui | Non | Logstore source de la tâche. | Aucune. |
RoleArn | String | Oui | Non | ARN (Alibaba Cloud Resource Name) du rôle que l'utilisateur doit endosser via le service STS (Security Token Service) pour accéder au Logstore de destination de la tâche. | Aucune. |
Script | String | Oui | Non | Syntaxe de la tâche. | Aucune. |
Sinks | List | Oui | Non | Configurations des destinations de stockage de la tâche. | Les destinations de stockage incluent les projets et les Logstores Log Service. Pour plus d'informations, consultez les propriétés Sinks. |
FromTime | Integer | Non | Non | Heure de début de la tâche. | Aucune. |
Lang | String | Non | Non | Type de langage de la tâche. | Important Si vous spécifiez le type SPL, une nouvelle version de la transformation de données est créée. Sinon, une ancienne version est créée. |
Parameters | Map | Non | Non | Configuration des paramètres avancés de la tâche. | Aucune. |
ToTime | Integer | Non | Non | Heure de fin de la tâche. | Aucune. |
Syntaxe Sinks
"Sinks": [
{
"Datasets": List,
"Project": String,
"Endpoint": String,
"Logstore": String,
"RoleArn": String,
"Name": String
}
]Propriétés Sinks
|
Propriété |
Type |
Obligatoire |
Modifiable |
Description |
Contrainte |
|
Logstore |
String |
Oui |
Non |
Logstore de destination de la tâche. |
Aucune. |
|
Name |
String |
Oui |
Non |
Nom de la destination de stockage de la tâche. |
Aucune. |
|
Project |
String |
Oui |
Non |
Projet Log Service de destination de la tâche. |
Aucune. |
|
RoleArn |
String |
Oui |
Non |
ARN (Alibaba Cloud Resource Name) du rôle que l'utilisateur doit endosser via le service STS (Security Token Service) pour accéder au Logstore de destination de la tâche. |
Aucune. |
|
Datasets |
List |
Non |
Non |
Ensembles de données de résultats. |
Jusqu'à 50 ensembles de données de résultats sont pris en charge. |
|
Endpoint |
String |
Non |
Non |
Endpoint du serveur auquel appartient le projet Log Service de destination de la tâche. |
Aucune. |
Valeurs renvoyées
Fn::GetAtt
Name : nom de la tâche ETL.
Exemples
ROSTemplateFormatVersion: '2015-09-01'
Parameters:
Project:
Type: String
Description:
en: The name of the project.
Required: true
Configuration:
AssociationPropertyMetadata:
Parameters:
Script:
Type: String
Description:
en: The script of the etl job.
Required: true
Sinks:
AssociationPropertyMetadata:
Parameter:
AssociationPropertyMetadata:
Parameters:
Datasets:
AssociationPropertyMetadata:
Parameter:
Type: String
Required: false
AssociationProperty: List[Parameter]
Type: Json
Description:
en: The processing result outputs the target list.
Required: false
MinLength: 1
MaxLength: 50
Project:
Type: String
Description:
en: The name of output target project.
Required: true
Endpoint:
Type: String
Description:
en: The endpoint of the region where the target Project resides.
Required: false
Logstore:
Type: String
Description:
en: Target Logstore name.
Required: true
RoleArn:
Type: String
Description:
en: The role ARN authorized to write the target Logstore.
Required: true
Name:
Type: String
Description:
en: Output target name.
Required: true
Type: Json
Required: false
AssociationProperty: List[Parameter]
Type: Json
Description:
en: The processing result outputs the target list.
Required: true
MinLength: 1
MaxLength: 50
Parameters:
Type: Json
Description:
en: The parameters of the etl job.
Required: false
ToTime:
Type: Number
Description:
en: Deadline of processing job, the default value is 0, which means that it will continue to consume until it is manually stopped.
Required: false
Default: 0
Logstore:
Type: String
Description:
en: Source Logstore name.
Required: true
Lang:
Type: String
Description:
en: The language of the etl job.
Required: false
FromTime:
Type: Number
Description:
en: The start time of the processing job, the default starts from the current time.
Required: false
RoleArn:
Type: String
Description:
en: The role ARN authorized to read the source Logstore.
Required: true
Type: Json
Description:
en: The configuration of the etl job.
Required: true
DisplayName:
Type: String
Description:
en: The display name of the etl job.
Required: true
Name:
Type: String
Description:
en: The name of the etl job.
Required: true
Resources:
EtlV2:
Type: ALIYUN::SLS::EtlV2
Properties:
Project:
Ref: Project
Configuration:
Ref: Configuration
DisplayName:
Ref: DisplayName
Name:
Ref: Name
Outputs:
Name:
Description: ETL name.
Value:
Fn::GetAtt:
- EtlV2
- Name
{
"ROSTemplateFormatVersion": "2015-09-01",
"Parameters": {
"Project": {
"Type": "String",
"Description": {
"en": "The name of the project."
},
"Required": true
},
"Configuration": {
"AssociationPropertyMetadata": {
"Parameters": {
"Script": {
"Type": "String",
"Description": {
"en": "The script of the etl job."
},
"Required": true
},
"Sinks": {
"AssociationPropertyMetadata": {
"Parameter": {
"AssociationPropertyMetadata": {
"Parameters": {
"Datasets": {
"AssociationPropertyMetadata": {
"Parameter": {
"Type": "String",
"Required": false
}
},
"AssociationProperty": "List[Parameter]",
"Type": "Json",
"Description": {
"en": "The processing result outputs the target list."
},
"Required": false,
"MinLength": 1,
"MaxLength": 50
},
"Project": {
"Type": "String",
"Description": {
"en": "The name of output target project."
},
"Required": true
},
"Endpoint": {
"Type": "String",
"Description": {
"en": "The endpoint of the region where the target Project resides."
},
"Required": false
},
"Logstore": {
"Type": "String",
"Description": {
"en": "Target Logstore name."
},
"Required": true
},
"RoleArn": {
"Type": "String",
"Description": {
"en": "The role ARN authorized to write the target Logstore."
},
"Required": true
},
"Name": {
"Type": "String",
"Description": {
"en": "Output target name."
},
"Required": true
}
}
},
"Type": "Json",
"Required": false
}
},
"AssociationProperty": "List[Parameter]",
"Type": "Json",
"Description": {
"en": "The processing result outputs the target list."
},
"Required": true,
"MinLength": 1,
"MaxLength": 50
},
"Parameters": {
"Type": "Json",
"Description": {
"en": "The parameters of the etl job."
},
"Required": false
},
"ToTime": {
"Type": "Number",
"Description": {
"en": "Deadline of processing job, the default value is 0, which means that it will continue to consume until it is manually stopped."
},
"Required": false,
"Default": 0
},
"Logstore": {
"Type": "String",
"Description": {
"en": "Source Logstore name."
},
"Required": true
},
"Lang": {
"Type": "String",
"Description": {
"en": "The language of the etl job."
},
"Required": false
},
"FromTime": {
"Type": "Number",
"Description": {
"en": "The start time of the processing job, the default starts from the current time."
},
"Required": false
},
"RoleArn": {
"Type": "String",
"Description": {
"en": "The role ARN authorized to read the source Logstore."
},
"Required": true
}
}
},
"Type": "Json",
"Description": {
"en": "The configuration of the etl job."
},
"Required": true
},
"DisplayName": {
"Type": "String",
"Description": {
"en": "The display name of the etl job."
},
"Required": true
},
"Name": {
"Type": "String",
"Description": {
"en": "The name of the etl job."
},
"Required": true
}
},
"Resources": {
"EtlV2": {
"Type": "ALIYUN::SLS::EtlV2",
"Properties": {
"Project": {
"Ref": "Project"
},
"Configuration": {
"Ref": "Configuration"
},
"DisplayName": {
"Ref": "DisplayName"
},
"Name": {
"Ref": "Name"
}
}
}
},
"Outputs": {
"Name": {
"Description": "ETL name.",
"Value": {
"Fn::GetAtt": [
"EtlV2",
"Name"
]
}
}
}
}