A gateway cluster provides load balancing and security isolation, and allows you to submit jobs to an E-MapReduce cluster without logging on to the cluster directly.
Prerequisites
You have created a Hadoop or Kafka cluster in E-MapReduce. For more information, see Create a cluster.
Only Alibaba Cloud accounts that created Hadoop or Kafka clusters before 17:00 (UTC+8) on December 19, 2022, can continue to create them.
Limitations
This method applies only to Hadoop and Kafka clusters. For gateway deployments for DataLake, OLAP, DataFlow, and Custom clusters, see Gateway deployment modes and selection guide.
Procedure
-
Log on to the EMR console.
-
On the EMR on ECS page, click the name of your target cluster.
-
In the upper-right corner of the Basic Information page, choose All Operations > Create Gateway.
-
On the Create Gateway page, configure the following parameters.
Module
Parameter
Description
Associated settings
Region
The physical location of the gateway cluster.
Resource Group
The resource group for the gateway cluster.
To create a new resource group, click Create Resource Group.. For more information, see Create a resource group.
Associated Cluster
The compute cluster to associate with the gateway cluster. The list is filtered by the selected region. The cluster must meet the following requirements:
-
The cluster must be in the Running state.
-
Only Hadoop or Kafka clusters can be associated.
NoteAfter you select an associated cluster, the VPC of the gateway cluster defaults to the VPC of the associated cluster. You can associate the gateway cluster with clusters created in both the new and previous versions of the console.
Basic settings
Billing Method
-
Subscription: A prepaid billing method. You pay for resources before use.
-
Pay-as-you-go: A postpaid billing method where you are charged hourly. Suitable for short-term tests or dynamic workloads.
Zone
Select the zone for the gateway cluster. This zone must be the same as the zone of the associated cluster.
vSwitch
Select a vSwitch in the specified VPC and zone.
Default Security Group
Uses the security group of the associated cluster.
Assign Public Network IP
Select whether to assign an EIP to the gateway cluster.
Node Group
-
Instance Type: Select the ECS instance type for the gateway nodes. The available types are filtered by the selected region. For more information, see Instance family.
-
System Disk: The system disk type for the gateway nodes. Supported types include Ultra Disk, ESSD, and standard SSD. The available disk types vary by instance type and region. By default, the system disk is deleted when the cluster is released.
Adjust the system disk size as needed. Value range: 60 GiB to 500 GiB.
-
Data Disk: The data disk type for the gateway nodes. Supported types include Ultra Disk, ESSD, and standard SSD. The available disk types vary by instance type and region. By default, the data disk is deleted when the cluster is released.
Adjust the data disk size as needed. Value range: 40 GiB to 32,768 GiB.
-
Instances: The number of gateway nodes. Default value: 1. You can adjust the value as needed.
Cluster Name
The name of the gateway cluster. The name must be 1 to 64 characters long and can contain Chinese characters, letters, digits, hyphens (-), and underscores (_).
Identity Credentials
The credentials used to log on to all nodes in the gateway cluster.
-
Password: Enter the password for logging on to the gateway cluster.
-
Must be 8 to 30 characters in length.
-
Must contain both uppercase and lowercase letters.
-
Must contain digits and special characters. The following special characters are supported:
!@#$%^&*
-
-
Key Pair: Select a key pair for logging on to the gateway cluster. If you do not have a key pair, click Create Key Pair to go to the ECS console and create one.
Keep the private key file (.pem file) secure. After the gateway cluster is created, the system automatically binds its public key to the cluster's ECS instances. When you use SSH to log on to the gateway cluster, you must provide the private key.
Advanced settings
ECS Application Role
The RAM role that authorizes applications on the cluster to call other Alibaba Cloud services. Default value: AliyunECSInstanceForEMRRole.
Bootstrap Actions
Optional. You can run your custom scripts before the cluster starts. For more information, see Run scripts by using bootstrap actions and Manually run scripts.
Tags
Optional. Add tags during or after cluster creation. For more information, see Manage tags.
Data Disk Encryption
Optional. This feature can be enabled only during cluster creation. For more information, see Enable data disk encryption.
-
-
After you configure the parameters, click Create and Pay.
After the gateway cluster is created, its Status changes from Creating to Running.