Create and configure a ClickHouse cluster on EMR on ECS, including software, hardware, and basic settings.
Background
For recommendations on instance types, memory, and disk settings, see Usage Recommendations.
Prerequisites
A VPC and a vSwitch are created in the target region. For more information, see VPCs and vSwitches.
Procedure
Go to the Create Cluster page.
Log on to the EMR on ECS console.
Optional: In the top navigation bar, select a region and a resource group based on your business needs.
Region: The selected region cannot be changed after the cluster is created.
Resource group: By default, all resources in your account are displayed.
Click CREATE_CLUSTER.
Configure the cluster settings.
ImportantAfter creation, you can only change the cluster name. All other settings are final. Review your configurations carefully before proceeding.
Software settings.
Parameter
Description
Region
The selected region cannot be changed after the cluster is created.
Business Scenario
Select Data Analytics.
Product Version
The latest software version is selected by default.
High Service Availability
Disabled by default.
Optional Services
You must select ClickHouse.
ImportantIn clusters running EMR-5.11.0 or later, or EMR-3.45.0 or later, ZooKeeper is selected by default when you select the ClickHouse service.
In clusters running EMR-5.8.0 (inclusive) to EMR-5.10.1 (inclusive), if you select only the ClickHouse service, the cluster uses the built-in ClickHouse Keeper instead of ZooKeeper. However, ClickHouse Keeper performs differently than ZooKeeper. We recommend that you also select ZooKeeper.
In clusters running EMR-3.42.0 to EMR-3.44.1 (inclusive):
If High Service Availability is enabled, ZooKeeper is selected by default when you select the ClickHouse service.
If High Service Availability is disabled, ZooKeeper is not automatically selected when you select the ClickHouse service. In this case, ClickHouse cannot perform DDL operations. We recommend that you also select ZooKeeper.
Advanced Settings
Custom Software Configuration: Allows you to specify a JSON file to configure the cluster's base software. For more information, see Configure custom software. This feature is disabled by default.
Hardware settings.
Parameter
Description
Billing Method
Defaults to Subscription. Supported billing methods:
Pay-as-you-go: Billed hourly based on actual usage.
Subscription: A prepaid method where you pay for resources before you use them.
NoteWe recommend using the Pay-as-you-go billing method for testing. After your tests are successful, create a new Subscription cluster for production use.
Zone
Distinct physical locations within a region, connected by a low-latency internal network.
VPC
If no VPC is available, click Create VPC to create one.
vSwitch
Select a vSwitch in the zone. If no vSwitch is available, create one.
Default Security Group
An existing security group is selected by default. For more information, see Security group overview.
You can also click create a new security group. to create a new one.
ImportantDo not use enterprise security groups created in the ECS console.
Node Group
Select an instance type based on your requirements. For more information, see Instance families.
System Disk: Select a disk type, such as ESSD, standard SSD, or ultra disk.
System disk size: Default: 80 GB. Range: 80 GB to 5,000 GB.
Data Disk: Select a disk type, such as ESSD, standard SSD, or ultra disk.
Data disk size: Default: 80 GB. Range: 40 GB to 32,768 GB.
Instances:
If High Service Availability is disabled, the cluster defaults to one master node and one core node.
If High Service Availability is enabled, the cluster defaults to three master nodes and three core nodes.
Assign Public Network IP: Select this option to assign an Elastic IP Address (EIP) to the cluster. Disabled by default.
NoteTo access the cluster from the internet after creation, you must apply for an Elastic IP Address (EIP). For details, see Elastic IP Address (EIP).
Basic settings.
Parameter
Description
Cluster Name
The name must be 1 to 64 characters long and can contain only Chinese characters, letters, digits, hyphens (-), and underscores (_).
Identity Credentials
Key Pair (Default): Log on to the cluster's Linux instances with an SSH key pair.
For more information, see SSH key pairs.
Password: Set a password to log on to the master nodes.
The password must be 8 to 30 characters long and contain at least one character from each of the following groups: uppercase letters, lowercase letters, numbers, and special characters.
Special characters include:
!@#$%^&*.Application Configuration
Configure the number of replicas and shards for ClickHouse.
Advanced Settings
ECS Application Role: Enables applications on EMR nodes to access other Alibaba Cloud services, such as OSS, by requesting temporary credentials instead of using a hardcoded AccessKey. This role defines the permissions granted by the credentials.
Bootstrap Actions: Optional. Run custom scripts before cluster services start. For more information, see Run a bootstrap action script.
Resource Group: Optional. For more information, see Use resource groups.
After confirming your settings, select the terms of service and click Confirm.
ImportantPay-as-you-go cluster: Creation starts immediately. After the cluster is created, its status changes to Running.
Subscription cluster: An order is generated first. The cluster is created after you complete the payment.