When an organization needs to incorporate on-premises servers into a Container Service for Kubernetes (ACK) cluster for unified management, creating hybrid cloud node pools in ACK managed Pro clusters enables elastic scheduling and cost optimization across both cloud and on-premises environments. This approach allows you to add your existing hybrid cloud nodes to the cluster, leveraging your current IT assets while maintaining a consistent orchestration platform.
Billing
When using hybrid cloud node pools with an ACK managed Pro cluster, your costs will comprise three parts:
The cluster management fee.
The management fee for hybrid cloud nodes (currently waived during the preview period).
The costs of any associated cloud resources.
Prerequisites
Before creating a hybrid cloud node pool, ensure the following conditions are met:
You have an ACK managed Pro cluster that meets the following criteria:
The virtual private cloud (VPC) where the cluster resides has established cross-cloud network connectivity.
The cluster version is 1.33 or later.
The cluster contains at least one Elastic Compute Service (ECS) node to host critical ACK management components. We recommend at least three ECS nodes for high availability.
The Terway Hybrid network plugin is installed in the cluster.
Impact assessment
To prevent unintended impact on existing workloads, nodes in a hybrid cloud node pool are created with the following default label and taint:
apiVersion: v1
kind: Node
metadata:
labels:
alibabacloud.com/nodepool-type: hybridcloud
...
spec:
taints:
- effect: NoSchedule
key: nodepool-type
value: "hybridcloud"
...To schedule pods onto these hybrid nodes, add a toleration for this taint to your pod specifications. If your application deployment does not need to distinguish between cloud and on-premises nodes, remove the taint.
Do not remove the default label alibabacloud.com/nodepool-type: hybridcloud. Doing so will impact service functionality.
Create a hybrid cloud node pool
You can configure the node pool in the console, including basic and network settings. Some settings, such as availability and networking, cannot be changed after the node pool is created. Creating a node pool does not affect the operation of existing node pools or their workloads.
Log on to the ACK console. In the left navigation pane, click Clusters.
On the Clusters page, find the cluster to manage and click its name. In the left navigation pane, choose .
On the Node Pools page, next to Create Node Pool, click ... > Create Hybrid Cloud Node Pool. In the dialog box that appears, configure the hybrid node pool parameters.
Node Pool Name: A unique name for your node pool (for example,
hybrid-nodepool-mexxSA).Zone: A custom, logical zone name (for example,
idc-zone-1). This name must be unique within the cluster.Network Plug-in:
Use CNI (Terway-Hybrid): This plugin is designed for hybrid cloud node pools. It ensures network connectivity between pods running on-premises and in the cloud.
If the Terway-Hybrid Container Network Interface (CNI) component is not installed in the cluster, install it from the Add-ons page first. See Terway Hybrid network plugin.
Configure CNI: If you want to use specific features of a CNI plugin, install a custom CNI plugin in the cluster.
Network Type:
underlay: Provides high performance with low network latency by eliminating Virtual Extensible Local Area Network (VXLAN) encapsulation overhead. Performance is approximately 20% higher than in Overlay mode.
overlay: Offers simple configuration and flexible deployment with no special requirements for the underlying network.
After the node pool is created, you can modify its settings on the Edit Node Pool page.
Add nodes to a hybrid cloud node pool
You can add your existing on-premises or third-party cloud servers to an ACK cluster as worker nodes for unified management.
Auto add instances with Cloud Assistant installed
Register the hybrid cloud nodes you want to add as Alibaba Cloud managed instances.
ImportantThe region where you register the instance must be the same as your ACK cluster's region.
On the Node Pools page, click
in the Actions column of the target node pool, then click Add Existing Node.Choose Add Existing as the upload method.
Select the instances you want to add to the ACK cluster.
Manually add instances
On the Node Pools page, click
in the Actions column of the target node pool, then click Add Existing Node.Choose Manual as the upload method.
Configure the activation ID and activation code. You can generate the activation ID and code on the Alibaba Cloud managed instances page.
Click OK to generate a script for manual addition.
Copy the script and run it on each hybrid cloud node you want to add.
Remove nodes from a hybrid cloud node pool
Removing a hybrid cloud node does not unregister the third-party server. To do so, see Unregister a third-party server.
On the Clusters page, find the cluster to manage and click its name. In the left navigation pane, choose .
Click the target node pool name. On the details page, select the nodes you want to remove and click Batch Remove.
OS compatibility
The following table lists the operating systems supported by hybrid cloud node pools. If you need to use a different OS, contact your business manager for an evaluation.
OS image type | Platform | Architecture | Image name (with version) | Image ID |
Alibaba Cloud Linux 3.2104 LTS 64-bit ACK-optimized | Aliyun | x86_64 | Alibaba Cloud Linux 3.2104 Container-Optimized | aliyun_3_x64_20G_container_optimized_20241226.vhd (Defaults to cgroup V2) |
Alibaba Cloud Linux 3 | Aliyun | x86_64 | Alibaba Cloud Linux 3.2104 LTS 64-bit | aliyun_3_x64_20G_alibase_20240528.vhd |
Alibaba Cloud Linux 3 ARM | Aliyun | arm64 | Alibaba Cloud Linux 3.2104 LTS 64-bit ARM Edition | aliyun_3_arm64_20G_alibase_20240528.vhd |
Alibaba Cloud Linux UEFI 3 | Aliyun | x86_64 | Alibaba Cloud Linux UEFI 3.2104 Security Enhanced | aliyun_3_x64_20G_uefi_alibase_20230727.vhd |
Red Hat | Red Hat | x86_64 | Red Hat Enterprise Linux (RHEL) 9.3 64-bit | Red Hat Enterprise Linux 9.3 64-bit (RHEL 9 and later versions use cgroup V2 by default) |