All Products
Search
Document Center

Container Service for Kubernetes:ACK Virtual Node

Last Updated:Jan 24, 2024

ack-virtual-node enables seamless integration between Kubernetes and Elastic Container Instance (ECI). This topic introduces ack-virtual-node, and describes the usage notes and release notes for ack-virtual-node.

Introduction

ack-virtual-node is developed based on the open source Virtual Kubelet project and adds support for Aliyun Provider. Improvements are made to this component to enable seamless integration between Kubernetes and ECI. This way, Kubernetes clusters are empowered with high elasticity and are no longer limited by the computing capacity of cluster nodes. You can create ECI-based pods as needed to avoid the planning of cluster capacity.

ack-virtual-node can be used to run pods on serverless elastic container instances. Elastic container instances are highly elastic and are billed on a pay-as-you-go basis. You can deploy ECI-based pods without the need to plan the capacity of your cluster in advance. You can use ack-virtual-node to improve the efficiency of application deployment and auto scaling, and minimize the computing cost in multiple scenarios. These scenarios include Job tasks, continuous integration and continuous delivery (CI/CD), Apache Spark big data computing, and online application auto scaling.

For more information about Elastic Container Instance-based pods, see Overview of elastic container instances.vk

Usage notes

For more information about how to deploy ack-virtual-node from the App Catalog page of the ACK console, see Deploy the virtual node controller and use it to create Elastic Container Instance-based pods.

Release notes

January 2024

Version number

Image address

Release date

Description

Impact

v2.10.5

registry-$RegionId-vpc.ack.aliyuncs.com/acs/virtual-nodes-eci:v2.10.5

2023-01-03

The issue that endpoints are frequently updated in the metrics sharding mode is fixed.

No impact on workloads.

November 2023

Version number

Image address

Release date

Description

Impact

v2.10.4

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.10.4

2023-11-27

  • The following issue is fixed: The performance is compromised when ZoneRecords are created in Alibaba Cloud DNS PrivateZone.

  • The following issue is fixed: When an existing Simple Log Service project is selected when you create a cluster, the project does not take effect.

  • The following issue is fixed: Deleting the Certificate Signing Request (CSR) in specific scenarios causes restart failures.

  • The issue that the OperatingSystem=Linux label is case-sensitive is fixed.

No impact on workloads.

v2.10.3

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.10.3

2023-11-14

  • The following issue is fixed: When Alibaba Cloud DNS PrivateZone is enabled repeatedly, some new Services do not have creation records.

  • The following issue is fixed: Some persistent volume claims (PVCs) resize requests are not processed when the PVC controller is repeatedly enabled.

  • The issue that some metrics are missing when metrics are queried is fixed.

No impact on workloads.

v2.10.2

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.10.2

2023-11-10

The crash issue caused by network policy configurations is fixed.

No impact on workloads.

v2.10.1

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.10.1

2023-11-06

The following issue is fixed: Whether SidecarSet is dynamically enabled depends on whether the ack-kruise component is installed.

No impact on workloads.

October 2023

Version number

Image address

Release date

Description

Impact

v2.10.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.10.0

2023-10-30

  • New features

    • In Kubernetes 1.22 or later versions, elastic workloads support Kubernetes scheduling semantics, including topology spread constraints, node affinity, and node anti-affinity.

    • The SidecarSet controller is supported.

    • Network policies are supported.

    • The DADI P2P acceleration feature is supported to accelerate image pulling.

    • The eBPF DNSCache mechanism is supported.

    • The container instance type metric (container_instance_resource_limits) is supported.

    • GPU monitoring 2.0 is supported.

  • Optimization

    • The synchronization of the scheduling status of elastic container instances is optimized.

    • By default, new virtual nodes that are deployed in ACK Serverless clusters do not contain the virtual-kubelet.io/provider label.

    • The speed of scheduling pods to virtual nodes is optimized.

    • The ZoneRecords of headless Services in Alibaba Cloud DNS PrivateZone are optimized.

    • The retry mechanism that is triggered when the installation of the Managed Service for Prometheus component fails is optimized.

    • The log output is optimized.

    • The MetricsVpcNet feature gate is enabled by default.

  • Fixes

    • Issues such as the Usages field in certificates is incorrect are fixed.

    • The issue that pods are scheduled to a cordoned virtual node is fixed.

    • The issue that the pods occasionally remain in the Pending state when the nodes are overloaded is fixed.

No impact on workloads.

September 2023

Version number

Image address

Release date

Description

Impact

v2.9.7

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.9.7

2023-09-01

The following issue is fixed: The system crashes when elastic container instances fail to be scheduled and are automatically cleared.

No impact on workloads.

August 2023

Version number

Image address

Release date

Description

Impact

v2.9.6

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.9.6

2023-08-15

The retry mechanism that is triggered when the Managed Service for Prometheus component fails to start is optimized.

No impact on workloads.

July 2023

Version number

Image address

Release date

Description

Impact

v2.9.5

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.9.5

2023-07-27

The speed of scheduling pods to virtual nodes is optimized.

No impact on workloads.

v2.9.4

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.9.4

2023-07-26

  • The WaitForFirstConsumer feature gate is enabled by default.

  • The incorrect environment variable of pods (KUBERNETES_SERVICE_PORT_HTTPS) is fixed.

  • The issue that the information about the inventory of ARM-based nodes becomes outdated is fixed.

No impact on workloads.

June 2023

Version number

Image address

Release date

Description

Impact

v2.9.3

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.9.3

2023-06-21

  • ACK clusters provide full support for ARM-based nodes.

  • The issue that occurs when the workloads deployed on ARM-based nodes reference the NodeName field through the downward API is fixed.

  • The issue that custom labels and annotations cannot be configured for nodes of version 2.9.X is fixed.

  • The issue that the virtual node component crashes when the -disable-taint parameter is specified is fixed.

  • The issue that the --node-arch parameter does not take effect is fixed.

  • The following issue is fixed: Pods remain in the Pending state when the WaitForFirstConsumer feature is enabled in some cases.

No impact on workloads.

v2.9.2

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.9.2

2023-04-28

The issue that pods cannot be scheduled to virtual nodes in ACK Basic clusters is fixed.

No impact on workloads.

v2.9.1

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.9.1

2023-04-20

  • The issue that virtual nodes keep disappearing and reappearing is fixed.

  • The issue that elastic container instance scheduling failures are not synchronized in Fail Fast mode is fixed.

  • The behavior of headless Services in Alibaba Cloud DNS PrivateZone is optimized.

No impact on workloads.

v2.8.8

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.8.8

2023-04-27

The issue that pods are restarted together with the component in some cases is fixed.

No impact on workloads.

March 2023

Version number

Image address

Release date

Description

Impact

v2.9.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.9.0

2023-03-30

  • ARM-based nodes are enabled for ACK Serverless clusters.

  • A new type of elastic container instance that supports the acs-visible-only attribute is available.

  • The ContainerInstanceCreated condition is added to indicate the status of elastic container instances.

  • The container_spec_cpu_shares metric is added.

  • The update logic of pods is optimized to reduce pod updates that are not required.

  • The installation logic, uninstallation logic, and error messages of the managed Prometheus component are optimized.

  • The configuration logic and error messages of DNSConfig are optimized.

  • The synchronization of events and states of elastic container instances is optimized.

  • The scheduling logic of pods whose Pod.Spec.NodeName parameter is manually specified is optimized.

  • The default number of entries in a log is set to 500.

  • The issue where the exec or attach command cannot be run in pods that are in the Pending state is fixed.

No impact on workloads.

v2.8.5

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.8.5

2023-03-02

The issue of elastic container instance leakage in extreme cases is fixed.

No impact on workloads.

December 2022

Version number

Image address

Release date

Description

Impact

v2.8.4

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.8.4

2022-12-27

  • The Fail Fast mode is optimized.

  • The issue that a pod changes to the previous state is fixed.

  • The issue that Alibaba Cloud DNS PrivateZone cannot resolve the domain name of a headless Service is fixed.

  • The issue of resource leakage during pod deletions when GracePeriod=0 is configured is fixed.

No impact on workloads.

November 2022

Version number

Image address

Release date

Description

Impact

v2.8.3

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.8.3

2022-11-25

  • The issue that the DNS records in Alibaba Cloud DNS PrivateZone are invalid when cluster domain names are used is fixed.

  • The issue that custom environment variables are overwritten by predefined environment variables is fixed.

  • The issue that only the first ImagePullSecret takes effect when multiple ImagePullSecrets are created is fixed.

  • The issue that ack-virtual-node stops running when APIServices are unavailable is fixed.

No impact on workloads.

v2.8.1

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.8.1

2022-11-21

  • The issue that metrics for CPU utilization are improperly displayed is fixed.

  • The display of reasons for pod creation failures is optimized.

  • Pod creation is automatically retried if the cause of failure is MissingParameter.

No impact on workloads.

v2.8.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.8.0

2022-11-21

  • Pod networking is supported.

  • Monitoring metrics for dynamic expansions of persistent volume claims (PVCs) are supported.

  • The issue that errors are reported by Alibaba Cloud DNS PrivateZone when the ServiceName parameter is left empty in the configuration of a StatefulSet is fixed.

  • The issue that ZoneRecords cannot be deleted when a large number of endpoints exist is fixed.

  • The frequent issue that False is returned for ContainerDiskPressure is fixed.

  • The issue that an ErrPodNotFound event is generated when a pod is in the Terminating state is fixed.

No impact on workloads.

v2.7.5

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.7.5

2022-11-07

Role-based access control (RBAC) resources of V2.7.4 are cleared.

No impact on workloads.

October 2022

Version number

Image address

Release date

Description

Impact

v2.7.4

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.7.4

2022-10-28

  • Pod creation is accelerated.

  • The issue that idempotent pod creation occasionally fails is fixed.

No impact on workloads.

September 2022

Version number

Image address

Release date

Description

Impact

v2.7.3

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.7.3

2022-09-28

The issue that the annotations of registered nodes are not updated is fixed.

No impact on workloads.

v2.7.2

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.7.2

2022-09-13

  • The issue that idempotent pod creation occasionally fails is fixed.

  • The issue that alert notifications cannot be sent after you use eci-profile to enable the logging and alerting feature.

No impact on workloads.

August 2022

Version number

Image address

Release date

Description

Impact

v2.7.1

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.7.1

2022-08-17

The issue that pod creation occasionally fails is fixed.

No impact on workloads.

v2.7.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.7.0

2022-08-02

  • The managed logging component can be installed.

  • The managed Prometheus component can be installed.

  • Elastic container instance exceptions can be reported.

  • The idempotence of API requests for creating elastic container instances is optimized.

  • The mechanism of scheduling pods to nodes is optimized.

No impact on workloads.

July 2022

Version number

Image address

Release date

Description

Impact

v2.6.1

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.6.1

2022-07-05

The issue that ack-virtual-node occasionally becomes stuck in the startup process is fixed.

No impact on workloads.

June 2022

Version number

Image address

Release date

Description

Impact

v2.6.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.6.0

2022-06-16

  • New features:

    • Custom ports are supported by kubelet.

    • The pod readiness gates feature is supported in Kubernetes 1.16.

    • The CSI Node feature is supported in Kubernetes 1.16.

    • The WaitForFirstConsumer binding mode is supported by volumes that use disks created from disk snapshots.

    • The nodeName field is supported by the downward API.

  • Fixed issues:

    • The issue that the labels that you configure for eci-profile do not take effect.

    • The issue that the time to live (TTL) values of logs is overwritten.

    • The issue that error logs are sent to the Logstore of the user.

  • Optimizations:

    • The synchronization of the local cache on client-go is optimized.

    • The registration logic and update logic of virtual nodes are optimized.

    • The event reporting mechanism for elastic container instances is optimized.

    • The size of HTTP request body is reduced.

No impact on workloads.

May 2022

Version number

Image address

Release date

Description

Impact

v2.5.4

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.5.4

2022-05-20

The issue that the component crashes when you configure eci-profile selectors is fixed.

No impact on workloads.

April 2022

Version number

Image address

Release date

Description

Impact

v2.5.3

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.5.3

2022-04-28

  • The issue that Metrics data occasionally fails to be obtained is fixed.

  • The issue that pods occasionally fail to connect to the API server is fixed.

No impact on workloads.

v2.5.2

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.5.2

2022-04-20

  • The issue that Alibaba Cloud DNS PrivateZone cannot be enabled is fixed.

  • The issue that the system does not respond to the exec command when the cluster runs Kubernetes 1.16 is fixed.

  • The issue that Metrics data cannot be obtained is fixed.

  • The issue that the status of the component may be inconsistent with the events of the component is fixed.

No impact on workloads.

March 2022

Version number

Image address

Release date

Description

Impact

v2.5.1

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.5.1

2022-03-31

  • The retention period of image caches can be configured.

  • The requests that are sent to the API server are optimized.

  • Pod creation is accelerated when you create a large number of pods.

  • The latency that occurs when you query Metrics data is reduced.

  • The issue that memory spikes occur when you concurrently query Metrics data is fixed.

  • The issue that duplicate Metrics data is returned is fixed.

  • The issue that the same data is returned from the /metrics and /metrics/cadvisor endpoints is fixed.

  • The issue that the SecretRef parameter of the Container Storage Interface (CSI) plug-in does not take effect is fixed.

  • The issue that the system does not respond or even crashes after you run the logs or exec command is fixed.

  • The issue that the component cannot run as normal in a private network is fixed.

No impact on workloads.

v2.4.3

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.4.3

2022-03-17

The issue that the system does not respond to the logs and exec commands when the cluster runs Kubernetes 1.16 is fixed.

No impact on workloads.

January 2022

Version number

Image address

Release date

Description

Impact

v2.4.2

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.4.2

2022-01-11

  • The issue of inconsistent status between a cluster and elastic container instances in the cluster is fixed.

  • The issue that Prometheus Monitoring cannot obtain data is fixed.

  • The issue that specific annotations in Elastic Container Instance Profile do not take effect is fixed.

No impact on workloads.

December 2021

Version number

Image address

Release date

Description

Impact

v2.4.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.4.0

2021-12-28

  • Kubernetes 1.22 is supported.

  • Dynamic expansion of persistent volume claims (PVCs) is supported.

  • The WaitForFirstConsumer volume binding mode is supported.

  • The efficiency of calling the Elastic Container Instance API is improved.

  • The issue that the version number of a virtual node is improperly displayed after the cluster is upgraded is fixed.

  • The issue of status inconsistency between Job pods and the elastic container instances on which the pods run is fixed.

  • The issue of status inconsistency between pods and the elastic container instances on which the pods run is fixed.

  • The issue that the SecretRef parameter in the CephFS and FlexVolume configurations does not take effect is fixed.

  • The issue that the component occasionally stops running is fixed.

No impact on workloads.

November 2021

Version number

Image address

Release date

Description

Impact

v2.3.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.3.0

2021-11-15

  • Service account token volume projection is supported.

  • IPv4/IPv6 dual stack is supported.

  • Different types of overlay networks are supported.

  • The issue that the component stops running in specific cases is fixed.

  • Pod creation is accelerated.

  • The pod scheduling issue is fixed.

  • The issue that the reclaim process of elastic container instances is slow is fixed.

No impact on workloads.

October 2021

Version number

Image address

Release date

Description

Impact

v2.2.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.2.0

2021-10-26

Queries for events and status are accelerated.

No impact on workloads.

v2.1.0

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.1.0

2021-10-12

New features:

  • Images can be pulled without a password from instances of Container Registry Enterprise Edition.

  • Secrets can be referenced for PVCs, CephFS, and FlexVolume.

  • The HugePages feature is supported by nodes.

Fixed issues:

  • The issue of Elastic Container Instance resource leakage in specific cases

  • The issue that the displayed information about CPU workloads is wrong

  • The issue that nodes change to the NotReady state due to slow restarts

  • The issue of pod creation failures due to excessively long URLs

  • The issue that ClusterRoles are deleted in specific cases

Optimizations:

  • Pod creation is accelerated.

  • Image caching is accelerated.

No impact on workloads.

May 2021

Version number

Image address

Release date

Description

Impact

v2.0.0.122-bdb884460-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.122-bdb884460-aliyun

2021-05-24

The issue that nodes are repeatedly created when concurrent requests are processed is fixed.

No impact on workloads.

v2.0.0.113-650b21c48-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.113-650b21c48-aliyun

2021-05-13

Rolling update for Alibaba Cloud DNS PrivateZone is supported.

No impact on workloads.

v2.0.0.110-49c928287-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.110-49c928287-aliyun

2021-05-06

Node selectors can be used to configure pod scheduling. This means that when a pod is configured with the type=virtual-kubelet label, the pod is managed by Virtual Kubelet.

No impact on workloads.

April 2021

Version number

Image address

Release date

Description

Impact

v2.0.0.102-045a06eb4-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.102-045a06eb4-aliyun

2021-04-22

The issue that information about Virtual Kubelet nodes is improperly displayed is fixed.

No impact on workloads.

v2.0.0.101-cd8bcfa04-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.101-cd8bcfa04-aliyun

2021-04-16

The calling of the Alibaba Cloud DNS PrivateZone API is optimized. This avoids repeated calls to BindZoneVpc.

No impact on workloads.

v2.0.0.93-ef86bbfa1-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.93-ef86bbfa1-aliyun

2021-04-13

The value of eciLogtailMacheineGroupKey is modified to support the log collection feature of environment variables and CustomResourceDefinitions (CRDs).

No impact on workloads.

v2.0.0.90-15deb126e-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.90-15deb126e-aliyun

2021-04-06

The feature of Elastic Container Instance Profile is supported.

No impact on workloads.

March 2021

Version number

Image address

Release date

Description

Impact

v2.0.0.86-9005a977d-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.86-9005a977d-aliyun

2021-03-17

  • The /etc/hosts file is optimized to support the Domain and DNS annotations.

  • The time required to check ClusterRoleBinding is reduced.

  • Leader elections for multiple components are optimized.

No impact on workloads.

February 2021

Version number

Image address

Release date

Description

Impact

v2.0.0.80-f9a46a994-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.80-f9a46a994-aliyun

2021-02-25

The feature of checking the CreatePod state is optimized: A pod can be created only when CreatePod is in the Pending state.

No impact on workloads.

v2.0.0.76-6e9e19bd5-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.76-6e9e19bd5-aliyun

2021-02-22

  • PProf debugging is supported.

  • Switches are added to control leader elections.

  • ClusterRole is updated for EndPointSlice.

  • Annotations related to Kubernetes versions can be added to pods.

  • Different webhooks can be configured in related Kubernetes versions.

No impact on workloads.

December 2020

Version number

Image address

Release date

Description

Impact

v2.0.0.618-7fd50d738-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v2.0.0.618-7fd50d738-aliyun

2020-12-04

  • Compatibility with pods is improved.

  • Multiple leader election logic of the Virtual Kubelet controller is supported.

Make sure that virtual private clouds (VPCs) and security groups are correctly configured for pods, and the pods can access the API server of your cluster. Otherwise, the pods remain in the waiting state.

September 2020

Version number

Image address

Release date

Description

Impact

v1.0.0.10-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/virtual-nodes-eci:v1.0.0.10-aliyun

2020-09-21

Auto scaling of clusters is supported. Pods are run as serverless container groups on Elastic Container Instance.

No impact on workloads.

March 2020

Version number

Image address

Release date

Description

Impact

v1.0.0.2-aliyun

registry-vpc.$RegionId.aliyuncs.com/acs/virtual-nodes-eci:v1.0.0.2-aliyun

2020-03-12

  • The virtual-nodes-eci controller can be deployed on StatefulSets. This allows you to change the number of replicated pods to create multiple virtual nodes and more pods.

  • The names of virtual nodes use the virtual-node-eci-$n format.

  • Pods are allowed to access ClusterIP Services.

  • Preemptible instances are supported.

  • Disks can be mounted by using the Container Storage Interface (CSI) plug-in.

If the virtual-nodes-eci controller is deployed on a Deployment, delete the pods on the virtual-kubelet node and install the component again.