Container Service for Kubernetes:Terway component release notes

Terway version

Kubernetes version

>=v1.10

>=Kubernetes 1.31

v1.9

>=Kubernetes 1.30

v1.8

>=Kubernetes 1.24

Version

Registry Address

Update date

Changes

Impact

v1.8.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.4

April 22, 2024

• Fixed an issue where IP resource pool prefetch failed.

• Improved the idempotence of creating network cards and allocating IP addresses to mitigate resource leak issues.

• Adjusted the CNI configuration sequence to ensure that containers on new nodes are scheduled only after the CNI is fully started and running properly.

This upgrade does not affect your services.

v1.8.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.3

April 10, 2024

• Added support for Red Hat 9.3.

• Fixed an issue where the vSwitch selection policy did not take effect.

• Fixed an issue with eRDMA quota calculation.

• Fixed an issue where event alerts for invalid resources were too sensitive.

• Fixed an issue with Hubble data collection.

• Fixed a forwarding issue in DataPath V2 mode.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.8.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.0

March 18, 2024

• Added support for DataPath V2.

• Added support for alibaba-addon-secret in registered clusters.

If you select DataPathV2 or IPvlan when you create a cluster, DataPathV2 is enabled.

v1.7.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.4

March 18, 2024

Fixed a potential issue where tokens could not be updated.

This upgrade does not affect your services.

v1.7.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.3

March 11, 2024

• Added support for LINGJUN Clusters.

• Fixed an issue with eRDMA quota calculation.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.7.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.2

February 28, 2024

• Fixed a slow IP address allocation issue.

• Fixed an issue where resource prefetch did not take effect.

This upgrade does not affect your services.

v1.7.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.0

February 18, 2024

• ERDMA is supported.

• Optimized ENI allocation efficiency.

• Reduced the pressure on kube-apiserver in IPvlan mode.

• The EIP feature is no longer supported in Terway.

• The minimum compatible Kubernetes version is 1.24.

The EIP feature is no longer supported in Terway. To use this feature, see Migrate EIPs from Terway to ack-extend-network-controller.

If your cluster is large, the load on kube-apiserver may increase for a short period during the upgrade. Monitor the resource usage of kube-apiserver.

ACK dedicated clusters use node RAM roles for OpenAPI authentication. Clusters created before March 1, 2020 may lack the vpc:DescribeVSwitches permission. This affects component functionality. See Use RBAC to authorize resource operations in a cluster to add this permission to the node RAM role.

Version

Registry address

Update date

Changes

Impact

v1.6.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.3

January 24, 2024

• Fixed an issue where Node Condition was overwritten.

• Fixed an issue where node rules were not cleared in policy-based routing mode.

• Fixed an issue where IP addresses were not reclaimed for a long time after stateful applications were released.

This upgrade does not affect your services.

Version

Registry address

Modification Time

Changes

Impact

v1.6.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.1

November 21, 2023

• Fixed a potential issue where service backends were not updated in IPvlan mode.

• Fixed an issue of duplicate IP address allocation.

This upgrade does not affect your services.

v1.4.9

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.9

November 21, 2023

Fixed an issue of duplicate IP address allocation.

This upgrade does not affect your services.

Version

Registry Address

Modification Time

Changes

Impact

v1.6.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.0

October 10, 2023

• Added support for migrating EIPs from Terway to ack-extend-network-controller.

• Added support for Kind configuration for StatefulSet applications in the terway-controlplane component.

This upgrade does not affect your services.

Version

Registry address

Modification Time

Changes

Impact

v1.5.7

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.7

August 24, 2023

• Optimized the startup speed of Terway.

• Fixed an occasional health check timeout issue.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.5.6

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.6

July 30, 2023

Added support for configuring a custom CNI chain.

This upgrade does not affect your services.

v1.5.5

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.5

July 6, 2023

Added support for configuring a whitelist for ENIs.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.5.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.4

June 1, 2023

Fixed a potential network jitter issue during upgrades in IPvlan mode.

This upgrade does not affect your services.

v1.4.8

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.8

June 1, 2023

Fixed a potential network jitter issue during upgrades in IPvlan mode.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.5.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.3

May 16, 2023

Fixed a potential issue in v1.4.4 where ExternalIPs could not be accessed.

This upgrade does not affect your services.

v1.5.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.2

May 10, 2023

• Fixed a potential issue where an upgrade failure could cause nodes to become NotReady.

• Fixed an issue where the webhook injected unnecessary zone constraints in Trunking mode.

This upgrade does not affect your services.

v1.4.6

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.6

May 10, 2023

Fixed a potential issue where an upgrade failure could cause nodes to become NotReady.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of the change

v1.5.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.1

April 28, 2023

• Added support for Kubernetes 1.26. Starting from v1.5.1, Terway is compatible with Kubernetes 1.22 and later.

• Upgraded Felix to v3.24.5.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.4.5

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.5

March 31, 2023

Reduced Role-Based Access Control (RBAC) permissions.

This upgrade does not affect your services.

v1.4.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.4

March 14, 2023

• Added support for modifying vSwitch configurations in the component management console.

• Optimized high memory usage of the component in IPvlan mode.

• Upgraded Cilium to 1.12.7.

• Upgraded iptables to 1.8.8.

If IPVlan is enabled for the cluster, you cannot access a backend that is not on the current node when in Local mode (for scenarios where a LoadBalancer service uses externalTrafficPolicy=Local to access its ExternalIP from within the cluster). You can use a ClusterIP to access the service, or update the Service with externalTrafficPolicy=Cluster .

Version

Registry address

Update date

Changes

Change impact

v1.4.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.3

December 23, 2022

• Upgraded Cilium to 1.12.4.

• Fixed a potential issue of duplicate pod IP address allocation.

• Changed the component upgrade policy to RollingUpdate.

This upgrade does not affect your services.

Version

Registry Address

Update date

Changes

Impact

v1.4.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.2

November 21, 2022

• Fixed a compatibility issue with LocalDNS in Trunking mode.

• Fixed a compatibility issue between NetworkPolicy (non-IPvlan mode) and Pod PostStartHook.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.4.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.1

September 28, 2022

• Added support for configuring terway-eniip component parameters on the component management page.

• Fixed a hairpin access failure issue.

• Fixed an abnormal IP address allocation issue when CNI execution is out of order.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of Changes

v1.4.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.0

August 29, 2022

• Upgraded Cilium to 1.12.1.

• The minimum compatible Kubernetes version is 1.20.

If the IPvlan mode is enabled for your cluster, the CRDs related to Cilium are updated during the cluster upgrade. If your cluster is large, the load on kube-apiserver may increase for a short period. Monitor the resource usage of kube-apiserver.

This upgrade does not affect your services.

Version

Registry address

Modification Time

Changes

Impact of the change

v1.3.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.3.0

July 22, 2022

Added support for Pod QoS management. For more information, see Configure QoS for pods.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.2.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.4

June 28, 2022

• Fixed an issue where the portmap plug-in did not take effect.

• Fixed an issue where EIPs could not be deleted.

• Fixed an issue of unbalanced traffic to service backends in IPvlan mode.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.2.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.3

May 26, 2022

• Added support for premium EIP and EIP bandwidth plan configurations.

• Fixed an issue where Kubelet container health checks failed when Cilium NetworkPolicy was used.

This upgrade does not affect your services.

Version

Registry address

Modification Time

Changes

Impact

v1.2.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.2

March 31, 2022

Fixed an ARP probe issue in VLAN mode.

This upgrade does not affect your services.

v1.2.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.1

March 15, 2022

• Fixed an issue where calico-felix fell back to the legacy iptables mode on Alibaba Cloud Linux 3.

• Fixed an issue where IP addresses failed to be reclaimed when metadata was abnormal.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.2.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.0

January 11, 2022

• Optimized the lock efficiency during CNI execution.

• Added support for pods to access their own services in IPvlan mode.

• In IPvlan mode, when accessing an external IP address from within a cluster, LoadBalancer traffic is routed to the service network. This feature is enabled by default in new clusters. You can enable in-cluster load balancing for existing Terway IPvlan clusters. For more information, see How do I enable in-cluster load balancing for a Terway IPvlan cluster?.

• Fixed a false positive issue in Terway VPC mode.

• Optimized the performance of calico-felix in large-scale clusters.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.1.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.1.1

December 20, 2021

• Improved network card resource reclamation to mitigate IPvlan creation failures caused by netns leaks in Containerd scenarios.

• Added support for configuring multiple security groups for ENIs. For more information, see Configure multiple security groups for an ENI.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.1.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.1.0

November 22, 2021

• Added support for IPv6 dual-stack.

• Upgraded Felix to v3.20.2.

• Upgraded CNI from 0.3.0 to 0.3.1.

• Adapted the deployment template to Kubernetes 1.22. Starting from this version, the minimum compatible Kubernetes version is 1.18.

• Fixed an occasional network card configuration error in IPvlan mode. For more information, see #261.

• Added a 100Mi memory request to the Policy container.

• If you deployed Typha in your cluster to optimize NetworkPolicy performance, update the component. For more information, see Improve the scalability of NetworkPolicy in large-scale Terway clusters.

• If you have not deployed Typha in your cluster, this upgrade does not affect your services.

• If the IPvlan mode is disabled for your cluster, the CRDs related to calico-felix are updated during the cluster upgrade. If your cluster is large, the load on kube-apiserver may increase for a short period. Monitor the resource usage of kube-apiserver.

• Make sure that your nodes have sufficient memory to prevent pods from being evicted by Kubernetes during the upgrade.

Version

Registry address

Update date

Changes

Impacts

v1.0.10.443-gaa1bfcc-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.443-gaa1bfcc-aliyun

September 14, 2021

Reduced network latency.

This update applies only to users who use Terway in exclusive ENI mode. Other modes do not need to be updated.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Change impact

v1.0.10.398-g63d2e57-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.398-g63d2e57-aliyun

August 4, 2021

• Fixed an issue where NetworkPolicy occasionally failed to apply in inclusive ENI mode.

• Upgraded the Cilium plug-in to 1.10.

If the IPvlan mode is enabled for your cluster, the CRDs related to Cilium are updated during the cluster upgrade. If your cluster is large, the load on kube-apiserver may increase for a short period. Monitor the resource usage of kube-apiserver.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.0.10.390-g5f3c461-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.390-g5f3c461-aliyun

July 2, 2021

• Fixed an issue where permissions were insufficient to modify pod annotations when using EIPs in Terway network mode.

• Fixed an issue where Terway could not start when using exclusive ENIs in Terway mode.

• Adapted to the network namespace path in Containerd mode.

• Added support for Alibaba Cloud Linux 3.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of change

v1.0.10.368-g2890967-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.368-g2890967-aliyun

May 24, 2021

• Fixed an issue where an alert with the message ResourceInvalid was reported in EIP scenarios.

• Added support for direct communication between a pod and its node in IPvlan mode. This bypasses the VPC, meaning data is forwarded on the host instead of being routed through the VPC.

• Added support for proactively checking and correcting the ip forwarding configuration.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.0.10.333-gfd2b7b8-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.333-gfd2b7b8-aliyun

April 26, 2021

• Fixed an address conflict issue when stateful applications use EIPs.

• Added support for enabling Hubble in IPvlan mode. For more information about Hubble, see What is Hubble.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.0.10.323-g778c128-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.323-g778c128-aliyun

March 22, 2021

• Optimized the number of OpenAPI request calls.

• Optimized event alerting when checking security group configurations.

This upgrade does not affect your services.

Version

Registry address

Modification Time

Changes

Impact

v1.0.10.317-g0652857-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.317-g0652857-aliyun

February 22, 2021

• Fixed a Cilium Identity resource leak issue.

• Fixed an occasional pod IP management issue for stateful applications.

This upgrade does not affect your services.

v1.0.10.309-g5314eee-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.309-g5314eee-aliyun

February 5, 2021

• Removed the logic for proactively fixing security group rules. Now, only event prompts are used for fixes.

• Fixed an occasional issue where pod IP addresses were reclaimed and then reallocated when the node was under high load.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Change Impact

v1.0.10.301-g0115576-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.301-g0115576-aliyun

January 21, 2021

This upgrade does not affect your services.

Version

Registry address

Modification Time

Changes

Impact

v1.0.10.280-gdc2cb6c-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.280-gdc2cb6c-aliyun

December 25, 2020

• Added proactive checks for Terway, including the following:

  • ENIs and their secondary IP addresses.

  • Security group consistency.

  • Pod network space configuration.

  • Host network configuration.

• Added support for host network stack routing in IPVLAN mode.

This upgrade does not affect your services.

v1.0.10.263-gdbe50a9-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.263-gdbe50a9-aliyun

December 3, 2020

Fixed an abnormal Terway issue in exclusive ENI mode.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.0.10.261-g8342155-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.261-g8342155-aliyun

November 27, 2020

• Added support for using synchronous calls to invoke ECS APIs.

• Fixed an issue where an error message was returned when using the CNI plug-in.

This upgrade does not affect your services.

v1.0.10.250-gb7bb10a-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.250-gb7bb10a-aliyun

November 23, 2020

• Fixed a pod network issue when the ENI driver failed to load.

• Fixed a status issue with released IP addresses when ENI OpenAPI was throttled.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.0.10.247-g4cb77d0-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.247-g4cb77d0-aliyun

October 26, 2020

Added support for ECS DDH instance types.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.0.10.237-g6a0f948-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.237-g6a0f948-aliyun

September 16, 2020

Optimized the ENI attach speed.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Change impact

v1.0.10.221-g8d6386a-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.221-g8d6386a-aliyun

August 11, 2020

Added support for IPVLAN+eBPF container networks.

This upgrade does not affect your services.

v1.0.10.213-g27145cc-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.213-g27145cc-aliyun

August 4, 2020

Fixed an occasional issue where ENIs could not be used, causing pod network failures.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.0.10.208-gf3144bf-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.208-gf3144bf-aliyun

July 20, 2020

• Fixed a policy-based routing leak issue on high-density nodes.

• Added support for internal OpenAPI.

• Fixed an issue where pod IP addresses could not be released when the vSwitch was full.

• Optimized the display of error messages for CNI failures.

This upgrade does not affect your services.

v1.0.10.211-gef088a4-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.211-gef088a4-aliyun

July 24, 2020

Added a cluster ID tag to ENIs.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Change impact

v1.0.10.156-g8660a0f-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.156-g8660a0f-aliyun

April 22, 2020

• Optimized the caching efficiency of ENI network resources.

• Upgraded the built-in Felix to 3.5.8.

• Added network resource reclamation for pods in the Completed|Failed state.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.0.10.139-g14a4f84-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.139-g14a4f84-aliyun

February 12, 2020

Fixed an occasional pod creation timeout issue.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.0.10.133-g001396b-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.133-g001396b-aliyun

January 10, 2020

• You can disable NetworkPolicy.

• ENI multi-IP clusters use IPVlan for pod network virtualization.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.0.10.122-gd0be015-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.122-gd0be015-aliyun

December 24, 2019

Optimized the efficiency of allocating multiple IP addresses to ENIs.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact

v1.0.10.100-g92a3fa5-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.100-g92a3fa5-aliyun

October 11, 2019

Fixed an issue where many concurrent job calls caused the host node to become NotReady.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.0.9.20-g35ae000-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.20-g35ae000-aliyun

August 23, 2019

Made the component compatible with Kubernetes 1.14.6.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of changes

v1.0.9.15-g3957085-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.15-g3957085-aliyun

April 11, 2019

Fixed an occasional failure issue during the upgrade of the Terway component.

This upgrade does not affect your services.

Version

Registry address

Update date

Changes

Impact of the change

v1.0.9.14-ga0346bb-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.14-ga0346bb-aliyun

March 28, 2019

• Fixed an issue where Terway failed to obtain ENI information when the meta server was throttled.

• Fixed an issue where the error message failed to move veth to host netns: file exists was reported when creating a container.

• Added a feature to periodically scan the status of ENIs and reclaim abnormally released ENIs.

• Optimized health checks: The Terway health check method was changed from HTTP path checks to TCP port checks.

This upgrade does not affect your services.