Container Service for Kubernetes:Terway

Terway version

Kubernetes version

>=v1.10

>=Kubernetes 1.31

v1.9

>=Kubernetes 1.30

v1.8

>=Kubernetes 1.24

Version number

Registry Address

Change time

Changes

Impact

v1.8.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.4

April 22, 2024

• Fixed an issue where IP resource pool prefetch failed.

• Improved the idempotence of creating network cards and allocating IP addresses to mitigate resource leak issues.

• Adjusted the CNI configuration sequence to ensure that containers on new nodes are scheduled only after the CNI is fully started and running properly.

This upgrade does not affect your services.

v1.8.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.3

April 10, 2024

• Supports Red Hat 9.3.

• Fixed an issue where the vSwitch selection policy did not take effect.

• Fixed an issue with eRDMA quota calculation.

• Fixed an issue where alerts for invalid resource events were too sensitive.

• Fixed an issue with Hubble data ingestion.

• Fixed a forwarding issue in DataPath V2 mode.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.8.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.0

March 18, 2024

• Supports DataPath V2.

• Supports alibaba-addon-secret for registered clusters.

If you select DataPathV2 or IPvlan when creating a cluster, DataPathV2 is enabled.

v1.7.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.4

March 18, 2024

Fixed a potential issue where tokens could not be updated.

This upgrade does not affect your services.

v1.7.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.3

March 11, 2024

• Supports LINGJUN Clusters.

• Fixed an issue with eRDMA quota calculation.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.7.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.2

February 28, 2024

• Fixed a slow IP allocation issue.

• Fixed an issue where resource prefetch did not take effect.

This upgrade does not affect your services.

v1.7.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.0

February 18, 2024

• Supports elastic Remote Direct Memory Access (eRDMA).

• Optimized ENI allocation efficiency.

• Reduced the pressure on the kube-apiserver in IPvlan mode.

• The EIP feature is no longer supported in Terway.

• Requires Kubernetes 1.24 or later.

The EIP feature is no longer supported in Terway. To use this feature, see Migrate EIPs from Terway to ack-extend-network-controller.

If you have a large-scale cluster, the load on the kube-apiserver may increase for a short period during the upgrade. Monitor the resource usage of the kube-apiserver.

ACK dedicated clusters use node RAM roles for OpenAPI authentication. Clusters created before March 1, 2020 may lack the vpc:DescribeVSwitches permission. This affects component functionality. For more information about how to add the permission to the node RAM role, see Use RBAC to authorize resource operations in a cluster.

Version number

Registry Address

Change time

Changes

Impact

v1.6.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.3

January 24, 2024

• Fixed a Node Condition overwrite issue.

• Fixed an issue where node rules were not cleared in policy-based routing mode.

• Fixed an issue where IP addresses were not reclaimed for a long time after a stateful application was released.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.6.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.1

November 21, 2023

• Fixed an issue where service backends might not be updated in IPvlan mode.

• Fixed an issue of duplicate IP allocation.

This upgrade does not affect your services.

v1.4.9

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.9

November 21, 2023

Fixed an issue of duplicate IP allocation.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.6.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.0

October 10, 2023

• Supports migrating EIPs from Terway to ack-extend-network-controller.

• Supports Kind configuration for the terway-controlplane component's StatefulSet.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.5.7

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.7

August 24, 2023

• Optimized the startup speed of Terway.

• Fixed an intermittent timeout issue with health checks.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact of changes

v1.5.6

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.6

July 30, 2023

Supports configuring a custom CNI chain.

This upgrade does not affect your services.

v1.5.5

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.5

July 6, 2023

Supports configuring a whitelist for ENIs.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.5.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.4

June 1, 2023

Fixed an issue where network jitter might occur during an upgrade in IPvlan mode.

This upgrade does not affect your services.

v1.4.8

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.8

June 1, 2023

Fixed an issue where network jitter might occur during an upgrade in IPvlan mode.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.5.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.3

May 16, 2023

Fixed a potential issue in v1.4.4 where ExternalIPs could not be accessed.

This upgrade does not affect your services.

v1.5.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.2

May 10, 2023

• Fixed an issue where an upgrade failure might cause nodes to become NotReady.

• Fixed an issue where the webhook injected unnecessary zone constraints in Trunking mode.

This upgrade does not affect your services.

v1.4.6

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.6

May 10, 2023

Fixed an issue where an upgrade failure might cause nodes to become NotReady.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.5.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.1

April 28, 2023

• Supports Kubernetes 1.26. Starting from v1.5.1, Terway requires Kubernetes 1.22 or later.

• Upgraded Felix to v3.24.5.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.4.5

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.5

March 31, 2023

Reduced Role-Based Access Control (RBAC) permissions.

This upgrade does not affect your services.

v1.4.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.4

March 14, 2023

• Supports modifying vSwitch configurations in the component management page.

• Optimized the high memory usage of components in IPvlan mode.

• Upgraded Cilium to version 1.12.7.

• Upgraded iptables to version 1.8.8.

If IPVlan is enabled for the cluster, you cannot access the external IP address of a LoadBalancer service from within the cluster in Local mode (where externalTrafficPolicy=Local ) if the backend is not on the current node. You can use the ClusterIP to access the service or change the externalTrafficPolicy of the service to `Cluster`.

Version number

Registry Address

Change time

Changes

Impact

v1.4.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.3

December 23, 2022

• Upgraded Cilium to version 1.12.4.

• Fixed a potential issue of duplicate pod IP allocation.

• Changed the component upgrade policy to RollingUpdate.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.4.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.2

November 21, 2022

• Fixed a compatibility issue with LocalDNS in Trunking mode.

• Fixed a compatibility issue between NetworkPolicy (non-IPvlan mode) and Pod PostStartHook.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Change Impact

v1.4.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.1

September 28, 2022

• Supports parameter configuration for the terway-eniip component. You can modify the parameters on the component management page.

• Fixed a hairpin access failure issue.

• Fixed an IP allocation anomaly issue during out-of-order CNI execution.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact of the change

v1.4.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.0

August 29, 2022

• Upgraded Cilium to 1.12.1.

• Requires Kubernetes 1.20 or later.

If you enable IPvlan mode for your cluster, Cilium-related CRDs are updated during the cluster upgrade. If you have a large-scale cluster, the load on the kube-apiserver may increase for a short period. Monitor the resource usage of the kube-apiserver.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact of the change

v1.3.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.3.0

July 22, 2022

Supports Pod QoS management. For more information, see Configure QoS for a pod.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact of the change

v1.2.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.4

June 28, 2022

• Fixed an issue where the portmap plug-in did not take effect.

• Fixed an issue where EIPs could not be deleted.

• Fixed a service backend traffic imbalance issue in IPvlan mode.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.2.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.3

May 26, 2022

• Supports premium EIP and EIP bandwidth plan configurations.

• Fixed an issue where Kubelet container health checks failed when Cilium NetworkPolicy was used.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.2.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.2

March 31, 2022

Fixed an ARP probing issue in VLAN mode.

This upgrade does not affect your services.

v1.2.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.1

March 15, 2022

• Fixed an issue where calico-felix fell back to legacy iptables mode on Alibaba Cloud Linux 3.

• Fixed an IP reclamation failure issue when metadata was abnormal.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact of changes

v1.2.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.0

January 11, 2022

• Optimized the efficiency of locks during CNI execution.

• Supports pods accessing their own services in IPvlan mode.

• In IPvlan mode, when accessing an ExternalIP from within a cluster, LoadBalancer traffic is load balanced to the service network. This feature is enabled by default in new clusters. You can enable in-cluster load balancing for existing Terway IPvlan clusters. For more information, see How do I enable in-cluster load balancing for a Terway IPvlan cluster?.

• Fixed a false positive issue in Terway VPC mode.

• Optimized calico-felix performance in large-scale clusters.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.1.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.1.1

December 20, 2021

• Improved network card resource reclamation to mitigate IPvlan creation failures caused by netns leaks in Containerd scenarios.

• Supports configuring multiple security groups for ENIs. For more information, see Configure multiple security groups for an ENI.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.1.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.1.0

November 22, 2021

• Supports IPv6 dual-stack.

• Upgraded Felix to v3.20.2.

• Upgraded CNI from version 0.3.0 to 0.3.1.

• Adapted the deployment template for Kubernetes 1.22. This version and later require Kubernetes 1.18 or later.

• Fixed an intermittent network card misconfiguration issue in IPvlan mode. For more information, see #261.

• Added a 100Mi memory request for the Policy container.

• If you have deployed Typha in your cluster to optimize NetworkPolicy performance, update the component version. For more information, see Improve the extensibility of NetworkPolicy in a large-scale Terway cluster.

• If you have not deployed Typha in your cluster, this upgrade does not affect your services.

• If you have not enabled IPvlan mode for your cluster, calico-felix-related CRDs are updated during the cluster upgrade. If you have a large-scale cluster, the load on the kube-apiserver may increase for a short period. Monitor the resource usage of the kube-apiserver.

• Make sure your nodes have sufficient memory to prevent pods from being evicted by Kubernetes during the upgrade.

Version number

Registry Address

Change time

Changes

Change impact

v1.0.10.443-gaa1bfcc-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.443-gaa1bfcc-aliyun

September 14, 2021

Reduced network latency.

This update applies only to users who use Terway in exclusive ENI mode. No update is required for other modes.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact of the change

v1.0.10.398-g63d2e57-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.398-g63d2e57-aliyun

August 4, 2021

• Fixed an intermittent issue where NetworkPolicy did not take effect in inclusive ENI mode.

• Upgraded the Cilium plug-in to version 1.10.

If you enable IPvlan mode for your cluster, Cilium-related CRDs are updated during the cluster upgrade. If you have a large-scale cluster, the load on the kube-apiserver may increase for a short period. Monitor the resource usage of the kube-apiserver.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.390-g5f3c461-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.390-g5f3c461-aliyun

July 2, 2021

• Fixed an issue where you did not have permission to modify pod annotations when using EIPs in Terway network mode.

• Fixed an issue where Terway failed to start when using exclusive ENIs in Terway mode.

• Adapted to the network namespace path in Containerd mode.

• Supports Alibaba Cloud Linux 3.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.368-g2890967-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.368-g2890967-aliyun

May 24, 2021

• Fixed an issue where the ResourceInvalid alert was triggered in EIP scenarios.

• Supports direct communication between a pod and its node in IPvlan mode. This allows data to be forwarded on the local machine instead of being routed through the VPC.

• Supports proactively checking and correcting the ip forwarding configuration.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.333-gfd2b7b8-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.333-gfd2b7b8-aliyun

April 26, 2021

• Fixed an address conflict issue when stateful applications used EIPs.

• Supports enabling Hubble in IPvlan mode. For more information about Hubble, see What is Hubble.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.323-g778c128-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.323-g778c128-aliyun

March 22, 2021

• Optimized the number of OpenAPI request calls.

• Optimized event alerting when checking security group configurations.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.317-g0652857-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.317-g0652857-aliyun

February 22, 2021

• Fixed a Cilium Identity resource leak issue.

• Fixed an intermittent pod IP management issue for stateful applications.

This upgrade does not affect your services.

v1.0.10.309-g5314eee-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.309-g5314eee-aliyun

February 5, 2021

• Removed the logic for proactively fixing security group rules. Now, only event prompts are used for fixes.

• Fixed an intermittent issue where pod IP addresses were reclaimed and then reallocated when the node was under high load.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.301-g0115576-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.301-g0115576-aliyun

January 21, 2021

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.280-gdc2cb6c-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.280-gdc2cb6c-aliyun

December 25, 2020

• Added proactive checks for Terway, including the following:

  • ENIs and their secondary IPs.

  • Security group consistency.

  • Pod network namespace configuration.

  • Host network configuration.

• Added support for host network stack routes in IPVLAN mode.

This upgrade does not affect your services.

v1.0.10.263-gdbe50a9-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.263-gdbe50a9-aliyun

December 3, 2020

Fixed an anomaly in Terway when in ENI exclusive mode.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.261-g8342155-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.261-g8342155-aliyun

November 27, 2020

• Supports using synchronous calls to invoke ECS APIs.

• Fixed an issue where an error message was returned when using the CNI plug-in.

This upgrade does not affect your services.

v1.0.10.250-gb7bb10a-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.250-gb7bb10a-aliyun

November 23, 2020

• Fixed a pod network issue when the ENI driver failed to load.

• Fixed an IP status issue when ENI OpenAPI calls are throttled.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.247-g4cb77d0-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.247-g4cb77d0-aliyun

October 26, 2020

Supports ECS DDH instance types.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.237-g6a0f948-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.237-g6a0f948-aliyun

September 16, 2020

Optimized the ENI attachment speed.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Change Impact

v1.0.10.221-g8d6386a-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.221-g8d6386a-aliyun

August 11, 2020

Supports IPVLAN+eBPF container networks.

This upgrade does not affect your services.

v1.0.10.213-g27145cc-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.213-g27145cc-aliyun

August 4, 2020

Fixed an intermittent pod network issue caused by ENI unavailability.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.208-gf3144bf-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.208-gf3144bf-aliyun

July 20, 2020

• Fixed a policy-based route leak issue on high-density nodes.

• Supports internal OpenAPI.

• Fixed an issue where pod IP addresses could not be released when the vSwitch was full.

• Optimized the display of error messages for CNI failures.

This upgrade does not affect your services.

v1.0.10.211-gef088a4-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.211-gef088a4-aliyun

July 24, 2020

Adds a cluster ID tag to ENIs.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.156-g8660a0f-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.156-g8660a0f-aliyun

April 22, 2020

• Optimized the caching efficiency of Elastic Network Interface (ENI) network resources.

• Upgraded the built-in Felix to version 3.5.8.

• Added network resource reclamation for pods in the Completed or Failed state.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.139-g14a4f84-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.139-g14a4f84-aliyun

February 12, 2020

Fixed an intermittent pod creation timeout issue.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.133-g001396b-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.133-g001396b-aliyun

January 10, 2020

• Supports disabling NetworkPolicy.

• Supports using IPVlan as the pod network virtualization technology for inclusive ENI clusters.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact of changes

v1.0.10.122-gd0be015-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.122-gd0be015-aliyun

December 24, 2019

Improves the allocation efficiency of multiple IP addresses to ENIs.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.10.100-g92a3fa5-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.100-g92a3fa5-aliyun

October 11, 2019

Fixed an issue where host nodes became NotReady due to many concurrent Job calls.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.9.20-g35ae000-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.20-g35ae000-aliyun

August 23, 2019

Compatible with Kubernetes 1.14.6.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impact

v1.0.9.15-g3957085-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.15-g3957085-aliyun

April 11, 2019

Fixed an intermittent failure issue during Terway component upgrades.

This upgrade does not affect your services.

Version number

Registry Address

Change time

Changes

Impacts of the change

v1.0.9.14-ga0346bb-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.14-ga0346bb-aliyun

March 28, 2019

• Fixed an issue where Terway failed to obtain ENI information when the meta server was throttled.

• Fixed an issue where the error failed to move veth to host netns: file exists was reported when creating a container.

• Added a feature to periodically scan the status of ENIs and reclaim abnormally released ENIs.

• Optimized health checks: The Terway health check method was changed from HTTP path checks to TCP port checks.

This upgrade does not affect your services.