Server Load Balancer:Migrate workloads from a self-managed NGINX Ingress to an ALB Ingress

Scenarios

Usage notes

• Make sure that a kubectl client is connected to the cluster. For more information, see Obtain the kubeconfig file of a cluster and use kubectl to connect to the cluster.

• CLB and ALB use the pay-as-you-go billing method. The billable items and pricing of CLB and ALB are different. After you migrate services from CLB to ALB, the fees change. For more information, see the following topics:

  • Pay-as-you-go CLB

  • ALB billing rules

Procedure

Step 1: Create an ALB Ingress

1. Log on to the ACK console and install the ALB Ingress controller. For more information, see Step 1: Install the ALB Ingress controller.

   The ALB Ingress controller must be installed in the ACK cluster or ACK Serverless cluster where the NGINX Ingress that you want to migrate is deployed.

2. Use the kubectl client to log on to the ACK cluster or ACK Serverless cluster where the NGINX Ingress is deployed and create an AlbConfig.

   1. Create a file named albconfig.yaml and copy the following content to the file:

      apiVersion: alibabacloud.com/v1
      kind: AlbConfig
      metadata:
        name: alb-demo
      spec:
        config:
          name: alb-test
          addressType: Internet
          zoneMappings:
          - vSwitchId: vsw-wz9e2usil7e5an1xi****
          - vSwitchId: vsw-wz92lvykqj1siwvif****
        listeners:
          - port: 80
            protocol: HTTP

      zoneMappings: the IDs of the vSwitches used by the ALB Ingress. You must specify at least two vSwitches that belong to different zones. The vSwitches that you specify must belong to the same virtual private cloud (VPC) as your cluster.

      Note

      If the NGINX Ingress that you want to migrate supports IPv6, you can set addressIpVersion to DualStack in the configuration of the AlbConfig. For more information, see Use AlbConfigs to configure ALB instances.

   2. Run the following command to create an AlbConfig:

      kubectl apply -f albconfig.yaml

   3. Run the following command to check whether the ALB instance is created:

      kubectl get albconfig

      Expected output:

      NAME       ALBID                    DNSNAME                                               PORT&PROTOCOL   CERTID   AGE
      alb-demo   alb-a8mmh2tqbmrm11****   alb-a8mmh2tqbmrm11****.cn-hangzhou.alb.aliyuncs.com                            27s

3. Create an IngressClass.

   1. Create a file named ingressclass.yaml and copy the following content to the file:

      apiVersion: networking.k8s.io/v1
      kind: IngressClass
      metadata:
        name: alb
      spec:
        controller: ingress.k8s.alibabacloud/alb
        parameters:
          apiGroup: alibabacloud.com
          kind: AlbConfig
          name: alb-demo

      parameters.name: the name of the AlbConfig that you want to use.

   2. Run the following command to create an IngressClass:

      kubectl apply -f ingressclass.yaml

4. Create an ALB Ingress.

   Important

   If advanced forwarding rules are configured on the NGINX Ingress, you can enable the advanced features of the ALB Ingress to forward requests that are destined for different domain names or URLs to different backend servers, redirect requests from HTTP to HTTPS, and perform canary releases. For more information, see ALB Ingress advanced features.

   1. Create a file named albingress.yaml and copy the following content to the file:

      apiVersion: networking.k8s.io/v1
      kind: Ingress
      metadata:
        name: demo-ingress-alb
        namespace: default
      spec:
        ingressClassName: alb
        rules:
          - host: www.example.net
            http:
              paths:
                - backend:
                    service:
                      name: nginx
                      port:
                        number: 80
                  path: /
                  pathType: Prefix

      • name: the name of the Ingress. In the same namespace, the name of the ALB Ingress must be different from the name of the NGINX Ingress.

      • ingressClassName: the name of the IngressClass that you want to use.

   2. Run the following command to create an ALB Ingress:

      kubectl apply -f albingress.yaml

   3. Run the following command to query ALB Ingress resources:

      kubectl get ing

      Expected output:

      NAME                CLASS   HOSTS              ADDRESS                                               PORTS   AGE
      demo-ingress-alb   alb     www.example.net   alb-a8mmh2tqbmrm11****.cn-hangzhou.alb.aliyuncs.com   80      10m     46s

      The output contains the endpoint of the ALB Ingress. Example: alb-a8mmh2tqbmrm11****.cn-hangzhou.alb.aliyuncs.com.

   4. Run the following command to access the backend services from the ALB Ingress to test the traffic volume.

      curl -H "Host:  www.example.net" http://alb-a8mmh2tqbmrm11****.cn-hangzhou.alb.aliyuncs.com

      If the expected output is returned, the ALB Ingress can access the backend services.

Step 2: Switch network traffic to the ALB Ingress

Step 1. Configure a temporary domain name for the CLB instance

1. Log on to the Alibaba Cloud DNS console.

2. On the Domain Name Resolution page, find and click the domain name www.example.net. The domain name points to the CLB instance.

3. On the DNS Settings page, click Add DNS Record. In the Add DNS Record panel, configure the following parameters and click OK.

   Parameter	Example
   Record Type	Select CNAME from the drop-down list.
   Hostname	The prefix of your domain name. In this example, www is entered.
   DNS Request Source	Select Default.
   Record Value	Enter a temporary domain name. In this example, web0.example.net is entered.
   TTL	Specify a TTL value for the CNAME record cached on the DNS server. The value is set to 5 seconds in this example. In this example, Alibaba Cloud DNS Enterprise Ultimate Edition is used. The TTL value is for reference only. You can specify a TTL value based on your business requirements. For more information, see Editions.

4. On the DNS Settings page, find the A record that points to the IP address of the CLB instance and click Modify in the Actions column.

5. In the Modify DNS Record panel, modify the Hostname parameter and click OK. In this example, the Hostname parameter is set to web0. The other parameters are not modified.

Step 2: Add a CNAME record for the ALB instance

1. Run the following command to query the domain name of the ALB instance:

   kubectl get albconfig

   Expected output:

   NAME       ALBID                    DNSNAME                                               PORT&PROTOCOL   CERTID   AGE
   alb-demo   alb-a8mmh2tqbmrm11****   alb-a8mmh2tqbmrm11****.cn-hangzhou.alb.aliyuncs.com                             27s

   Note

   You can also log on to the ALB console to view the domain name of the ALB instance. The ALB console provides only the configurations of ALB instances. To modify the configurations, refer to the YAML file.

2. To create a CNAME record, perform the following steps:

   1. Log on to the Alibaba Cloud DNS console.

   2. On the Domain Name Resolution page, click Add Domain Name.

   3. In the Add Domain Name dialog box, enter a domain name and click OK.

      Warning

      • The domain name associated with the CLB instance is added.

      • Before you create the CNAME record, you must use a TXT record to verify the ownership of the domain name.

   4. Find the domain name that you want to manage and click DNS Settings in the Actions column.

   5. On the DNS Settings page, click Add Record.

   6. In the Add DNS Record panel, configure the following parameters and click OK.

      Parameter	Example
      Record Type	Select CNAME from the drop-down list.
      Hostname	The prefix of your domain name. In this example, www is entered.
      DNS Request Source	Select Default.
      Record Value	Enter the CNAME. The CNAME is the domain name of the ALB instance.
      TTL	Specify a TTL value for the CNAME record cached on the DNS server. The value is set to 5 seconds in this example. In this example, Alibaba Cloud DNS Enterprise Ultimate Edition is used. The TTL value is for reference only. You can specify a TTL value based on your business requirements. For more information, see Editions.

      Note

      • New CNAME records immediately take effect. The time that is required for a modified CNAME record to take effect is determined by the TTL value of the CNAME record in the local DNS cache. The default TTL value is 10 minutes.

      • If the CNAME record that you want to create conflicts with an existing record, specify another domain name.

Step 3: Set weights and perform a canary release

1. On the Domain Name Resolution page, click the domain name that you want to manage. On the DNS Settings page, click Weight Settings in the left-side navigation pane.

2. On the Weighted Round-robin page, click EnableWeight in the Actions column, and then click Set Weight.

   To configure weights for different DNS records of the same domain name, the DNS records must be of the same type and have the same hostname and ISP line. The supported types are A, CNAME, and AAAA.

3. In the Set Weight panel, set the weights of the DNS records of the CLB and ALB instances. Set the weight of the DNS record for the CLB instance to 100. Set the weight of the DNS record for the ALB instance to 0.

   

4. Progressively reduce the weight of the DNS record for the CLB instance and progressively increase the weight of the DNS record for the ALB instance. Make sure that your services are not affected.

5. Log on to the ECS instance on which the pods of the Service are deployed and run the dig command multiple times to check the traffic volume.

   dig www.example.net

   The following figure shows the output. The results show that requests are distributed to ALB and CLB based on the weights of the DNS records.

6. Progressively reduce the weight of the CLB DNS record to 0 and progressively increase the ALB DNS record to 100.

Step 3: Delete redundant resources

After you close all persistent connections on the NGINX Ingress and no traffic is forwarded to the NGINX Ingress, you can release redundant resources after a period of observation.

1. Delete the NGINX Ingress.

   1. Log on to the ACK console. On the Clusters page, find and click the ACK cluster or ACK Serverless Cluster that you want to manage.

   2. In the left-side navigation pane, choose Network > Ingresses.

   3. In the upper part of the Ingresses page, select a namespace. Find the NGINX Ingress that you want to delete and choose > Delete in the Actions column.

   4. In the message that appears, click OK.

2. Uninstall the Nginx Ingress controller.

   1. Log on to the ACK console. In the left-side navigation pane, click Clusters.

   2. On the Clusters page, click the name of the cluster that you want to manage and choose Operations > Add-ons in the left-side navigation pane.

   3. On the Add-ons page, click the Networking tab, find the Nginx Ingress Controller card, and then click Uninstall.

   4. In the message that appears, click OK.

References

• ALB Ingress overview

• ALB Ingress features

• Use an ALB Ingress to expose Services in an ACK cluster

• Use ALB Ingresses in self-managed Kubernetes clusters