When FPGAs are used for computing in a Container Service for Kubernetes (ACK) cluster, you can schedule pods to FPGA-accelerated nodes. This allows you to make full use of FPGA resources. This topic describes how to schedule pods to FPGA-accelerated nodes by using labels.

Prerequisites

Background information

When you deploy FPGA-accelerated nodes in an ACK cluster, FPGA-related attributes are exposed by node labels. This offers the following benefits:

  • You can use the labels to filter FPGA-accelerated nodes.
  • The labels can be used as conditions to schedule pods.

Step 1: View the labels of the FPGA-accelerated nodes

Method 1: View the labels of the FPGA-accelerated nodes in the console

  1. Log on to the ACK console.
  2. In the left-side navigation pane, click Clusters.
  3. On the Clusters page, find the cluster that you want to manage and click the name of the cluster or click Details in the Actions column. The details page of the cluster appears.
  4. In the left-side navigation pane of the details page, choose Nodes > Node.
  5. On the Nodes page, find the FPGA-accelerated node that you want to manage, and choose More > Details in the Actions column.
    View the labels of the FPGA-accelerated node.
    Node details

Method 2: Run the kubectl command to view the labels of the FPGA-accelerated nodes

  1. Run the following command to view the details of the FPGA-accelerated nodes: 
    kubectl get nodes
    Expected output:
    NAME                       STATUS   ROLES    AGE     VERSION
cn-beijing.192.168.XX.X1   Ready    <none>   3h51m   v1.18.8-aliyun.1
cn-beijing.192.168.XX.X2   Ready    <none>   3h41m   v1.18.8-aliyun.1
  2. Select an FPGA-accelerated node and run the following command to view the labels of the FPGA-accelerated node: 
    kubectl describe node cn-beijing.192.168.XX.X2

    Expected output:

    Name:               cn-beijing.192.168.XX.X2
Roles:              <none>
Labels:             ack.aliyun.com=c05888610e***
                    alibabacloud.com/nodepool-id=npfda879b6***
                    beta.kubernetes.io/arch=amd64
                    beta.kubernetes.io/instance-type=ecs.f3-c4f1.xlarge
                    beta.kubernetes.io/os=linux
                    failure-domain.beta.kubernetes.io/region=cn-beijing
                    failure-domain.beta.kubernetes.io/zone=cn-beijing-h
                    fpga.k8s.aliyun.com=f3
                    kubernetes.io/arch=amd64
                    kubernetes.io/hostname=cn-beijing.192.168.XX.X2
                    kubernetes.io/os=linux
                    node.kubernetes.io/instance-type=ecs.f3-c4f1.xlarge
                    topology.diskplugin.csi.alibabacloud.com/zone=cn-beijing-h
                    topology.kubernetes.io/region=cn-beijing
                    topology.kubernetes.io/zone=cn-beijing-h

    The output shows that the fpga.k8s.aliyun.com=f3 label is added to the FPGA-accelerated node. The label is used to schedule pods in the following example.

Step 2: Schedule pods to the FPGA-accelerated nodes

  1. Log on to the ACK console.
  2. In the left-side navigation pane, click Clusters.
  3. On the Clusters page, find the cluster that you want to manage and click the name of the cluster or click Details in the Actions column. The details page of the cluster appears.
  4. In the left-side navigation pane of the details page, choose Workloads > Deployments.
  5. On the Deployments page, click Create from YAML in the upper-right corner.
  6. Select a custom template from the drop-down list of sample templates, and copy the following content to the Template field. 
    apiVersion: batch/v1
kind: Job
metadata:
  name: fpga-run-task1
spec:
  backoffLimit: 0
  completions: 1
  parallelism: 1
  template:
    spec:
      nodeSelector:
        fpga.k8s.aliyun.com: f3
      containers:
      - image: <your image>
        imagePullPolicy: Always
        name: fpga-run-task1
        resources:
          limits:
            xilinx.com/fpga-aliyun-f3: 1
        securityContext:
          privileged: true
    Note Replace the value of <your image> with the address of your custom image.
  7. Click Create.
    In the left-side navigation pane of the details page, choose Workloads > Pods.

    In the list of pods, you can view that the specified pod is scheduled to the required FPGA-accelerated node. You can use labels to schedule pods to specific FPGA-accelerated nodes with ease.