A Lingjun cluster is a collection of high-performance Lingjun compute nodes equipped with Lingjun optimization components. Each Lingjun node corresponds to a GPU server and can be used to deploy heterogeneous computing services. This topic describes how to manage Lingjun clusters and Lingjun nodes, for example, view cluster information, view node details, and scale out a Lingjun cluster.
Manage Lingjun clusters
The status of a Lingjun cluster can be one of the following:
Initialization failed.: View the details of the failed task in the O&M Task Center.
Initializing: Configuring the Lingjun network and initializing Lingjun compute nodes.
Running: You can scale out or scale in a cluster, or reinstall or restart a node only when the cluster is in the Running state.
ImportantIf the cluster scale-out, cluster scale-in, node reinstall, and node restart tasks involve different Lingjun compute nodes, you can submit them in parallel.
View cluster information
Log on to the Lingjun console.
In the left-side navigation bar, choose Resources and Nodes > Cluster Management.
Click Details next to the cluster ID to go to the Cluster Details page.
View basic cluster information, such as the cluster name, number of groups, and creation information.
View cluster information across five tabs: Node Group, Monitoring overview, Basic Metrics, RDMA, and GPU.
Scale out the cluster
When you scale out a cluster, deploy the CPFS client on each new GPU node and add the node to the CPFS cluster.
You must tag the newly added nodes.
Log on to the Intelligent Computing Lingjun console.
In the left-side navigation bar, choose Resources and Nodes > Cluster Management.
Find the target cluster and click Scale out in the Actions column.
In the Original Group Details: section, click Join Existing Node next to the corresponding node group name.
In the dialog box that appears, enter the node name prefix, logon password, and confirm password.
Select the check box next to one or more unused node instances or purchase new nodes, then click Yes.
In the Scale-out configuration, click Confirm Submission.
Return to the Cluster Management page. The cluster status shows Scaling out. Wait for the scale-out to complete.
Scale in a cluster
Scaling in a cluster reinstalls the removed nodes and clears all local data on those nodes. Therefore, back up node data before performing a scale-in operation.
During cluster scale-in, the nodes to be scaled in must be removed from the CPFS cluster.
Log on to the Intelligent Computing Lingjun console.
In the left-side navigation bar, choose Resources and Nodes > Cluster Management.
In the Actions column, click scale-in.
In the Original Group Details: section, select the check box next to each node you want to remove, then click Batch Remove from Cluster.
In the The following information displays the detailed configurations for scale-down: section, click Confirm Submission.
On the Confirm scale-in page, enter
DELETEin the text box and click Yes to scale in the cluster.Return to the Cluster Management page. The cluster status shows Scaling in. Wait for the scale-in to complete.
Delete cluster
Before you delete a cluster, you must scale in the cluster to remove all nodes.
The associated CPFS cluster is not deleted when you delete a cluster.
Log on to the Intelligent Computing Lingjun console.
In the left navigation bar, choose Resources and Nodes > Cluster Management.
Click the Cluster ID/Name you want to delete. On the Cluster Details page, click Delete in the upper-right corner.
In the dialog box that appears, click Yes to delete the cluster.
Create a cluster group
You can create a cluster group for a Lingjun cluster in one of the following ways:
Create a cluster group when you create the cluster. For more information, see Cluster and group configuration.
After the cluster is created, create a group for an existing cluster.
Log on to the Intelligent Computing Lingjun console.
In the left-side navigation bar, choose Resources and Nodes > Cluster Management.
Click the corresponding Cluster ID/Name.
Click the Node Group tab.
On the Node group tab, click Create Group. Enter the node group name, default instance type, and other information.
Optional. After you create a node group, you can edit its name or delete it.
Manage Lingjun nodes
A Lingjun compute node can perform only one operation at a time, including cluster scale-out, cluster scale-in, node reinstallation, and node restart.
Purchase a node
Log on to the Lingjun console.
In the left-side navigation bar, choose > Node Management.
On the Node Management page, click Purchase Node to go to the node purchase page.
Follow the on-screen instructions to purchase a node.
View node details
Log on to the Intelligent Computing Lingjun console.
In the left-side navigation bar, choose Resources and Nodes > Node Management to open the Node Management page.
Click the All tab to view all nodes.
You can view the basic information about a node, such as the Node ID / Hostname, Image Name, Zone, etc.
Select conditions such as Image Name, Zone, or IP Address from the drop-down list, then enter search content in the text box to search for nodes.
Click the Unused tab to view unused nodes. You can view the basic information about an unused node, such as Node Model and GPU.
Log on to a node
Log on to the Intelligent Computing Lingjun console.
In the left-side navigation pane, choose Resources and Nodes > Node Management
Find the node that you want to manage, click the More icon in the Actions column, and then select Remote Logon.
The login username is root.
The login password is the cluster's login password.
Reinstall node
Reinstalling a node will delete the node data. Exercise caution when performing this operation.
You can reinstall a node only when the cluster is in the Running state.
When reinstalling a node, you must first remove the old node from the CPFS cluster and then add the new node information to the CPFS cluster.
You need to reinstall a node in the following situations:
Redeploy the business.
Change the operating system version.
Meet O&M requirements.
Procedure:
Log on to the Intelligent Computing Lingjun console.
In the left-side navigation pane, choose Resources and Nodes > Node Management
On the Node Management page, find the node that you want to manage and click Reinstall in the Actions column. In the dialog box that appears, select an image version, modify the node name, enter and confirm the root password of the node, and then click Reinstall.
Restart a node
Restarting a node may affect business continuity.
You can restart a node only when the cluster is in the Running state.
You need to restart a node in the following situations:
Deploy a new application or service.
Modify system configuration.
O&M scenario requirements.
Operation steps:
Log on to the Intelligent Computing Lingjun console.
In the left-side navigation pane, choose Resources and Nodes > Node Management
On the Node Management page, click instance ID and then Restart.