If your data is stored in Hadoop Distributed File System (HDFS), you must provide a compute node that has at least 16 cores and 64 GB memory. Then, you must mount HDFS and a Data Transport Mini device to the compute node to migrate data. This topic describes how to mount HDFS and a Data Transport Mini device to a compute node.

Prerequisites

  • A compute node is created.
  • The shared directory of the Data Transport Mini device is shared. To share a directory, follow these steps:
    1. Log on to the device console. For more information about how to log on to the device console, see Install hardware.

    2. Choose ConsolePanel>Privilege>Shared Folders.

    3. On the Shared Folder tab, check whether the filedata directory exists.

      The filedata directory exists by default. If the shared directory does not exist, create one. For more information, see the following Create a shared directory section.

(Optional) Create a shared directory

Before you create a shared directory, log on to the Data Transport server to check whether the shared directory exists. If the directory exists, use your browser to log on to the device console and add the shared directory.

Log on to the Data Transport server to check whether the share directory exists

  • Log on to the Data Transport server from a Linux or Mac-based host

    1. Open the command line window on your laptop.

    2. Run the ssh username@management IP address command.

      The default management IP address is 192.168.1.1. For more information about how to configure a management IP address, see Install hardware.

    3. Enter a password to log on to the Data Transport server.

    4. Run the cd /share/CACHEDEV1_DATA command to go to the directory. Run the ls command to check whether the filedata directory exists. If the filedata directory exists, skip the following step and use the browser to access the device console.
    5. If the filedata directory does not exist, run the mkdir filedata command to create a shared directory.
  • Log on to the Data Transport server from a Windows-based host

    1. Download a remote connection tool to your laptop.

      For example, if you want to download PuTTY, visit Download PuTTY. Select a version that matches your computer model and install PuTTY.

    2. Open PuTTY, configure the following parameters, and log on to the Data Transport server.

      Specify a management IP address for the Host Name (or IP Address) parameter. The default IP address is 192.168.1.1. For more information about how to configure a management IP address, see Install hardware.

    3. Run the cd /share/CACHEDEV1_DATA command to go to the directory. Run the ls command to check whether the filedata directory exists. If the filedata directory exists, skip the following step and use the browser to access the device console.
    4. If the filedata directory does not exist, run the mkdir filedata command to create a shared directory. Then, use your browser to log on to the device console and add the shared directory.

Add a shared directory in the device console

  1. Log on to the device console. For more information about how to log on to the device console, see Install hardware.

  2. Choose ConsolePanel>Privilege>Shared Folders. Then, choose Create>Shared Folder. Configure the following parameters to add a shared folder.

    Folder name: Enter filedata.

    • Path: Select Enter path manually, and then select filedata.
  3. Click the edit icon next to the filedata directory.

  4. In the Edit Shared Folder Permission dialog box, select NFS host access, and confirm that the access permission for the filedata directory is read/write.

  5. Choose ConsolePanel>Network & File Services>Win/Mac/NFS, and click Linux NFS Service.

  6. Select Enable NFS v4 Service, and click Apply.

Step 1: Configure a service IP address

  1. Log on to the device console. For more information about how to log on to the device console, see Install hardware.

  2. Choose Console Panel>Network & Virtual Switch>Interfaces.

  3. Find the network adapter that is in the Connected state and click the edit icon.

  4. On the IPv4 tab, select Use static IP address. Specify the Fixed IP address, Subnet Mask, and Default Gateway based on your actual network configurations, and then click Apply.

    Note We recommend that you save this IP address because you must specify this IP address when you create a data address in the Data Transport console.

Step 2: Mount HDFS to the compute node

Mount HDFS to a compute node. For more information, see Configuring Mountable HDFS.

Step 3: Mount Data Transport to the compute node

Linux

  1. Log on to the Linux-based compute node.

  2. Run the following command to create a local directory to which Data Transport is mounted:

    mkdir /mnt/cube

  3. Run the following command to view the Data Transport shared directory:

    showmount -e 172.168.1.1

    172.168.1.1 indicates a service IP address. Replace it with the actual IP address.

    If the filedata directory is displayed, the Data Transport shared directory can be mounted.

  4. Run the following command to mount the Data Transport Mini device to the compute node:

    mount 172.168.1.1:/filedata /mnt/cube

  5. Run the following command to view the result:

    df -h

    The command output in the following figure indicates that Data Transport is mounted.

Windows

  1. Log on to the Windows-based compute node.

  2. Open This PC and select Map network drive.

  3. In the Map Network Drive dialog box, set a folder path, for example, \\172.168.1.1\filedata. Note that filedata is the name of the shared directory.

    172.168.1.1 indicates a service IP address. Replace it with the actual IP address.

  4. Click Finish.

    Note Error message: You cannot access this shared folder because your organization's security policies block unauthenticated guest access. These policies help protect your PC from unsafe or malicious devices on the network. This error message is returned because security policies prevent unauthenticated guest access. Check the security policies of your computer.
  5. View the mount result.

    If Data Transport is mounted, the filedata folder appears, as shown in the following figure.

What to do next

After you mount HDFS and the Data Transport Mini device to the compute node, you must use the migration method for Data Transport II or III to complete a migration task. For more information about how to configure a migration task, see Create and run a migration job.