This article describes how to deploy the Data Transport software and the basic operations of this software.
Unzip the installation package.
Once you have received the installation package InstallPackage.tar, upload it to a location in the Linux system (such as /opt/Cube). Switch to the directory where the InstallPackage.tar file is located. Enter command
unzip InstallPackage.tarto unzip the installation package. After unzipping, the directory looks like the following:
Configure the JDK 1.8 environment variables.
Data Transport runs in an environment of JDK 1.8 or later. In the installation package, the InstallPackage directory contains “jdk1.8.0_131.” Go to the following directory and create soft links of Linux environment variables for the Java executable files under this directory.
ln -s /opt/Cube/InstallPackage/jdk1.8.0_131/bin/java /usr/bin/java
Enter command “java -version” to view the Java version information. Make sure the version information displayed is the same as the version installed: 1.8.0_131.
Start the service
Unzip the installation package under the directory
/InstallPackage/cube. Enter the directory and you can find the
cube.shscript. Enter command ./cube.sh” to start the Data Transport service.
Go to the user interface of Data Transport.
In the Data Transport user interface, you can see nine options numbered from 1 through 7, 9, and 0. The details of these operations are as follows:
- start service: Start the Data Transport service process
- stop service: End the Data Transport service process
- submit job: Create and submit jobs
- delete job: Delete jobs
- re-try job: Retry failed jobs
- re-run local tasks in job: Rerun previously submitted local tasks in a job
- get job status: Obtain the job status
- Reset password: Reset the password
- exit menu: Exit the user interface
After logging in for the first time, enter 9 to reset the password. The new password must contain at least 10 characters, with a combination of uppercase letters, lowercase letters, numbers, and special characters.
Once the new password is set, enter 1 and use the new password to start the service process of Data Transport.
Once the service process starts, enter 3 to create and submit jobs. When creating the job, select the job type (1 for download, 2 for upload), and follow the prompt to enter required information, such as the job name.
Select 1 to download, enter the source path and the target path, and then confirm the download job.
After submitting the job, enter 7 to view the job status.
The parameters include:
- JobName: The name of the job
- JobState: The status of the job
- PendingTasks: The number of tasks to be executed
- DispatchedTasks: The number of tasks sent
- RunningTasks: The number of tasks being executed
- SucceedTasks: The number of tasks that have completed execution
- FailedTasks: The number of failed tasks
- ScanFinished: Whether the scan is complete
A job status of Running indicates that the job is being executed. A job status of Succeed indicates that the job has completed data transmission. If the job fails, enter 5 to run the failed job again.
Once the data transmission is complete, enter 2 to end the service process of Data Transport.
Before the service process of Data Transport starts, or after it ends, enter 4 to specify the job name and delete the previously created job.
Enter 0 to exit the user interface of Data Transport and return to the system interface.
View the logs
While the jobs are running, log information such as the status is saved under /opt/Cube/InstallPackage/cube/logs (example path). The main logs are master.log and worker.log.
This log provides an overview of the jobs, including job name, status, total number of jobs, number of jobs already executed, number of failed jobs, and whether all the files have been scanned.
You can view information, such as the status, ID, and size of a specific job. You can also view the specific job files.