If you need to back up a large amount of data from an Object Storage Service (OSS) bucket, you can use the OSS inventory feature of Hybrid Backup Recovery (HBR) to accelerate incremental backup. This topic describes how to create and run OSS backup plans by using the OSS inventory feature.

Prerequisites

  • An OSS bucket whose storage class is Standard or Infrequent Access (IA) is created. For more information, see Create buckets.
  • If you want to use an existing OSS inventory list to create an OSS backup plan, the OSS inventory list must meet the following requirements:
    • The inventory list of the latest version is enabled. The bucket prefix that is used in the inventory list is the same as the value of the Source Path parameter that is specified in the Create Backup Plan panel.
    • The inventory list must include the Object Size, Storage Class, Last Modified Date, and ETag fields.
    use inventory list

    For more information, see Configure bucket inventory.

Background information

You can use the inventory feature to export the information about specific objects in a bucket, such as the number, sizes, storage classes, and encryption status of objects. If you need to back up a large amount of data from an OSS bucket, you can use the OSS inventory feature of HBR to accelerate incremental backup. If you want to back up more than 100 million objects, we recommend that you use the OSS inventory feature. OSS determines the time at which OSS inventory lists are generated. If you perform a backup before an inventory list is generated, the backup fails.

Usage notes

When you use the OSS inventory feature of HBR to back up OSS data, take note of the following items:
  • HBR cannot back up or restore symbolic links, object access control lists (ACLs), or objects in Archive buckets.
  • You are charged higher fees for access to the objects in IA buckets than for access to the objects in Standard buckets.
  • You are charged for OSS API operations that are called by HBR during the backup of OSS objects. For more information, see Overview.
  • If you delete an existing backup, the data integrity of subsequent backups is not affected.
  • The OSS inventory list is managed in the OSS console. For more information about how to create an OSS inventory list, see Configure bucket inventory.
  • To accelerate incremental backup, HBR uses the latest inventory list in the last seven days.
    It may take some time to generate an OSS inventory list. When you use the OSS inventory list, take note of the following limits:
    • If no inventory list exists when a backup task is performed, the backup task fails.
    • When a backup job is triggered, the backup job fails if the inventory list remains the same as the inventory list of the previous backup.
    • When a backup job is triggered, HBR uses only the previous inventory list. When the backup is completed, the objects that you add to the OSS inventory list are backed up in the next backup cycle.
    • The interval at which backups are performed must be greater than or equal to the interval at which OSS inventory lists are generated. This way, you can use an OSS inventory list each time you perform a backup.
    Therefore, we recommend that you set the time to start the first backup to a point after an OSS inventory list is generated and then click Run Now to manually perform a backup after an OSS inventory list is generated. This way, you can enable the inventory list feature in time to accelerate your backup jobs.

Procedure

To create a backup plan for an OSS bucket, perform the following steps:

  1. Log on to the HBR console.
  2. In the left-side navigation pane, choose Backup > OSS Backup.
  3. In the top navigation bar, select the region where the OSS bucket resides.
  4. On the Backup Plans tab, click Source Bucket.
  5. In the Create Backup Plan panel, set the parameters and click OK.
    Note You can use each backup plan free of charge for one month, which starts from the day when the backup plan is created. For example, if you create a backup plan on February 14, 2020, you can use the backup plan free of charge until March 14, 2020. You are charged for OSS API operations that are called by HBR during the backup of OSS objects. For more information, see OSS billable items and billing methods.
    OSS inventory
    1. The following table describes the parameters in the basic settings of the backup plan.
      Parameter Description
      Source OSS Bucket The name of the OSS bucket that you want to back up. Select an OSS bucket from the drop-down list.
      Plan Name The name of the backup plan. If you do not specify this parameter, a random name is specified by default.
      Start Time The time at which the backup plan starts. The time is accurate to seconds.
      Pay After Trial Ends Specifies whether to pay for the backup plan after the free trial ends. Valid values:
      • No (default value): The backup plan is not renewed after the free trial for the backup plan ends. Then, the backup plan is deleted.
      • Yes: Your backup plan is automatically renewed after the free trial ends.
    2. To specify the advanced settings, click Show Advanced Settings, click Switch to Paid Plan to enable the advanced settings, and then set the parameters. The following table describes the parameters.
      Parameter Description
      Source Path The prefix in the names of the objects that you want to back up from the OSS bucket. By default, no prefix is specified and all objects in the root directory of the OSS bucket are backed up.
      Backup Interval The interval at which incremental backup is performed. By default, the backup interval is one day. Unit: minutes, hours, days, and weeks.
      Retention Policy The retention policy of the backup. Valid values:
      • Limited (default value): The backups are retained for a specified period of time. If you select Limited, you must set the Retention Period parameter.
      • Permanent: The backups are permanently retained.
      Retention Period The retention period of backup files. By default, the backup is retained for 1 week. Units: days, weeks, months, and years.
      Backup Vault The backup vault where you want to store the backup files. Valid values:
      • Create Vault (default value): If you select this value, specify the Vault Name field. By default, a random name is used.
      • Select Vault: If you select this value, select a backup vault from the Vault Name drop-down list.
      Vault Name The name of the backup vault.
      Use OSS Inventory Specifies whether to enable the OSS inventory feature to back up OSS buckets. In this example, the parameter is set to Select Inventory.
      • No: disables the OSS inventory feature. You must back up objects in traversal mode.
      • Select Inventory: You can use an existing OSS inventory list to accelerate incremental backup of OSS objects.
      OSS Inventory Name This parameter is required only if the Use OSS Inventory parameter is set to Select Inventory. You can select a created OSS inventory list from the OSS Inventory Name drop-down list. For more information about how to create an OSS inventory list, see Configure bucket inventory.
      The OSS inventory list that you create must meet the following requirements:
      • The inventory list of the latest version is enabled. The bucket prefix that is used in the inventory list is the same as the value of the Source Path parameter that is specified in the Create Backup Plan panel.
      • The inventory list must include the Object Size, Storage Class, Last Modified Date, and ETag fields.
      Delete inventory file after backup Specifies whether to delete the inventory list when a backup plan is completed. If you set this parameter, you may delete the inventory lists of the bucket. We recommend that you store the inventory lists in a dedicated bucket or set the parameter to Do Not Delete to manually manage the lists.
      • Do Not Delete: retains the inventory lists. If other applications access the OSS inventory lists, we recommend that you set the parameter to this value.
      • Delete Current: deletes the inventory list that is used in the backup job.
      • Delete All: deletes all the inventory lists that are generated before the backup after the backup is completed. If no other applications access the OSS inventory lists, we recommend that you set the parameter to this value.
    3. Configure the OSS inventory feature.
      Parameter Description
      Use OSS Inventory Specifies whether to enable the OSS inventory feature to back up OSS buckets. In this example, the parameter is set to Select Inventory.
      • No: disables the OSS inventory feature. You must back up objects in traversal mode.
      • Select Inventory: You can use an existing OSS inventory list to accelerate incremental backup of OSS objects.
      OSS Inventory Name This parameter is required only if the Use OSS Inventory parameter is set to Select Inventory. You can select a created OSS inventory list from the OSS Inventory Name drop-down list. For more information about how to create an OSS inventory list, see Configure bucket inventory.
      The OSS inventory list that you create must meet the following requirements:
      • The inventory list of the latest version is enabled. The bucket prefix that is used in the inventory list is the same as the value of the Source Path parameter that is specified in the Create Backup Plan panel.
      • The inventory list must include the Object Size, Storage Class, Last Modified Date, and ETag fields.
      Delete inventory file after backup Specifies whether to delete the inventory list when a backup plan is completed. If you set this parameter, you may delete the inventory lists of the bucket. We recommend that you store the inventory lists in a dedicated bucket or set the parameter to Do Not Delete to manually manage the lists.
      • Do Not Delete: retains the inventory lists. If other applications access the OSS inventory list, we recommend that you set the parameter to this value.
      • Delete Current: deletes the inventory list that is used in the backup job.
      • Delete All: deletes all the inventory lists that are generated before the backup after the backup is completed. If no other applications access the OSS inventory lists, we recommend that you set the parameter to this value.
    After the backup plan is created, HBR runs backup jobs based on the backup plan.

What to do next

After the backup plan is created, HBR runs backup jobs based on the backup plan. On the Backup Plans tab, you can perform the following operations in the Actions column:
Operation Description
Run Now Immediately runs a backup job.
Modify Modifies the parameters for a created OSS backup job if the backup job does not meet your requirements.
Backups You can view all the backup history of the file system or its backup history in the recent three months.
Suspend Plan Suspends a running backup job.
Resume Plan Resumes a suspended backup job.
Delete Plan Deletes a running backup job. After you delete a backup plan, HBR no longer runs the plan. However, the data that is backed up is retained.
Alert Settings If the backup job fails or the client is disconnected from the server, HBR sends an alert notification by default. For more information, see Configure alert notifications.

What to do next

Create an OSS restore job