edit-icon download-icon

How to synchronize data to OSS

Last Updated: Feb 12, 2018

If you want the incremental data to be automatically synchronized to OSS buckets, you can use the following methods.

Methods

  • OSS cross-region replication: Synchronize the data in bucket A to bucket B in another region. You can set up cross-region replication for the source bucket in the console.
  • Image original retrieval: Seamlessly migrate data from the source site to OSS, that is, migrate a service that is already running on the source site or other cloud products to OSS without stopping it. If the data to be accessed cannot be found in OSS after historical data of the service has been migrated to OSS by OSSimport, image original retrieval is triggered to capture the data from the source site to OSS.
    Image original retrieval
  • OSS APIs or SDKs: Migrate data by coding using OSS APIs or SDKs. See Copy Object and Upload Part Copy for more information.

Scenario 1: Data synchronization between different OSS buckets

To synchronize the data in bucket A to bucket B, use the following methods:

  • Set up cross-region replication
    • Apply to the scenario where the source bucket A and the target bucket B are in different regions and neither of them is of the Archive storage type.
  • Image original retrieval
    • Apply to the scenario where the required data cannot be found in bucket B by the client. In this case, image original retrieval is triggered to capture and download the data from bucket A to bucket B.
  • OSS APIs/SDKs Copy Object and Upload Part Copy
    • Apply to users who have special requirements and strong development capabilities.

FAQ

  • Can I configure to synchronize a subset of directories of a bucket rather than the entire bucket?
    Yes. You can specify a file name prefix in the configuration by setting up the cross-region replication feature to synchronize only directories with that prefix.

  • Can I use cross-region replication for archive storage?
    Cross-region replication is not supported if the source or target bucket is of the Archive storage type. You can synchronize the data by coding using OSS APIs/SDKs.

    It takes time to restore data from an archive storage. If you have to synchronize data from an archive storage to a standard or infrequent access storage, we recommend that you use a more reasonable architecture by changing the storage type of the source bucket to standard or infrequent access and that of the target bucket to archive, reducing costs and improving business experience.

Scenario 2: Data synchronization from a third-party data source to OSS

To automatically synchronize data from a third-party data source to OSS, use the following methods:

  • Image original retrieval
    • If the client cannot find the required data in OSS, image original retrieval is triggered to capture and download the data from the third-party source site to OSS.Image original retrieval
  • OSS APIs/SDKs Copy Object and Upload Part Copy
    Apply to users who have special requirements and strong development capabilities.
  • OSSimport incremental migration
    Use the OSSIMPORT incremental data migration mode to query data in the source site at a fixed interval and synchronize the data to OSS.

FAQ

Others

If the problem persists, contact Alibaba Cloud After-Sales Technical Support.

Thank you! We've received your feedback.