edit-icon download-icon

OSS data source config

Last Updated: May 04, 2018

The Object Storage Service (OSS) is a massive, secure, and highly reliable cloud storage service offered by Alibaba Cloud. For more information on OSS products, see OSS Product overview.

Procedure

  1. Enter the DataWorks console as a developer, and click Enter Project, as shown in the following figure.

    EnterProject

  2. Click Data Integration from the upper menu and navigate to the Data Sources page.

    DataSources

  3. Click New Source.

  4. In dialog box, select OSS as the data source type.

  5. Complete the configuration items of the OSS data source.

    17

    • Name: A combination of letters, numbers, and underscores (). It must begin with a letter or an underscore (), and and the length must not exceed 60 characters.

    • Description: A brief description of the data source, which must not exceed 80 characters.

    • Endpoint: It refers to the OSS Endpoint information in the following format:http://oss.aliyuncs.com. The endpoint of the OSS service associates with a region, and different domains must be entered for accessing different regions.

      Note:

      The format of the Endpoint is http://oss.aliyuncs.com. The connectivity test is passed but an error reports at the same time. If OSS is prefixed with the Bucket value with a dot, such as http://xxx.oss.aliyuncs.com.

    • Bucket: It refers to the corresponding OSS Bucket information. The bucket is a storage space and serves as the container for storing objects. You can create one or more buckets and add one or more files to each bucket. The bucket entered here searches for corresponding files in the data synchronization task, and file searching is unavailable for non-added buckets.

    • AccessID/AceessKey: The AccessID/AccessKey is equivalent to the logon password.

  6. Click Test Connectivity.

  7. When the connectivity test is passed, click Complete.

Connectivity test description

  • In a classic network, the connectivity test is provided to verify whether the Endpoint and AccessKey entered are correct.

  • Currently, test of the connectivity to data sources is unavailable in VPC environments.

What to do next

Now you have learned how to configure the OSS data source. The article explains how to configure the OSS Writer plug‑in later. For more information, see Configure OSS Writer.

Thank you! We've received your feedback.