All Products
Search

This Product

    Data Management:Prepare resources for Airflow

    Document Center

    Data Management:Prepare resources for Airflow

    Last Updated:Jun 21, 2026

    This topic describes the resources required to configure an Airflow instance and how to enable Internet access for it.

    Required resources and their purposes

    Object Storage Service (OSS): Stores Airflow logs, dependent Python libraries, and data output from tasks.

    Note

    Create an OSS bucket

    1. Go to the Buckets page and click Create Bucket.

    2. When you configure the bucket, enter a bucket name and select the same region as your other instances.

    3. Scroll to the bottom of the page and click Create. Follow the on-screen instructions to complete the creation process. For more information, see Console Quick Start.

    4. In the bucket, create files to store Airflow data.

    Note

    You do not need to manually add the OSS instance to Data Management Service (DMS). DMS can automatically retrieve instance information from the OSS console.

    Enable Internet access for Airflow on DMS

    If your Airflow instance requires Internet access, you must configure Internet access for its VPC.

    Obtain the VPC ID of your workspace

    1. Log in to DMS 5.0.

    2. Go to the workspace page.

      DMS provides two methods to access the workspace page. You can choose either method.

      Method 1

      In the upper-left corner of the console, click the 2023-01-28_15-57-17.png icon and choose All Features > Data+AI > workspace.

      Note

      If you are not using the simplified console, choose Data+AI > workspace from the top menu bar.

      Method 2

      Important

      This method is in beta testing and is available only to some users.

      In the navigation pane on the left, click the Data Factory image icon, and then click workspace.

      Note

      If you are not using the simplified console, choose Data Factory > workspace from the top menu bar.

    3. Click the name of the target workspace.

    4. In the lower-left corner, click the Settings image icon, select workspace management, and find the VPC ID.

    Create an internet NAT gateway

    1. Log on to the VPC console.

    2. In the navigation pane on the left, choose NAT Gateway > Internet NAT Gateway.

    3. On the Internet NAT Gateway page, click Create Internet NAT Gateway.

    4. On the purchase page, set the parameters and click Buy Now in the lower-right corner.

      The following table describes some of the parameters.

      Parameter

      Description

      Instance Name

      Enter a name for the internet NAT gateway instance.

      Region

      The internet NAT gateway and the workspace must be in the same region.

      Network and zone

      The selected network must be the VPC associated with your workspace.

      Network Type

      Select Internet NAT Gateway.

      EIP

      If you have an existing Elastic IP Address (EIP) in the same region as the workspace, select Select EIP. Otherwise, click Purchase EIP.

    5. On the Parameters page, verify the parameters and click Activate Now.

    6. Wait for the purchase to complete.

      The Congratulations, the purchase is successful! message confirms that the internet NAT gateway has been created.