All Products
Search

This Product

    Data Management:Prepare resources for Airflow

    Document Center

    Data Management:Prepare resources for Airflow

    Last Updated:Dec 05, 2025

    This topic describes the resources that you need to purchase to configure an Airflow instance and explains how to enable Internet access for Airflow.

    Required resources and their functions

    Object Storage Service (OSS): Stores Airflow logs, dependent Python libraries, and data output by tasks.

    Note

    • All resources must be in the same region as the Airflow instance.

    • For information about the regions that Airflow supports, see Supported regions and zones.

    Create an OSS bucket

    1. Go to the Buckets page and click Create Bucket.

    2. Enter a bucket name and select the same region as your other instances.

    3. Scroll to the bottom and click Create. Follow the on-screen instructions to complete the process. For more information, see Quick Start.

    4. In the bucket, create a folder to store Airflow data.

    Note

    You do not need to manually register the OSS bucket with DMS. DMS automatically retrieves instance information from the OSS console.

    Enable Internet access for Airflow on DMS

    If your Airflow instance needs to access the Internet, you must configure public network access for its VPC.

    Obtain the VPC ID of the workspace

    1. Log on to the DMS console V5.0.

    2. Go to the Workspace page.

      In the upper-left corner of the console, click the 2023-01-28_15-57-17.png icon and choose All Features > Data+AI > Workspace.

      Note

      If you are not using the simplified console, choose Data+AI > Workspace from the top menu bar.

      screenshot_2025-08-28_10-26-34

    3. Click the name of the target workspace.

    4. In the lower-left corner, click the Settings image icon, select Workspace Management, and find the VPC ID.

      image

    Create an Internet NAT gateway for the Airflow VPC

    1. Log on to the VPC console.

    2. In the navigation pane on the left, click NAT Gateway > Internet NAT Gateway.

    3. On the Internet NAT Gateway page, click Create Internet NAT Gateway.

    4. On the purchase page, set the configuration parameters and click Buy Now in the lower-right corner.

      The following table describes some of the parameters on the purchase page.

      Parameter

      Description

      Instance Name

      Set the name of the Internet NAT gateway instance.

      Region

      The region of the Internet NAT gateway must be the same as the region of the workspace.

      Network and Zone

      Must be the same as the VPC of the workspace.

      Network Type

      Select Internet NAT Gateway.

      EIP

      If you have an Elastic IP Address (EIP) in the same region as the workspace, select Select EIP. If not, click Purchase EIP.

    5. On the Parameters page, verify the parameters and then click Activate Now.

    6. Wait for the purchase to complete.

      The Purchase succeeded! message indicates that the gateway is created.