All Products
Search

This Product

    Data Lake Formation:Access DLF from DataWorks

    Document Center

    Data Lake Formation:Access DLF from DataWorks

    Last Updated:Mar 26, 2026

    When you need to load external data into a Data Lake Formation (DLF) catalog, setting up a DLF 2.0 data source in DataWorks Data Integration gives you a managed, serverless path to move data without writing custom ingestion code. This topic walks you through adding a DLF 2.0 data source and creating a synchronization task.

    How it works

    DataWorks Data Integration connects to DLF through three components:

    Component Role
    DLF 2.0 data source Stores the authentication credentials and catalog metadata that DataWorks uses to reach DLF.
    Serverless resource group Executes the data movement. Network connectivity between this resource group and DLF must pass a connectivity test before the data source can be saved.
    Synchronization task Defines the data flow from your source into the target DLF catalog tables.

    Prerequisites

    Before you begin, make sure you have:

    • A DataWorks workspace. To create one, see Create a workspace.

    • A DLF Paimon catalog. To create one, see Get started with DLF.

    • Network connectivity between a serverless resource group and DLF. If connectivity is not configured, see the Network connectivity topics before proceeding.

    • If you plan to use a Resource Access Management (RAM) user or RAM role as the access identity:

      • Grant the RAM user or RAM role the permissions to call the required REST APIs.

      • In the Data Lake Formation console, grant the Data Editor permission on the tables to be synchronized.

    Step 1: Add a DLF 2.0 data source

    1. Go to the Data Sources page in DataWorks.

      1. Log on to the DataWorks console. In the top navigation bar, select the target region.

      2. In the left-side navigation pane, choose More > Management Center. Select the target workspace from the drop-down list, then click Go to Management Center.

      3. In the left-side navigation pane of the SettingCenter page, click Data Sources.

    2. On the Data Sources page, click Add Data Source. In the dialog box, search for Data Lake Formation and click Data Lake Formation 2.0 (DLF 2.0).

    3. On the Add Data Lake Formation 2.0 (DLF 2.0) Data Source page, configure the following parameters.

      Parameter Description
      Data Source Name A name for the data source. Must be unique within the workspace, contain only letters, digits, and underscores (_), and start with a letter.
      Configuration Mode The only valid value is Alibaba Cloud Instance Mode.
      Access Identity The identity DataWorks uses to access DLF. Options: Alibaba Cloud Account, Alibaba Cloud RAM User, or Alibaba Cloud RAM Role.
      DLF Catalog The DLF catalog to connect to. Select a catalog in the same region as the DataWorks workspace.
      Database Name The database within the selected DLF catalog.

    4. In the Connection Configuration section, test network connectivity between the data source and a serverless resource group.

      • If the test succeeds, click Complete Creation.

      • If the test fails, see the Network connectivity topics to resolve the issue before saving.

    Step 2: Create a synchronization task

    After the DLF 2.0 data source is added, configure a synchronization task to move data into the catalog. For setup instructions, see the Synchronize data to DLF 2.0 topics.

    Verify and next steps

    After the synchronization task runs, verify the result in the DLF console: navigate to your catalog and confirm that the target tables contain the expected data.

    To learn more about managing data in DLF, see Get started with DLF.