All Products
Search

This Product

    Dataphin:Set the compute engine of a Dataphin instance to Hadoop

    Document Center

    Dataphin:Set the compute engine of a Dataphin instance to Hadoop

    Last Updated:Jun 23, 2026

    Before you start data development in a project space, configure the compute engine for your Dataphin instance. After configuration, you can add compute resources to the project space to provide computing and storage capabilities.

    Prerequisites

    The metadata initialization is complete. For more information, see using Hadoop as the metadata warehouse compute engine for metadata warehouse initialization.

    Procedure

    1. Log on to the Dataphin console with a super administrator account.

    2. Navigate to Management Center > System Settings from the top menu bar on the Dataphin home page.

    3. In the Compute Settings section, select a Hadoop type compute engine and configure its parameters.

      Hadoop-based compute engines include Alibaba Cloud E-MapReduce 3.x, Alibaba Cloud E-MapReduce 5.x, and CDH 5.x.

      Hadoop, CDH6.x, Cloudera Data Platform 7.x, and Huawei FusionInsight 8.x

      Hadoop and AsiaInfo DP5.3 Hadoop.

      Note

      If you set the compute engine to Aliyun E-MapReduce 3.x Hadoop, Aliyun E-MapReduce 5.x Hadoop, CDH 5.x Hadoop, CDH 6.x Hadoop, Cloudera Data Platform 7.x, AsiaInfo DP5.3 Hadoop, or Huawei FusionInsight 8.x Hadoop, you only need to select the offline computing engine type. You do not need to configure the other parameters. After you save the compute engine type, click Configure Compute Cluster to add or configure a Hadoop cluster on the Planning > Compute Source > Manage Hadoop Cluster page.

      Parameter

      Description

      NameNode

      You can add multiple HDFS connection URLs for the same cluster. Metadata is retrieved successfully if at least one URL passes verification. For example, host=192.xxx.xx.xxx,webUiPort=500xxx,ipcPort=80xx.

      Execution Engine

      Select a compute execution engine based on your business requirements.

    4. Click Save.

    What to do next

    After the compute engine is configured, you can add compute resources to a project space to provide computing and storage capabilities. For more information about creating a project space and adding compute resources, see creating a general project.