All Products
Search

This Product

    Dataphin:Create an Amazon EMR compute source

    Document Center

    Dataphin:Create an Amazon EMR compute source

    Last Updated:Jun 04, 2026

    Add an Amazon EMR compute source to a Dataphin project to enable compute tasks, ad hoc queries, and general scripts when Amazon EMR is the configured compute engine.

    Prerequisites

    Procedure

    1. In the top navigation bar of the Dataphin homepage, choose Planning > Compute Source.

    2. On the Compute Source page, click New Compute Source and select Amazon EMR Compute Source.

    3. In the Create Amazon EMR Compute Source dialog box, configure the required parameters.

      Parameter

      Description

      Basic Information

      Compute Type

      Select Amazon EMR.

      Compute Source Name

      Supports Chinese characters, letters, digits, underscores (_), and hyphens (-). Maximum length: 64 characters.

      Configuration Method

      Only Reference Specified Cluster is supported. Enter keywords to search for a cluster. After selection, click View to check cluster details on the View Amazon EMR Cluster page.

      Description (optional)

      A brief description of the compute source. Maximum length: 128 characters.

      Compute Configuration

      Primary Node Public DNS

      Auto-populated from the selected Amazon EMR cluster. Not editable.

      Database

      Enter the database name of the Amazon EMR compute engine.

      Spark SQL

      Select Enable or Disable. Default: Enable.

      Note

      This parameter can be configured only when Spark SQL is enabled on the referenced cluster.

      Spark Local Client

      Select Enable or Disable. Default: Enable.

      Note

      This parameter can be configured only when both Spark SQL and Spark Local Client are enabled on the referenced cluster.

      Default Queue For Production Tasks (optional)

      YARN resource queue for manual and scheduled production tasks.

      Queue For Other Tasks (optional)

      YARN resource queue for other tasks, such as ad hoc queries, data previews, and JDBC Driver access.

      Queue For Priority Tasks

      Select Use Default Queue For Production Tasks or Custom.

      If you select Custom, specify a YARN resource queue for each priority level.

      Note

      Dataphin routes Hive SQL tasks to queues based on priority. Configure different priority queues when the Hive execution engine is Tez or Spark for priority settings to take effect.

    4. Click Submit.

      After creation, attach the compute source to a project. Create a general project.