All Products
Search

This Product

    Dataphin:Configure custom task parameters

    Document Center

    Dataphin:Configure custom task parameters

    Last Updated:Jan 21, 2025

    This topic explains how to set custom task parameters to optimize resource allocation and prevent system inefficiencies.

    Background information

    Custom task parameters allow for the specification of compute engine settings, ensuring compatibility with the enterprise's unique requirements and enhancing the performance of logical table tasks.

    Procedure

    1. Navigate to the Management Center from the Dataphin home page by single clicking it in the top menu bar.

    2. Use the operation guide depicted below to access the Custom Task Parameters tab and set the parameters accordingly.

      image..png

      Parameter

      Description

      Custom Parameter Activation

      Choose to Enable or Disable the Custom Task Parameters.

      Custom Parameter Configuration

      Input the custom task parameters, ensuring they align with the compute engine's attributes linked to the Dataphin system. An example configuration is provided below.

      set odps.sql.mapper.cpu=100
set odps.sql.mapper.split.size=256
set odps.sql.reducer.cpu=100
set odps.sql.joiner.cpu=100
      Note

      Custom parameter settings take precedence. The task node's physical configuration supersedes the intelligent engine's custom task parameters.

    3. Once the parameters are set, single click Confirm.

    4. In the confirmation dialog box, single click Confirm to finalize the custom task parameter settings.

      To revert to the compute engine's default settings, go to the Custom Task Parameters page and single click Restore Default Values. Confirm the action in the subsequent dialog box by single clicking Confirm.