Dataphin:Configure open-source Flink resources in real-time mode

Procedure

1. In the top menu bar of the Dataphin home page, choose Developer > Data Development.

2. In the top menu bar, select a project. If you are in Dev-Prod mode, you must also select an environment.

3. In the left navigation pane, choose Data Processing > Script Task.

4. In the list of computing tasks, select your open-source Flink task and click Configuration in the right sidebar.

5. In the configuration panel, click the Real-time Mode tab and configure the Real-time Mode Resource Configuration section.

   Flink on yarn

   Parameter	Description
   Production Environment Resource Queue	Defaults to the resource queue selected during task creation. You can switch the DPI engine. Important After you switch the engine, the execution of submitted tasks may vary. Proceed with caution.
   Production Environment Engine Version	Defaults to the engine version selected during task creation. Supported versions: 1.13.1, 1.14.2, 1.15.3, and 1.20.1.
   Development Environment Resource Queue And Engine Version	Defaults to the configuration selected during task creation. Select System Default Configuration or Custom Configuration. System Default Configuration: Uses the same cluster and engine version as the production environment. Custom Configuration: Select the Development Environment Resource Queue and Development Environment Engine Version. The available versions are 1.13.1, 1.14.2, 1.15.3, and 1.20.1. Not required for Basic mode projects.
   Parallelism	Default: 1. Enter any integer greater than 0, or -1 for automatic inference.
   Task Manager Slots (Optional)	Empty by default. Enter any integer greater than 0.
   Job Manager Memory	Memory allocated to the JobManager.Default: 2 Gi.Specify in bytes or with a Gi/Mi suffix. Examples: 1024000, 1024Mi, 1.5Gi.
   Task Manager Memory	Default: 2 Gi.Specify in bytes or with a Gi/Mi suffix. Examples: 1024000, 1024Mi, 1.5Gi.
   Job Manager CPUs	CPU resources for the JobManager. Default: 1C. Enter any integer greater than 0.
   Task Manager CPUs	CPU resources for the TaskManager. Default: 1C. Enter any integer greater than 0.

   Flink on K8s

   Parameter	Description
   Production Environment Resource Queue	Defaults to the resource queue selected during task creation. You can switch the DPI engine. Important After you switch the engine, the execution of submitted tasks may vary. Proceed with caution.
   Production Environment Engine Version	Defaults to the engine version selected during task creation. Supported versions: 1.13.1, 1.14.2, 1.15.3, and 1.20.1.
   Development Environment Resource Queue And Engine Version	Defaults to the configuration selected during task creation. Select System Default Configuration or Custom Configuration. System Default Configuration: Uses the same cluster and engine version as the production environment. Custom Configuration: Select the Development Environment Resource Queue and Development Environment Engine Version. The available versions are 1.13.1, 1.14.2, 1.15.3, and 1.20.1. Not required for Basic mode projects.
   Parallelism	Default: 1. Enter any integer greater than 0, or -1 for automatic inference.
   Task Manager Count	Default: 1. Enter any integer greater than 0.
   Job Manager Memory	Memory allocated to the JobManager.Default: 1 Gi.Specify in bytes or with a Gi/Mi suffix. Examples: 1024000, 1024Mi, 1.5Gi.
   Task Manager Memory	Default: 1 Gi.Specify in bytes or with a Gi/Mi suffix. Examples: 1024000, 1024Mi, 1.5Gi.
   JobManager CPU	CPU resources for the JobManager. Default: 1C. Enter any number greater than 0, such as 1 or 10.5.
   TaskManager CPU	CPU resources for the TaskManager. Default: 2C. Enter any number greater than 0, such as 1 or 10.5.

6. Click OK.