Fine-grained resource configuration (expert mode, BETA) lets you control CPU, memory, and concurrency per operator in Ververica Flink real-time tasks. The system runs jobs in Native K8s mode and determines TM specifications and count based on Slot specs and job concurrency.
Access the resource configuration page
-
In the top menu bar, choose Development > Data Development.
-
In the top menu bar of the Development page, select a project.
-
In the left navigation pane, choose Data Processing > Script Task, then click the target task in the task list.
-
Click Configuration in the right sidebar.
-
Select the Real-time Mode tab. In the Real-time Mode > Resource Configuration section, set Resource Configuration Type to Custom Configuration.
-
Click Go To Configure.
Procedure
The resource configuration page displays a topology diagram. Each box represents a configurable computing task. A Group contains nodes that can run on a single machine to reduce network overhead. The default configuration shown is the system recommendation.
-
Click the
icon in the upper-right corner of a Group to configure its resources. Set parameters in the Custom Configuration Group Runtime Parameters and Custom Configuration StreamExecCalc Runtime Parameters dialog boxes.-
Custom Configuration Group Runtime Parameters
Parameter
Description
CPU
CPU resources allocated to this node.
Heap Memory
Memory used by Java applications, measured in MB or GB. Controllable through JVM command line parameters. Blink programs typically require Heap Memory for overhead such as caching — size it based on program scale.
Heap Memory size and its components are adjustable via JVM command line parameters. Configure based on the program's scale and caching requirements.
Off-heap Memory
Off-heap memory size, measured in MB or GB.
Concurrency
Batch-updates the concurrency for all OPERATOR nodes under the current SLOT node. Click the SLOT node (outermost layer) Edit icon to configure. Valid values: positive integers from 1 to 32768. If left empty, no update is performed.
Accepts integers from 1 to 32768. Leave empty to skip.
NoteOnly SLOT nodes support batch modification of concurrency.
-
Custom Configuration StreamExecCalc Runtime Parameters
Parameter
Description
Concurrency
Default: 1. Enter any integer greater than 0, or -1 for automatic inference.
Chaining Policy
-
ALWAYS: Chains with both upstream and downstream operators.
-
HEAD: Starts a new chain. Breaks the link with upstream operators but chains with downstream nodes.
-
NEVER: Does not chain with upstream or downstream operators.
Operator State Expiration Time Setting
If the current OPERATOR node is stateful, you can set individual expiration times for each state.
Supported units: days, hours, minutes, or seconds.
-
-
-
Click OK.
-
Click Save in the upper-right corner.
ImportantTo revert to the system-recommended configuration, click Reset To System Initial in the upper-right corner.
To save the current configuration as a record, click Save Current Configuration As New Record next to Resource Information Record. In the Save Resource Record dialog box, enter a Resource Record Name and click OK.
Operations available for existing resource records:
Operation
Description
View Version Information
Click the Actions
icon in the record row.Enable Record
-
Click the Actions
icon in the record row. -
In the Prompt dialog box, click OK to confirm.
Delete Record
-
Click the Actions
icon in the record row. -
In the Prompt dialog box, click OK to confirm.
-