To efficiently and flexibly manage Paimon tables in the Development Console, configure the required toolkits for tasks such as merging small files and sorting data. This topic describes this configuration process to help you manage Paimon table data more easily.
Limitations
Paimon tables are supported by Ververica Runtime (VVR) 8.0.5 or later.
Procedure
Download the JAR packages required for the Paimon data management environment.
paimon-flink-action:
paimon-ali-vvr: Download the package that corresponds to your VVR version:
For VVR 11.2 and later (JDK 11): paimon-ali-vvr-11-vvp-1-ali-16.0-1.jar
For VVR 11.2 and later (JDK 8): paimon-ali-vvr-11-vvp-jdk8-1-ali-16.0-1.jar
For VVR 11.1: paimon-ali-vvr-11.1-1-ali-16.0-1.jar
For VVR 8.0.11: paimon-ali-vvr-8.0-vvp-1-ali-16.0-1.jar
In the Development Console, go to Artifacts and click Upload Artifact to upload the two JAR packages you downloaded in the previous step.
Navigate to , click .
In the Create JAR Deployment dialog, fill in the configuration items as follows:
Configuration Item
Description
Example
Deployment Mode
Select Stream Mode or Batch Mode as needed.
Batch Mode
Deployment Name
Enter the name for job deployment.
test
Engine Version
Select VVR 8.0.5 or a later.
vvr-8.0.5-flink-1.17
JAR URI
Select the
paimon-flink-actionJAR package uploaded in Step 2.Entry Point Class
The entry point class of the program. Leave this blank.
Entry Point Main Arguments
The input parameters to be called in the main method. Fill in this field as needed. For details, see the related feature document. For example, to implement data sorting, see Data consumption.
Additional Dependencies
The path or filename of the dependency file to attach. Select the
paimon-ali-vvrpackage you uploaded in Step 2.Click Deploy.
Find the target deployment and click Start. For more information, see Start a job.
References
To configure job parameters after the job starts, see Configure a deployment.
Some parameters support dynamic updates to reduce business downtime caused by restarts. For more information, see Dynamically update the parameter configuration for dynamic scaling.
For common optimizations for Paimon primary-key and append scalable tables in different use cases, see Performance optimization.