This topic will guide you through the process of creating and attaching Ververica Flink compute sources, data sources, and real-time projects in this tutorial.
Step 1: Create Ververica Flink compute source
Navigate to the Dataphin home page and click Planning in the top menu bar.
Refer to the image below to access the Ververica Flink New Compute Source page.
On the New Compute Source page, fill in the required parameters.
Parameter
Description
Compute Type
Choose Ververica Flink as the compute type.
Region
Select the region where your compute source will be located, such as China (Hangzhou).
Access Method
Choose the access method for the compute source, with VPC network being the recommended option.
Accesskey ID, AccessKey Secret
Provide the AccessKey ID and AccessKey Secret for an account with access to the fully managed Flink project.
Retrieve the AccessKey ID and AccessKey Secret from the User Information Management page.
Flink Workspace ID
Select the Flink Workspace ID associated with the Ververica Flink compute source, typically flink_dataphin_default.
Flink Project Space
Choose the Project Space for the Ververica Flink compute source.
Compute Source Name
Enter the name flink_dataphin for the compute source.
Description
Provide a concise description of the compute source, such as Real-time R&D demo.
Click Validate And Submit. The system will verify the connectivity of the compute source and proceed to create it.
Step 3: Create project
Use the image below as a guide to access the New Project dialog box.
In the Production Development Type step, select Basic Mode and click Next.
Within the New Project dialog box, enter the project details as follows:
Parameter
Description
Business Unit
Leave this field blank; the default setting is empty.
Project English Name
Input the name flink_dataphin for the project.
Project Name
Enter the project name flink_dataphin.
Compute Source Type
Activate the real-time engine and select the Ververica Flink compute source. For the Flink stream processing compute source, choose the previously created flink_dataphin compute source.
Space Type
Choose General Layer.
Security Settings
Adopt the default configuration.
More Settings
Maintain the default configuration.
Click OK to finalize the creation of the real-time project.
Step 4: Create data source
On the Dataphin home page, select Management Center from the top menu bar.
Refer to the image below to navigate to the New Data Source dialog box.
In the Relational Data Source section, select MySQL.
In the New MySQL Data Source dialog box, provide the data source details as outlined below:
Parameter
Description
Data Source Name
Enter the name flink_dataphin for the data source.
Version
Select the version, for example, MySQL8.
Data Source Description
Provide a brief description of the data source, such as Source data for real-time R&D.
Datasource Config
Choose the "production" Data Source configuration.
Tag
Leave as the default option, Not Filled.
JDBC URL
Enter the JDBC URL in the format
jdbc:mysql://host:port/dbname. You can find thehost:portdetails on the MySQL instance product page, as illustrated below:
ImportantEnsure Dataphin's IP is added to the database whitelist to avoid connection issues. For details on how to do this.
If using an internal network address, ensure that the database and Dataphin instance are in the same region. For additional information.
Username, Password
Input the username and password required to log into the data source.
SSL Encryption
If SSL encryption is enabled for your MySQL data source, select Enable, then Upload Truststore Certificate, and enter the Truststore Certificate Password for secure data transmission.
Type
Choose ApsaraDB as the type.
NoteThe access method should correspond to the network type selected during database creation.
For a Public Network Database, select a database accessible over the public network.
ApsaraDB refers to a database hosted on Alibaba Cloud.
For an ECS (VPC) Self-managed Database, choose a self-managed database within a VPC.
Advanced Settings
Retain the default configuration.
Select Test Connection to verify connectivity.
Once the connectivity test is successful, click OK to complete the data source setup.