DataWorks:StarRocks

EMR Serverless StarRocks

Add the IP addresses of the DataWorks resource group to the IP allowlist of your EMR Serverless StarRocks instance.

• For the IP addresses of DataWorks resource groups, see General configurations: Add IP addresses to an allowlist.

• Add IP addresses to the allowlist in the EMR console.

  

Self-managed StarRocks

Make sure the DataWorks resource group can reach the query port, FE port, and BE port of your StarRocks instance. The default ports are 9030, 8030, and 8040.

Internal network connection (recommended)

Use this mode when your StarRocks instance and the Serverless resource group are in the same Virtual Private Cloud (VPC). An internal network connection provides low latency without exposing data to the public internet.

Both Alibaba Cloud instance mode and Connection string mode are supported:

• ApsaraDB for RDS: Select a StarRocks instance in the same VPC directly. The system retrieves the connection information automatically.

• User-created Data Store with Public IP Addresses: Enter the internal address or IP address, port, and Load URL of the instance.

Public network connection

Use this mode when you need to access StarRocks over the public network, for example, for cross-region access or from an on-premises environment. Only Connection string mode is supported.

• Enable public network access on your StarRocks instance before connecting.

• User-created Data Store with Public IP Addresses: Enter the public address or IP address, port, and Load URL of the instance.

Serverless resource groups cannot access the public network by default. To connect to StarRocks over a public endpoint, configure a NAT Gateway and an Elastic IP address (EIP) for the bound VPC. Make sure the Serverless resource group can reach the query port, FE port, and BE port (defaults: 9030, 8030, and 8040).

For Alibaba Cloud EMR StarRocks Serverless, set Host Address/IP Address to Internal Endpoint or Public network address, and set the port to a query port.

• FE: Get the FE information from the instance details page.

  

• Database: After connecting through EMR StarRocks Manager, view databases in SQL Editor or Metadata Management.

  To create a database, run SQL commands directly in the SQL editor.

  

Configure a batch synchronization task using the Code Editor

When configuring a batch synchronization task in the Code Editor, set the parameters in the script according to the unified script format. For format requirements, see Use the Code Editor.

Reader

{
    "stepType": "starrocks",
    "parameter": {
        "selectedDatabase": "didb1",
        "datasource": "starrocks_datasource",
        "column": [
            "id",
            "name"
        ],
        "where": "id>100",
        "table": "table1",
        "splitPk": "id"
    },
    "name": "Reader",
    "category": "reader"
}

Writer

{
    "stepType": "starrocks",
    "parameter": {
        "selectedDatabase": "didb1",
        "loadProps": {
            "row_delimiter": "",
            "column_separator": ""
        },
        "datasource": "starrocks_public",
        "column": [
            "id",
            "name"
        ],
        "loadUrl": [
            "1.1.X.X:8030"
        ],
        "table": "table1",
        "preSql": [
            "truncate table table1"
        ],
        "postSql": [
        ],
        "maxBatchRows": 500000,
        "maxBatchSize": 5242880,
        "strategyOnError": "exit"
    },
    "name": "Writer",
    "category": "writer"
}

{"column_separator": "<your-separator>", "row_delimiter": "<your-delimiter>"}

{
    "format": "json"
}