Manage import jobs

Updated at:
Copy as MD

The Import Tasks page in EMR StarRocks Manager gives you a visual view of all import jobs in your StarRocks instance — without running SQL commands. Use it to monitor job progress, diagnose failures, and control jobs that are stuck or running unexpectedly.

Data on the Import Tasks page comes from StarRocks kernel query commands such as SHOW LOAD. Its lifecycle matches the data stored in the StarRocks kernel.

Note

Broker Load is an asynchronous import method. A job that submits without errors may still fail. After submitting a Broker Load job, check the Import Tasks page to confirm the final status.

Prerequisites

Before you begin, ensure that you have:

  • A connected StarRocks instance. For more information, see SQL editor.

Limitations

Import task management requires a StarRocks instance with minor version 2.5.8-1.7-1.1.3 or later.

View import jobs

Important

To view Stream Load jobs, run SET GLOBAL enable_load_profile = true first.

On the Import Tasks page, you can:

  • View jobs in Broker Load, Routine Load, Stream Load, or Insert mode.

  • Sort jobs by job ID or creation time, in ascending or descending order.

  • Filter jobs by warehouse name, database name, table name, job ID, status, or tag.

Job states by mode

Each import mode has its own set of states. Understanding what each state means helps you decide whether to wait or intervene.

States fall into two categories:

  • Terminal states — the job has ended. No further action is needed or possible.

  • In-progress states — the job is still running or waiting. Monitor these to decide whether to wait or intervene.

The following tables map each state to its category and what the system is doing.

Broker Load

StateCategoryWhat it means
FINISHEDTerminalThe job succeeded.
CANCELLEDTerminalThe job failed.
QUEUEINGIn progressThe job is waiting in the queue to be scheduled.
PENDINGIn progressThe job has been created but not yet started.
LOADINGIn progressThe job is actively importing data.
PREPAREDIn progressThe import job is submitted.

Routine Load

StateCategoryWhat it means
STOPPEDTerminalThe job has ended and cannot be restarted.
CANCELLEDTerminalThe job failed.
NEED_SCHEDULEIn progressThe job is waiting to be rescheduled.
RUNNINGIn progressThe job is actively consuming messages from Kafka.
PAUSEDIn progressThe job is suspended. Resume it when ready.

Stream Load

StateCategoryWhat it means
FINISHEDTerminalThe job succeeded.
CANCELLEDTerminalThe job failed.
BEGINIn progressThe job has started.
BEFORE_LOADIn progressThe data is queued and waiting to be imported.
LOADINGIn progressThe data is being imported.
PREPARINGIn progressThe job is preparing to commit.
PREPAREDIn progressThe job is presubmitted.
COMMITEDIn progressThe import job is submitted.

Insert

Note

Insert mode supports internal tables only.

StateCategoryWhat it means
FINISHEDTerminalThe job succeeded.
CANCELLEDTerminalThe job failed.
QUEUEINGIn progressThe job is waiting in the queue to be scheduled.
PENDINGIn progressThe job has been created but not yet started.
LOADINGIn progressThe job is actively running.
PREPAREDIn progressThe import job is submitted.

View job details

  1. On the Import Tasks page, click the tab for the import mode you want to inspect.

  2. Find the job and click its job ID.

  3. On the Task Details page, review the job details and error logs if the job failed.

When a job shows CANCELLED status on the list page, hover over the status to see a quick error summary. For the full error log, go to the Task Details tab.

Detail fields by mode

Broker Load

FieldDescription
etlInfoExtract, transform, and load (ETL) information.
taskInfoParameters set at job creation: resource (not used), timeout (seconds), and max-filter-ratio (maximum fraction of rows that can be filtered due to data quality issues).
jobDetailsNumber of tasks, imported file count and size, total data volume, and row count.
errorMessagenull when the job is in PENDING, LOADING, or FINISHED state. When CANCELLED, contains type and msg. See the errorMessage type values below.
trackingSQLSQL statement to query the error log directly.
trackingLogsError log details.

`errorMessage` type values:

TypeMeaningNext step
USER_CANCELThe job was manually canceled.No action required.
ETL_SUBMIT_FAILThe job failed during submission.Check network connectivity and job configuration.
ETL_QUALITY_UNSATISFIEDThe error rate exceeded max-filter-ratio.Review max-filter-ratio in taskInfo and inspect trackingLogs for filtered rows.
LOAD_RUN_FAILThe job failed during the loading phase.Inspect trackingLogs for the root cause.
TIMEOUTThe job did not complete within the timeout period.Increase the timeout value in taskInfo or reduce the data volume per job.
UNKNOWNAn unexpected error occurred.Inspect trackingLogs for details.

Routine Load

FieldDescription
jobPropertiesJob configuration properties.
dataSourcePropertiesData source configuration, such as Kafka topic and partition offsets.
customPropertiesUser-defined properties.
statisticsRow count and data volume processed so far.
reasonOfStateChangedExplanation of the most recent state transition.
errorLogUrlsURL to the error log for failed jobs.
otherMsgAdditional diagnostic information.
trackingSQLSQL statement to query the error log directly.
trackingLogsError log details.

Stream Load

FieldDescription
errorMessageError message for failed jobs.
trackingSQLSQL statement to query the error log directly.
trackingLogsError log details.

Insert

FieldDescription
etlInfoETL information.
taskInfoParameters set at job creation: resource (not used in Insert jobs), timeout (seconds), and max-filter-ratio.
jobDetailsNumber of tasks, imported file count and size, total data volume, and row count.
errorMessagenull when the job is in PENDING, LOADING, or FINISHED state. When CANCELLED, contains type and msg (same types as Broker Load).
trackingSQLSQL statement to query the error log directly.
trackingLogsError log details.

View job profiles

A job profile contains performance metrics for diagnosing slow or inefficient import jobs.

  1. On the Import Tasks page, click the tab for the import mode.

  2. Find the job and click its ID in the Task ID column.

  3. Click the Task Profile tab.

Profile retention limits:

  • Only the most recent 500 job profiles are retained per StarRocks instance. This applies to both Broker Load and Stream Load jobs.

  • For Stream Load, profiles are collected only for jobs that run for more than 10 seconds. High-frequency real-time imports generate many short-lived tasks, so most are excluded by default.

If you need to inspect jobs beyond the 500-profile limit, query the StarRocks information schema directly using SHOW LOAD or SHOW ROUTINE LOAD in the SQL editor.

Manage import jobs

You can take action on jobs in Broker Load or Routine Load mode that have not yet reached a terminal state.

ModeActionResult
Broker LoadCancelThe job enters CANCELLED state and stops immediately.
Routine LoadPauseThe job enters PAUSED state. Click Resume in the Actions column to restart it.
Routine LoadRestoreThe job briefly enters NEED_SCHEDULE state while being rescheduled, then returns to RUNNING and resumes consuming Kafka messages.
Routine LoadStopThe job enters STOPPED state permanently. This action cannot be undone.

Example: monitor and troubleshoot Broker Load jobs

This example shows how to create two Broker Load jobs — one successful and one that fails due to dirty data — and then use StarRocks Manager to diagnose the failure.

  1. Create two import jobs in Broker Load mode. For more information, see Broker Load. For the second job, modify the table data to introduce dirty data. This simulates a job that exceeds the max-filter-ratio threshold and enters CANCELLED state. For other import modes, see Routine Load and Stream Load.

  2. Open StarRocks Manager:

    1. Log on to the EMR console.

    2. In the left-side navigation pane, choose EMR Serverless > StarRocks.

    3. In the top navigation bar, select the region where your instance is deployed.

    4. Click StarRocks Manager, or find the instance and click Connect in the Actions column. For more information, see Use EMR StarRocks Manager to connect to an EMR Serverless StarRocks instance.

  3. Connect to the StarRocks instance. For more information, see SQL editor.

  4. In the left-side navigation pane, click Import Tasks. The page lists all import jobs in your account. For jobs in CANCELLED state, hover over the status to see a brief error summary.

  5. Click the Broker Load tab (selected by default).

  6. Find the failed job and click its job ID.

    • On the Task Details tab, check errorMessage to identify the failure type. For ETL_QUALITY_UNSATISFIED errors, review max-filter-ratio in taskInfo and inspect trackingLogs for the specific rows that were filtered.

    • On the Task Profile tab, review performance metrics to identify bottlenecks if the job ran slowly before failing.

What's next