Batch import

The import feature of DataWorks Data Modeling provides different types of import templates for objects such as models and data metrics. You can use the import feature to import information about multiple objects to Data Modeling at a time based on the related import template to create the objects in Data Modeling. The import feature frees you from repeatedly creating objects and saves time for you. This topic describes how to use the import feature to import information about multiple objects to Data Modeling at a time to create the objects in Data Modeling.

Limits

Only files in the .xlsx format are supported. Each file is limited to 30,000 rows and a maximum size of 10 MB.

Go to the Imported Objects page

Log on to the DataWorks console. In the target region, click Data Development and O&M > Data Modeling in the left-side navigation pane. Select a workspace from the drop-down list and click Go to Data Modeling.
In the top navigation bar of the Data Modeling page, click General Tools.

On the Imported Objects page, you can create an import task or manage existing import tasks. For more information, see Create an import task or Manage import tasks.

Create an import task

Note

The configuration items vary based on the type of import task. In this topic, an import task for importing data domains is used to describe the import feature. You can view the configuration items for other types of import tasks in the console.

On the Imported Objects page, click Create Import Task.
Select an import object type and download an import template.

On the Confirm Import Type tab, select the object type to import and download the corresponding template. Then, fill in the template based on your business requirements.

Note
After you select the required import object type, you can preview the fields in the import template and prepare the related configuration information.

Import types include data warehouse planning (data domains, business processes), data standard (field standards, standard codes, units of measure, naming dictionaries), dimensional modeling, and data metrics (atomic metrics, modifiers, time periods). For example, the template for a data domain includes fields such as English abbreviation, English name, Chinese name, description, and owner account ID. After you fill in the template, click Next.
Import the object information and check the information.
On the Data Import tab, upload and preview the data file. You can filter the preview to show only objects with names that conflict with existing objects in DataWorks, which allows you to modify or delete them before importing.
Note
- The available Import Mode and Import Status options depend on the selected import type.
  
  Import Mode: If an object in the imported file has the same name as an existing object in DataWorks, you can choose to either skip the object or overwrite the existing object with the content from the file.
  
  Import Status:
  
  Import and Save: Imports and saves the data without creating a new version.
  
  Import and Submit: Imports the data and submits it as a new version.
- Only files in the .xlsx format are supported. Each file is limited to 30,000 rows and a maximum size of 10 MB.
View the import results.

On the Complete tab, you can view the import results. In the details list, click View More Details next to an item to go to its edit page. If an import failed, troubleshoot the errors based on the details and import the file again. The page displays statistics about the import task. The Import Result Details table lists the status for each record. From this page, you can click More Details for more information or click Continue to Import to start a new import task.

Manage import tasks

The import page lists all import tasks and their details.

Area

Description

Filter bar

In this area, you can specify one or more of the following filter conditions to search for the desired import tasks: Operation Date, Import Type, and Operator.

Task list

In this section, you can view information about the import task, such as its status, the amount of data that was successfully imported, and the total amount of data imported in the task. Click View Details to view the details of the task. Pay attention to the following:

Import Status:
- Successful: All objects in the task were imported successfully.
- Failed: All objects in the task failed to import.
- Partially Successful: Some objects in the task failed to import.
You must identify and troubleshoot the exception based on the details of the failure.
If the values for volume of imported data and Total data volume: do not match, the possible reasons are as follows:
- Some objects fail to be imported by using the import task.
- Some objects that are imported by using the import task have the same names as some existing objects in Data Modeling.
You must troubleshoot the issue based on actual scenarios.

What to do next

After an import task is created, you can go to the editing page of the import task to perform other operations based on your business requirements.