Dataphin:Batch import and export lookup tables

Permission description

Super administrators, data standard administrators, and operators responsible for import and export records have access to view import details and download export files.

Batch import lookup tables

1. Navigate to the Dataphin home page, select Administration > Standard from the top menu bar.

2. In the left-side navigation pane, choose Reference Data > Lookup Tables. On the Reference Tables list page, click Batch Import And Export and select Batch Import Lookup Tables.

3. In the Batch Import Lookup Tables dialog box, configure the relevant parameters.

   Parameter	Description
   Import Scenario	Choose a configuration template based on the import scenario. The template file for updates includes all selected lookup table information; simply modify the necessary details and re-import. Two scenarios are supported: Add and Update. The import scenario only influences the template generation; the actual addition or update during import is determined by the presence of the lookup table code. The import scenario solely influences the creation of the configuration template. In the actual import phase, the decision to add or update hinges on the existence of the lookup table code.
   STEP 1 Download Configuration Template--Add
   Configuration Template	If no template exists, click the file name or the download icon to download the .xlsx file. If a template is already available, upload the configuration file and import it directly. Note Importing lookup tables requires permissions to create or edit them. Without these permissions, the import cannot proceed due to failed permission verification.
   STEP 1 Download Configuration Template--Update
   Update Scope	Select the lookup tables to update, ensuring the selection does not exceed 20 at a time.
   Configuration Template	Generate a template based on the selected lookup table range by clicking Generate Template. This creates a .xlsx file for download. Note If no template exists, click the file name or the download icon to download the .xlsx file. If a template is already available, upload the configuration file and import it directly. Importing lookup tables requires permissions to create or edit them. Without these permissions, the import cannot proceed due to failed permission verification.
   STEP 2 Upload Configuration File
   Upload File	Each lookup table corresponds to a separate .xlsx file. Inconsistent file types will prevent import. A maximum of 20 files can be uploaded simultaneously, with each file not exceeding 20MB. Each lookup table can contain up to 10,000 code values. Adhere to the specified filling guidelines for each field in the template. Altering row or column positions, modifying column names, or adding or deleting rows and columns will result in a parsing error, preventing import. Basic lookup table information is verified first during import. Only files that pass this verification can proceed to code value import. Lookup Table Name: Mandatory. It must correspond one-to-one with the lookup table code and be unique within its directory, with a maximum of 128 characters. Only tables with operation permissions can be imported. Lookup Table Code: Mandatory. Globally unique identifier for the lookup table, allowing up to 128 case-sensitive characters. During import, if the code exists, it's considered an update; if not, a new table is created. Lookup Table Directory: Optional. Fill in the format /first-level directory/second-level directory/.... If left blank or filled as /, it defaults to the root directory. Lookup Table Owner: Optional. Enter the username (available on the Member Management page). If not provided, the batch import operator is assumed as the owner in the add scenario; in the update scenario, existing owner information is retained. Lookup Table Description: Optional. Allows up to 1,000 characters. Code Value Information: Each code value occupies one row. After verifying the lookup table's basic information, the code value information is checked. Only files that pass this verification will be imported. Code Value: Mandatory. Supports up to 64 characters, including Chinese characters, English letters, numbers, and special characters: -,_,(),space. It must be unique within the lookup table. Code Name: Mandatory. Allows up to 64 characters, including Chinese characters, English letters, numbers, and special characters -,_,(),space. Code English Name: Optional. Supports up to 64 characters, including English letters, numbers, and half-width symbols. Code Description: Optional. Allows up to 256 characters.
   STEP 3 Conflict Resolution Policy
   Verification Field	Code value, unique within the lookup table and case-insensitive.
   Handling Policy	Select a handling policy for instances when the imported code value conflicts with an existing one in the lookup table. Choose between Skip If Conflict or Overwrite If Conflict. Skip If Conflict: If the imported code value matches an existing one, the record is skipped and not processed. Overwrite If Conflict: When the code value being imported matches an existing code value in the lookup table, the associated information, such as the code name and description, will be updated with the details from the current import.

4. Click Start Parsing to verify the file format and lookup table information for this import.

   File Format: Check if the imported file is empty, contains multiple sheets of code values or lookup tables, and if the file format matches the template.

   Lookup Table Information: Confirm if the current operator has the necessary permissions to manage the lookup table, if the creation limit is exceeded, and the validity of the lookup table configuration information, including code, name, directory, existence of a same-named table in the specified directory, owner, and description.

5. After successfulparsing, verify the code value information. Once verified, the import results page will open.

   Code Value: Check for completeness of code value and name, adherence to input specifications for code value/name/English name/description, absence of duplicates, and compliance with system limits on the number of code values.

   Parameter	Description
   Import Result	Monitor the import progress, view results, and check the execution time.
   Abnormal Records	Shows records with code values that failed verification during import, detailing the code value, code name, English name of the code, description, and associated abnormal prompts from the original file. On the Abnormal Records tab, download the problematic records by clicking Download Abnormal Records. Modify them as per the error messages and re-import.
   Skipped Records	When the conflict policy is configured to 'skip if conflict', existing code value records in the target lookup table will not be overwritten. These records will appear in the 'skipped records' list, which includes details such as code value, code name, English name of the code, description, and any abnormal prompts from the original file. Access the Skipped Records tab and click Download Skipped Records to obtain the original records in an Excel file.
   Execution Log	You can view and copy the execution log for the import process.

   After the import is completed, if you want to quickly view the import result, you can close the import configuration dialog box. Closing the dialog box will not terminate the execution of the import task. You can click Batch operation records in the lookup table list and select the historical import records you want to view.

Batch export lookup tables

1. On the Reference Tables list page, click Batch Import And Export and select Batch Export Lookup Tables.

2. In the Batch Export Lookup Tables dialog box, determine the export scope.

   Export Scope: Choose the range of lookup tables for export. Options include exporting all lookup tables or only selected ones.

   Note

   • A maximum of 1,000 lookup tables can be exported at once.

   • Each lookup table is exported as a separate .xlsx file. Multiple tables exported simultaneously will be compressed into a .zip file.

3. Click OK to complete the export of the lookup tables. You can view the information of this export operation and download the export files in the Batch operation records.

Batch operation records of lookup tables

This section allows for the review of detailed import and export operation records for each lookup table.

1. From the Reference Tables list page, click Batch Import And Export and choose Batch Operation Records.

2. In the Batch Operation Records Of Lookup Tables panel, access the import and export records.

   • Batch Import: View details of lookup table import records, including ordinal number, creator, import scenario, table name, status, creation time, and completion time. Click the View icon in the operation column for more details.

   • Batch Export: View details of lookup table export records, including ordinal number, creator, scope, status, creation time, and completion time. Click the Download icon in the operation column to save the export files locally.

     Note

     • Exported lookup table files are stored for 7 days in the file system and cannot be downloaded after this period.

     • Only records with a successful export status are available for file download.

What to do next

After importing the lookup tables, you can manage the lookup tables in the lookup table list. For more information, see the lookup table list.