Automate Data Standardization with Smart Mapping Recommendations - Dataphin

Standard mapping uses a large language model and semantic analysis on selected data tables to identify core fields. It then intelligently recommends standard mappings that you can apply or discard. This topic describes how to configure intelligent standard mapping recommendations.

Prerequisites

You must purchase the Standard function plan and the X-Data Standard function plan to use X-Data Standard.
X-Data Standard is configured and enabled. For more information, see Intelligent Assistant.

Permissions

Super administrators, data standard administrators, and custom global roles with Standard - Management permissions can use X-Data Standard.
Super administrators and operations administrators can add Dataphin table assets and data source table assets. Additionally, project or sector administrators and table owners can add Dataphin table assets. Operations personnel and table maintenance personnel can add data source table assets.
Super administrators, data standard administrators, standard owners, and asset owners can add or delete mappings.

Procedure

On the Dataphin homepage, choose Super X > X-Data Standard from the top menu bar to go to the X-Data Standard page.

On the X-Data Standard page, you can create mappings between asset objects and data standards.

Area	Description
① Intelligent Assistant	Switch between enabled intelligent applications that you have permission to use.
② Task Records / New Task	Task Records: Click Task Records in the upper-left corner. In the Task Records dialog box, view up to 20 task records from the last 7 or 30 days and perform the following operations: Search and filter: Search for task records by keyword, or click the filter icon to filter them by governance operation or data source. Rename: Click the Rename icon next to a task record to rename it. The name can contain up to 256 characters. Delete: Click the Delete icon next to a task record to delete it. New Task: Click New Task in the upper-left corner to open a new task page.
③ Data scope for intelligent standard mapping recommendations	Select the data scope from asset sources for standard mapping recommendations. Add Data: Standard mapping recommendations are supported only for Dataphin tables. Projects contain only physical tables, and sectors contain only logical tables. Click Select data for governance or the Add Data Source button. In the Add Data Source panel, select the desired asset objects and click OK. You can select up to five data sources. Asset search and filter: Search for assets by keyword, or filter them by environment or asset type. Asset rule configuration: After you select an asset, click the Edit icon in the Data Scope column. In the Data Scope Configuration dialog box that appears, configure the data scope for the asset and click OK. Data Scope: You can select All Tables or Specific Tables. If you select Specific Tables, you can configure filter conditions based on the full table name, asset checklist tag, table description, or db/schema (supported only for data sources) to filter assets with finer granularity. You can configure up to 10 filter conditions. The relationship between filter conditions can be AND or OR. Full Table Name, Table Description, and db/schema: The supported filter conditions are prefix match, suffix match, contains (for Table Description only), and belongs to (for db/schema only). For Prefix Match, Suffix Match, and Contains, you can enter up to 256 characters. For Belongs To, you can select up to 500 asset objects of the corresponding type from the current data source. Asset Checklist Tag: Supports the "contains any" and "contains all" filter conditions. Contains Any: The asset checklist tags must contain at least one of the selected tag values to meet the condition. Contains All: The asset checklist tags must contain all of the selected tag values to meet the condition. Intelligently Identify Core Fields: If you enable this option, the task uses semantic analysis to identify core fields within the selected data scope before it performs standard mapping. If you disable this option, standard mapping is performed on all fields of the selected asset objects. Important Intelligently identifying core fields can reduce interference from irrelevant information. However, this may also cause objects that require governance to be ignored. Filter Mapped Fields: This option can be configured only when the standard mapping recommendation card is selected. If you select this option, fields that already have a valid standard mapping are filtered out. Start Execution: After you configure the data scope, click the icon to trigger the task. For more information about the task execution flow, see Intelligent standard mapping recommendation flow. After the task is successfully executed, you can view the standard mapping details.

View standard mapping details

The standard mapping recommendation list displays the mappings between data standards and asset objects. These mappings are intelligently recommended by a large language model for your configured assets. You can view the standard mappings from three perspectives: Expand All, Group By Standard, and Group By Table.

View all standard mappings

You can search by data table, field, or standard name. You can also filter by data source or data standard set. Use the quick filters to find mapping objects with a Pending Review or Application Failed status.
The list shows the table or data source, field, data standard or code, data standard set or folder, and review status for each mapping object.
- Table/Data Source: For Dataphin physical tables, the project name is displayed. For logical tables, the sector name is displayed. For data sources, the db/schema (and its data source) is displayed. Click the name to go to the object details page under Governance > Asset Checklist to view more asset information.
- Data Standard/Code: Click a standard name to view the details of the mapped data standard in the View Standard panel. You can switch between versions.

View standard mappings from the Summary by Standard view

You can search by standard name or code. You can also filter by data standard set. Use the quick filters to find mappings with a Pending Review or Application Failed status.
The list shows the standard name, data code, data standard set, data standard set folder, number of fields, and review status.
View Details: Click a standard name or the View icon in the Actions column to view the standard mapping details.

Standard mapping details

You can search by asset table name or field name. You can also filter by data source. Use the quick filters to find assets that are pending review or have failed applications.
The list shows the asset name, its table, data source, and review status.
- Table: Click the name to go to the object details page under Governance > Asset Checklist to view more asset information.
- Data Source: For Dataphin physical tables, the project name is displayed. For logical tables, the sector name is displayed. For data sources, the db/schema (and its data source) is displayed.

View standard mappings from the Table Summary view

You can search by table name. You can also filter by data source. Use the quick filters to find mappings with a Pending Review or Application Failed status.
The list shows the asset name, data source, number of fields, number of standards, and review status.
- View Details: Click a table name or the View icon in the Actions column to view the standard mapping details.
- Data Source: For Dataphin physical tables, the project name is displayed. For logical tables, the sector name is displayed. For data sources, the db/schema (and its data source) is displayed.

Standard mapping details

You can search by asset field name or standard name. You can also filter by data standard set. Use the quick filters to find assets that are pending review or have failed applications.
The list shows the asset name, data standard or code, data standard set or folder, and review status.
Data Standard/Code: Click a standard name to view the details of the mapped data standard in the View Standard panel. You can switch between versions.

Manage standard mapping details

You can perform different operations on assets or objects in different views, as shown in the table below.

View	Single Operation	Batch Operation	Operations on Standard Mapping Details
Expand All	Allows you to perform Application and Deprecate operations on specific objects, such as Dataphin tables or data sources, in the current mapping.	Allows you to perform Application and Deprecate operations on selected objects, such as Dataphin tables or data sources, in this view.	None
Group by Standard	Allows you to perform View Details, Application, and Deprecate operations on standards in the current mapping. Operations on a standard also apply to all objects mapped to it.	None	Allows you to perform operations on all objects that are mapped to the standard in the current mapping. Single operation: Supports Application, Deprecate, and Unmap (and Delete This Row). Batch operations: Supports Application / Apply All and Deprecate / Deprecate All.
Group by Table	Allows you to perform View Details, Application, and Deprecate operations on tables in the current mapping. Operations on a table also apply to all objects mapped within it.	None	Allows you to perform operations on all objects that are mapped within the table in the current mapping. Single operation: Supports Application, Deprecate, and Unmap (and Delete This Row). Batch operations: Supports Application / Apply All and Deprecate / Deprecate All.

Operation	Description
Application	This operation is available when the review status is Pending review, Application failed, or Discarded. This operation adds the current mapping to the Valid Mappings list under Governance > Data Standard > Mappings. To apply a single mapping, click the Apply icon in the Actions column. For batch applications, you can select the scope based on the review status and choose how to handle invalid mapping conflicts. Filter By Application Status: You can apply mappings with a review status of Pending Review or Application Failed. Invalid Mapping Conflict Resolution: This policy determines how to handle mappings that are being applied but already exist in the invalid mappings list. You can choose to skip them or change their status to valid. Skip And Do Not Add: If a mapping to be applied is already in the invalid mappings list, the system skips it. The review status of this mapping is recorded as Application failed. Change Invalid Mapping To Valid Mapping: If a mapping to be applied is already in the invalid mappings list, the system first removes it from the invalid mappings list and then adds it to the valid mappings list.
Discard	This operation is available when the review status is Pending review or Application failed. To discard a single mapping, click the Discard icon in the Actions column. For batch discards, you can select the scope based on the review status. You can discard mappings with a review status of Pending Review or Application Failed.
Unmap (and delete this row)	This operation is available when the review status is Applied. This operation unmaps and deletes the current mapping. You can re-add it on the Data Standard page by importing valid mappings in a batch or creating a standard mapping rule.