All Products
Search
Document Center

Dataphin:Manage data quality objects to be published

Last Updated:Jan 21, 2025

The data quality objects within the imported deployment package file are displayed on the 'Data Quality to be Published' page, where you can manage and publish them.

Data quality objects to be published entry

  1. Log on to Dataphin using the cross-tenant publisher account.

  2. Navigate to the Dataphin home page, and from the top menu bar, select Management Center > Migration.

  3. In the left-side navigation pane, select Migration > Import Deployment Package.

  4. Single click the Actions column's publish icon image.

  5. Click the Data Quality tab to access the global objects to be published page.

View and manage data quality objects to be published

Once the deployment package has been successfully imported, you have the ability to filter, publish, view details, compare versions, and examine version specifics for data quality objects within the Rule Template and Quality Rule tabs. The operations you can perform will depend on the type of object.

Note

Data quality relies on many complex objects. It is recommended to publish according to the order in the "Instructions" in the upper right corner of the page. For the recommended publishing order of the deployment package, see Recommended publishing order.

Operation items

Description

Filter

Perform a fuzzy search by object name or filter by change time, publishing status, change type, and environment changes.

  • Batch Search: You can click Batch Search and enter the supported search items for each object in the Batch Search dialog box. You can enter up to 1,000 items, separated by line breaks. Click OK to perform an exact search, and the system will display the found objects in the list below.

  • Filter:

    • Select the start and end dates for Change Time in the format YYYY-MM-DD hh:mm:ss.

    • Choose one or more statuses for Publishing Status, including To Be Published, In Publish, Published Successfully, Publishing Failed, and Succeeded With Warning. 'Succeeded with warning' indicates a successful publish with minor discrepancies that do not affect the use of the objects but signal a potential risk.

    • Change Type: You may select multiple change types simultaneously, including Add, Update, and Delete. For detailed explanations of each change type, see Change type description.

    • Check for Environment Change to see if the current target environment has changed since the last import.

    • Filter quality rule objects by Check Object Type.

Publish

Republish objects that failed or are pending publication. Both individual and batch publishing are supported. Objects that have been published successfully do not require republishing.

  • For Single publish, click publish in the operation column of the desired object. In the publish dialog box, enter a publish name (up to 64 characters) and click OK.

  • For Batch publish, select the check box next to the object names, or use Select All or Select All On This Page at the bottom of the page. After selecting the objects, click Publish. In the publish dialog box, enter a publish name (up to 64 characters) and click OK.

    Note

    'Select all' applies to all objects under the current filter and search conditions; 'select all on this page' applies only to the objects on the current page.

View details

View detailed information of individual objects in the current target environment.

Note

When the change type is delete and the publishing status is successful, the object no longer exists in the target environment, and its details cannot be viewed.

Version comparison

Version comparison is available only for objects with a change type of update. It compares the current import's version with the latest version in the target environment.

Publishing details

In the Publishing Details dialog box, review basic information, flow verification, and abnormal reminder information.

  • Flow verification:

    • Dependency verification:

      • For Rule templates, verify the existence of the corresponding data source for the Dataphin table and global data table in the target environment when the change type is add or update.

      • For Quality rules, when adding or updating, ensure that the rule template, tables, dependent objects, and business properties required by the quality rule exist in the target environment.

    • Publishing verification:

      • For Rule templates, confirm the success of the publishing process. This includes re-executing pre-verification, checking the number of rule templates when adding or updating, and confirming deletion when the change type is delete.

      • For Quality rules, confirm the success of the publishing process. This includes re-executing pre-verification, checking the number of quality rules when adding or updating, and confirming deletion when the change type is delete.

    • Monitored object: This verification item is supported solely by quality rule objects. It checks for the existence of the monitored object within the current environment.

  • Abnormal reminder: Displays detailed information about any abnormalities found during verification.