Dataphin:Creating and managing Data Standards

Permissions description

• Super administrators and data standard administrators have the authority to create or clone data standards across all data standard sets.

• Data standard set maintainers and members are authorized to create or clone data standards within the data standard sets they are part of.

• Super administrators, data standard administrators, and data standard owners can manage the data standards they oversee, which includes editing, submitting for approval, deleting, unpublishing, and modifying associated standards.

Limits

A single data standard set may contain no more than 1000 standards.

Data Standard list

On the data standard page, you can concentrate on a particular data standard set that you adhere to or that pertains to you, allowing for a quick review of the standard summary within that set. The data standard list offers two display modes: Edit and View. On the Standard List page, you can click the icon in the upper right corner to toggle between views.

In view mode, you can browse the data standard set directory and view information about data standards, but you cannot perform any operations. This mode is ideal for users who only need to view information.

In edit mode, you can not only view the data standard set directory and data standards but also carry out actions such as editing, deleting, creating new standards, cloning, publishing, and revoking standards, along with editing and deleting within the data standard set directory. Edit mode is accessible only to users with data standard management permissions for the current data standard set. Below is an illustration of the edit state.

Operations Supported by Standards

Creating Data Standards

• Data standards must be created using a specific standard template within a designated data standard set.

• The data standard set defines the standard's classification and ownership, along with the permissions, control, and approval process required for publishing. The standard template dictates the attributes that must be filled in when creating a data standard and allows for the configuration of monitoring features.

• There are three entry points for creating data standards, depending on whether a standard template is pre-configured:

  • Entry Point One: From the global data standard list, click the new standard button in the upper right corner, select the data standard set and standard template to proceed to the standard details configuration page.

  • Entry Point Two: On the data standard list page of an individual data standard set, if the set has a default standard template, you will be taken directly to the standard details configuration page based on the default template attributes. If there is no default standard template, you must select one before proceeding to the new standard page.

  • Entry Point Three: In the standard template list, click the new icon next to a standard template. The template will automatically populate with the current template's attributes, and after selecting the data standard set, you will be directed to the new standard page.

Procedure

1. On the Dataphin home page, click Administration > Standard in the top menu bar.

2. The following figure demonstrates how to Create Standard on the global standard list page. Click Standard in the left-side navigation pane, then click the + Create Standard button.

3. In the New Data Standard dialog box, select the data standard set and standard template.

   • Standard Set: Please select the data standard set to which the data standard will belong.

   • Standard Template: When a selected data standard set comes with a configured default standard template, it will automatically populate the default template. If there is no default template, you must select a standard template manually. For guidance on creating a standard template, see Create and manage standard templates.

4. Click Next to proceed to the new standard page and configure the standard's parameters.

   If you want to change the standard template, click Switch in the upper right corner.

   Important

   Please note that switching templates will clear all previously configured information, which cannot be restored. Ensure that the information is complete and meets the attribute value specifications before switching.

   Parameter	Description
   Attribute configuration
   Attribute Information	The specification for filling in attribute values depends on the attribute configuration of the standard template to which it belongs. For example, the field value type corresponding to the Pause schedule date attribute is enumeration value (single choice), and the range of optional enumeration values references the China statutory holidays lookup table. Therefore, when creating a data standard, the attribute value is a dropdown single-choice box, with optional enumeration values referencing the code values of the China statutory holidays lookup table. Standard code value: If the standard code of the current template is automatically generated based on the coding rule, the system will display the code value generated based on the rule. You can click Regenerate, and the system will regenerate a new code value for you. You can also click Switch to custom edit to fill in the code value according to the coding rule constraints of the current template. System attribute configuration: Range value: If the attribute field value type is range value, the configuration method is as follows: Enter enumeration value: Commonly used when the value range is enumerable. Multiple enumeration values are separated by English half-width commas and do not exceed 5000 characters. Interval value: Commonly used when the value range is a continuous number or date. You can choose from five symbols: >, >=, <, <=, No Limit. If both the maximum and minimum values are set to No Limit, no configuration is required. Reference lookup table: Commonly used when the attribute value range is dynamically changing or needs to follow a certain constraint. Only lookup tables with the status of Published can be selected. For more attribute configuration information, see Custom attributes. Built-in attributes: If referencing Dataphin system built-in attributes, the constraint configuration is as follows: When the attribute configuration references System Attribute - Data Type, you need to select the data type stored in the database for the field. If the data type is CHAR (n) or VARCHAR (n), you need to configure the length. CHAR defaults to 255 and can choose an integer between 1 and 255. VARCHAR defaults to 1000 and can choose an integer between 1 and 65535. If the data type is DECIMAL (p,s), you need to configure the precision. DECIMAL defaults to [38,18]. Precision can choose an integer between 1 and 38, and scale can choose an integer between 0 and 18. Scale must be less than precision, otherwise the input is invalid. When the attribute configuration references System Attribute - Range, configure the value constraint range based on the configured attribute field value type and range value type. When the attribute configuration references System Attribute - Is Nullable/Is Empty String/Is Unique, you can choose the value constraint as Yes or No. When the attribute configuration references System Attribute - Data Classification/Data Grading, please select the data classification category and data grading level you need to better manage data by layers. For information on creating data classification and data grading, see Manage data classification, Manage data grading. Note If the system built-in attributes are referenced by data standards, the built-in monitoring will also be referenced. If you have not activated the corresponding module, you cannot reference the built-in monitoring configuration of the system attributes, only the attribute configuration can be referenced. Different functional modules correspond to different attributes as follows: Range, Is Nullable, Is Empty String, Is Unique built-in content quality monitoring, so you need to activate the asset quality module function to make the monitoring effective. Data Classification, Data Grading need to activate the asset security module function to make the monitoring effective. The system public property can optionally automatically add the corresponding drop mark monitoring configuration. The system will generate the corresponding verification details based on the filled property value and property meaning. You can manually modify the configuration as needed. If you do not need to perform drop mark auditing, you can manually cancel the selected monitoring configuration. Note: The monitoring configuration selection status following the property corresponds one-to-one with the rules in the monitoring configuration list below.
   Business information
   Data Standard Set And Directory	Default data standard set name.
   Effective Time	Set the effective time of the standard. Permanent: Effective permanently. Custom: Effective within the specified time period. Beyond the specified time period, the standard will become expired. If you need to continue using the standard, you can modify the effective time and republish it.
   Owner	Select the owner of the standard. The standard owner needs to be a maintainer or member of the data standard set to which it belongs and can edit and delete the standard.
   Description	Custom description, not exceeding 256 characters.
   Monitoring configuration The monitoring rules include metadata monitoring and content quality monitoring inherited from system attributes, along with custom quality monitoring rules. For details on metadata and content quality monitoring, see Metadata monitoring and Content quality monitoring. For information on creating quality monitoring rules, see Quality monitoring rule configuration. You can click the button to view the details of the monitoring configuration instructions.
   Monitoring rule configuration	If you have purchased the asset quality module, you can customize quality monitoring, such as Field Uniqueness Validation. After configuration, all asset objects mapped to the current standard can quickly reference and add the monitoring configured by the current standard on the quality rule configuration page to better follow the constraints of the data standard and achieve the effect of batch creating quality monitoring. Each data standard can configure up to 100 monitoring rules. You can perform view, edit, and delete operations on the monitoring rules. When creating Dataphin data table quality rules, you can reference the quality monitoring rules configured here to quickly produce quality rules in batches. On the standard mapping relationship page, for each valid mapping relationship, you can quickly reference the monitoring configured by the standard in the relationship and generate the corresponding quality monitoring rules. Note If the standard deletes the quality monitoring rules, the configuration of the generated quality rules will be incomplete. Please operate with caution according to business needs. If the standard modifies the quality monitoring rules, the generated quality rules will be updated synchronously, but the content of the quality custom configuration will not be modified. When referencing public attributes with monitoring, the corresponding monitoring rules, such as metadata monitoring, will be automatically added. The information supported for editing varies for quality rules generated in different functions. For details, see Quality rule editing instructions.
   Intelligent mapping configuration
   Feature	After configuring the identification features associated with the standard, during the execution of the mapping rules, the mapping relationship between the standard and asset objects will be intelligently recommended based on the defined feature expression, combined with data content details and object description metadata information, reducing manual configuration costs. Supports selecting up to 20 identification features. Multiple identification features are in an or relationship. Click the view icon after the identification feature to view the identification feature information in the View Feature Details dialog box.
   Associated information
   Associated Standards	Supports viewing the information of associated data standards, including the standard name, standard code, directory & data standard set it belongs to, owner, and associated relationship information. Add associated standards: Click the Add button. In the Add Associated Standards dialog box, associate data standards, supporting the configuration of up to 50 associated standards. Click Confirm to add the associated standards to the list. Only when you click the Save or Save And Publish button at the bottom, the associated standards can be successfully added. View standards: You can click the name of the standard to view the basic information, monitoring rules, and historical version details of the standard in the View Standard panel. Delete associated standards: Click the delete icon in the operation column to remove the associated standards.
   Associated Lookup Tables	Supports viewing the information of associated lookup tables, including the lookup table name, lookup table code, owner, and associated relationship information. View lookup tables: You can click the name of the lookup table or the View icon in the operation column to view the details and reference information of the lookup table. Edit associated lookup tables: The associated lookup table is automatically generated based on the configured standard attribute values. You can modify the standard's associated lookup table information by modifying the attribute values.
   Associated Documents	Supports viewing the information of associated standard documents, including the standard document name, description, directory it belongs to, and creator information. Add associated documents: Click the Add button. In the Add Associated Documents dialog box, associate documents, supporting the configuration of up to 50 associated documents. Click Confirm to add the associated documents to the list. Only when you click the Save or Save And Publish button at the bottom, the associated documents can be successfully added. Preview Documents: When the document format is PDF, online preview of document content is supported. Download Documents: You can download the standard documents to your local device and view them. Delete Associated Documents: Click the delete icon in the operation column to remove the associated documents.

5. Click Save to review the configuration information in the data standard list.

   To publish the standard online, click Save And Publish. You will need to provide Approval Remarks as reference for the publishing process in the Submit For Publishing Standard dialog box, then click Confirm to publish the standard to the production environment.

Quality monitoring rule configuration