After initiating remediation, you can monitor and manage the entire process, including verification details. This topic explains how to oversee the remediation process.
Usage instructions
Activation of the Data Quality module is required to utilize the remediation process feature.
Permission instructions
Super administrators and quality administrators have permissions to view, dismiss abnormalities, re-verify, initiate, and complete acceptance for all remediation processes.
Regular users designated as the remediation or acceptance owner can view, dismiss abnormalities, and re-verify the remediation process.
Super administrators and quality administrators can add or remove associated knowledge bases in the remediation process.
The remediation owner can initiate acceptance, while the acceptance owner is responsible for completing it.
Operation permissions vary by object. For more information, see Remediation Process Operation Permissions.
Remediation owner and acceptance owner instructions
The remediation owner, responsible for the remediation process, requires permissions to edit and verify quality rules and may initiate acceptance. The acceptance owner, as the final arbiter, decides whether to approve the remediation based on its effectiveness.
View remediation process from different perspectives
Dataphin allows viewing the remediation process from both Global and Personal perspectives.
Global: Super administrators and quality administrators can access all remediation processes globally.
Personal: Super administrators and quality administrators can switch to view any member's remediation processes. Regular members can only see their own remediation or acceptance processes and cannot switch views.
The personal perspective only displays remediation processes where you are the quality owner.
Remediation process entry
On the Dataphin home page, click Administration > Data Quality in the top menu bar.
In the left-side navigation pane, click Remediation Process to access the Remediation Process page.
View remediation process list
The remediation process page lists information post-remediation from verification details. The display is consistent across Dataphin tables, global tables, data sources, metrics, real-time meta tables, and tags. Below is an example using the Dataphin table.
Area | Description |
①Search and filter area | You can select different administration objects such as Dataphin Table, Datasource Table, Datasource, Metric, Real-time Meta Table, Tag to view remediation process details. You can also perform a fuzzy search based on the name of the remediation process or perform precise filtering based on Remediated By Me, Validated By Me, Not Validated, Priority, Remediation Status, Remediate By, Validated By. |
②List area | Displays information such as Remediation Process Name, Number Of Issues, Remediate By, Validated By, Priority, Remediation Status, Start At, Completion Time. You can also click View Remediation Details in the Actions column to view specific information about the remediation and perform different operations based on different administration statuses. For details, see Remediation process details. |
Remediation process details
View remediation process
Area | Description |
①Basic information area | Displays information such as Remediate By, Validated By. When the remediation status is In Remediation or Re-remediation, you can click the Initiate Acceptance button, fill in the remediation reason, submit the remediation result, and wait for the acceptance owner to perform acceptance. When the remediation status is Pending Acceptance, determine whether to pass acceptance based on the actual remediation situation. |
②Filter and search area | You can perform a fuzzy search based on the name of the remediation object or rule, or perform precise filtering based on rule strength, verification result, issue status, whether to ignore the abnormality, issue type, and proposal method. |
③Remediation details list | Displays information such as remediation object, verification object, rule name/ID, issue status, issue type, issue description, latest verification result, rule strength, verification scope, verification time, proposal method/proposer, and related knowledge base document information. Related Knowledge Base Document: Click View Details to view the knowledge base information associated with the rule. This includes table name, verification object, rule, and related knowledge base document information. You can also perform search, view, edit, and delete operations on the knowledge base. For operation details, see View knowledge base. |
Manage remediation process
Individual Operations
You can execute various operations on the remediation object depending on the issue status. For more information, see Individual Operations.
Remediation process status | Issue status | Operations |
Pending Acceptance | To Be Processed | Supports viewing details, ignoring this abnormality, canceling ignore, marking as processed, returning for reprocessing, associating knowledge base document, viewing operation record |
Ignored, Processed | Supports viewing details, returning for reprocessing, associating knowledge base document, viewing operation record. | |
In Remediation | To Be Processed | Supports viewing details, ignoring this abnormality, re-verifying, associating knowledge base document. |
In Verification | Supports viewing details, associating knowledge base document. | |
Ignored | Supports viewing details, canceling ignore, re-verifying, associating knowledge base document. | |
Acceptance Passed | Processed | Supports viewing details, associating knowledge base document. |
Batch Operations
You can carry out batch operations on the remediation object, such as Ignore This Abnormality, Cancel Ignore, Re-verify, Mark As Processed, Return For Reprocessing, Associate Knowledge Base Document. For details, see Batch Operations.
Remediation records
Remediation records provide a log of actions taken during the remediation process, including the type of operation, post-operation status, operator, time of action, and a description of the operation.