This topic describes how to configure rules to monitor the data quality of the ods_log_info_d table.
Prerequisites
Procedure
- Go to the DataStudio page.
- Log on to the DataWorks console.
- In the left-side navigation pane, click Workspaces.
- In the top navigation bar, select the region where your workspace resides, find the workspace, and then click Data Analytics in the Actions column.
- Go to the Monitoring Rules page of the ods_log_info_d table.
- Click the
icon in the upper-left corner and choose .
- In the left-side navigation pane, click Monitoring Rules. Select EMR from the Engine/Data Source drop-down list.
- Find the ods_log_info_d table and click View Monitoring Rules.
- Click the
- Add a partition filter expression.
- Click + in the Partition Expression section.
- In the Add Partition dialog box, set the Partition Expression parameter to dt=$[yyyymmdd-1] and select the corresponding data quality wrapper.
- Click Verify to view the scheduling result.
- Verify that the scheduling result is correct and click OK.
- Create a monitoring rule.
- Test the monitoring rule.
- Click Test in the upper-right corner of the page.
- In the Test dialog box, set the Data Timestamp and Resource Group parameters and click Test.
- After the test is completed, click The test is complete. Click to view the results to go to the page of the test results.
- Link the monitoring rule to nodes.
- On the Monitoring Rules page of the ods_log_info_d table, click Manage Linked Nodes.
- In the Manage Linked Nodes dialog box, enter the IDs or names of the nodes and click Create.
- After the nodes are added, the monitoring rule is linked to the nodes. Verify that Data Quality checks the data quality of a node instance after the instance is run.
- Configure subscriptions.