如果系統提供的指標類型無法滿足需求,您可以使用自訂指標規則。
定義自訂指標規則
在assertion中使用一個自訂的指標名稱,同時在規則配置中,添加這個自訂指標名稱的配置,在配置值中給出自訂指標的SQL查詢語句。樣本如下:
datasets:
- type: Table
tables:
- tb_d_spec_demo
filter: "dt='$[yyyymmdd]' AND hh='$[hh24-1/24]'"
dataSource:
name: odps_first
envType: Dev
rules:
- assertion: "avg_order_span between 5 and 10"
avg_order_span:
query: "SELECT COUNT(safety_stock_level - days_to_manufacture) FROM dim_product;"保留問題資料
可以為自訂指標規則添加保留問題資料的設定,除了開啟collectFailedRows外,還需要添加failedRowsQuery正常執行問題資料保留動作。
datasets:
- type: Table
tables:
- tb_d_spec_demo
filter: "dt='$[yyyymmdd]' AND hh='$[hh24-1/24]'"
dataSource:
name: odps_first
envType: Dev
rules:
- assertion: "id_for_belgium between 5 and 10"
id_for_belgium:
query: "SELECT count(*) FROM product_b;"
collectFailedRows: true
failedRowsQuery: "SELECT id FROM product_b WHERE id IS NULL"