DataWorks provides end-to-end data development and governance capabilities through a unified workflow. You can also customize this workflow by implementing process controls at key stages to meet your specific business needs. This topic describes the process management capabilities that DataWorks offers for data development.
Limitations
This feature is available only in DataWorks Enterprise Edition and later editions.
Overview
DataWorks workspaces are available in standard mode and basic mode. The node development process varies based on the workspace mode. The following figures show the data development workflows for both modes.
-
Node development process in a standard mode workspace
-
Node development process in a basic mode workspace
As shown in the figures, you can implement process controls at key stages of the workflow, such as before a node is run for debugging, before a node is committed, and before a node is deployed.
|
Pre-run check |
Pre-commit check |
Pre-deployment check |
|
|
|
|
You can use DataWorks feature modules, such as Open Platform and Data Governance Center, to implement checks and controls at key stages of the data development workflow.
|
Feature module |
Pre-run check |
Pre-commit check |
Pre-deployment check |
Description |
|
Data Governance Center |
|
|
|
Data Governance Center provides multiple built-in check items. You can enable these items based on your business requirements. When a related operation is performed, DataWorks triggers the corresponding built-in validation logic. The workflow proceeds only if the check passes. |
|
Open Platform |
|
|
|
If the built-in check items cannot meet your process management requirements, you can use Open Platform to develop custom check programs for specific events and integrate them into your data development workflow. |
The following sections describe these process management capabilities at key stages, using the development workflow in a standard mode workspace as an example.
Built-in check items: Data Governance Center
Data Governance Center provides multiple built-in check items. You can enable these items based on your business requirements. When a related operation is performed, DataWorks triggers the corresponding built-in validation logic to check the operation. The workflow proceeds only if the check passes.
|
Item |
Description |
|
DataWorks feature module |
Data Governance Center Data Governance Center provides multiple built-in check items. You can enable these items to check operations.
|
|
Configuration and guidance |
You need to enable check items in Data Governance Center and specify the workspace in which they take effect. For general instructions, see Configure governance items. |
Custom check logic: Open Platform
If the built-in check items do not meet your process management requirements, you can use Open Platform to develop custom check programs for specific events and integrate them into your data development workflow. This lets you implement custom validation logic at key stages of the process.
|
Item |
Description |
|
DataWorks feature module |
Open Platform Open Platform provides features such as OpenEvent, Extensions, and API operations. You can use OpenEvent to subscribe to event messages for user operations in DataStudio. After an event message is received, you can use Extensions to create a custom check and approval program. The program then sends the results back to DataWorks through an API call. For more information about OpenEvent and Extensions, see OpenEvent overview and Extensions overview. |
|
Check workflow |
If you use Open Platform to subscribe to and check events for key operations in DataStudio, the user's action triggers a check workflow. The following figure shows the check workflow for pre-run control as an example. |
|
Configuration and guidance |
You need to subscribe to events from DataStudio in Open Platform, develop an extension to process the events, and deploy the extension to DataWorks. Then, specify the workspace in which to enable the extension.
For more information about the event types that you can subscribe to and manage in Open Platform, see Extensions overview.
|
