Publish objects from an imported deployment package - Dataphin - Alibaba Cloud - Dataphin

Prerequisites

A deployment package file from the source environment has been imported into the target environment. For more information, see Import a deployment package.

Notes

To ensure production data security and prevent failures from incorrect object dependencies, the system enters a maintenance state during object publishing to block concurrent operations. After publishing is complete, a system administrator or super administrator must manually exit the maintenance state before other users can resume normal operations.
If an object in the deployment package has the same version as the corresponding object in the current environment, it does not need to be published. However, this object is still counted in the total number of objects on the overview page.

Note

Dataphin V3.11 supports exporting historical objects created before Dataphin V3.9 and publishing them to other tenants.

Permissions

Only users with the cross-tenant publishing user role can access and manage objects that are waiting to be published.

Access the deployment package overview

Log on to Dataphin with a cross-tenant publishing user account.
On the Dataphin homepage, from the top menu bar, select Management Center > Cross-tenant Publish.
In the navigation pane on the left, choose Migration > Import Deployment Package.
In the Actions column of the target deployment package, click the publish icon.

Deployment package overview

The deployment package overview page compares the imported package with the current environment and displays changed objects with their publishing status: To be published, Publishing, Succeeded, Failed, or Succeeded with risks. You can publish and manage objects by functional module: Global, Data Architecture, Development, Tag Architecture, Tag, Data Standard, Data Quality, and Data Security.

Note

The deployment package overview page shows only the objects that need to be published. Objects in the package that have the same version as their counterparts in the current environment are ignored.

Area

Description

① Operations area

Supports the following operations: Modify Publish Settings, Reparse, One-click Publish, and Refresh.

Modify Publish Settings: Publishing settings must be configured before you can publish objects. If settings change, click Modify Publish Settings to update them on the import settings page.
Reparse: Compares objects in the deployment package with the current environment. Objects with matching versions do not need to be published. Objects with different versions, or those that are new or marked for deletion, are set to To be published. If the corresponding object version in the current environment has changed, reparsing may yield a different status.
One-click Publish: The system publishes the objects sequentially. During the process, you can click Stop Publish.

During a one-click publish, if no strong dependencies exist between objects, they are published in the order they appear on the page. The failure of an object in a previous stage does not interrupt the publishing process. For the recommended publishing order, see Recommended publishing order.

When you stop publishing, only modules that are not being published are stopped. Modules that are currently being published continue, and already complete modules are not rolled back. If you restart after stopping, the system republishes failed objects and objects that were still waiting.
Note
- Before you use one-click publish, you must complete the publish settings. Otherwise, the one-click publish cannot proceed.
- During a one-click publish, if compute engines are included, the system uses the configuration from the source environment to publish them. If data sources are included, the system applies the replacement rules before publishing. If object information is insufficient, such as missing connection details, authentication details, or files, the publishing will fail.
- To avoid potential data loss when compute engine information is the same in both tenants, first publish the compute engines and data sources. After that is complete, perform the one-click publish.
Refresh: Refreshes the list of objects to be published.

② Publish Object List

Objects are grouped into functional modules, each displayed as a card showing the module's publishing status and object details.

Status: A status icon on each card indicates the publishing status of the module.
- : The module is waiting to be published.
- : The module contains objects that failed to publish.
- : The module is being published.
- : All objects in the module were published successfully.
Object information: The total number of objects (excluding objects that do not need to be published) and the number of objects in each publishing status: To be published, Publishing, Succeeded, Succeeded with risks, and Failed.
View Details: If a functional module contains changed objects, click the icon on its card to view the details.

Change types

When you import a deployment package, the system automatically identifies and marks each object's change type. The change types are Add, Update, and Delete.

Add: If an object in the imported package does not exist in the target environment, its change type is Add. When you publish this type of object, it will be added to the target environment.
Update: If an object in the imported package already exists in the target environment but has a different version, its change type is Update. When you publish this type of object, it will overwrite the corresponding object in the target environment.
Delete: If the imported package does not contain an object that exists in the target environment, its change type is Delete. When you publish this type of object, the corresponding object will be deleted from the target environment.

Permissions for publishing objects

To publish objects to a production or development environment, the cross-tenant publishing user must have the required publish permissions for the corresponding object types. The following table lists the required permissions:

Object to publish	Subtype	Permissions required
Global	Statistic period Global variable Public calendar Object property Identification feature	Requires a cross-tenant publishing user with the super administrator or system administrator role.
	Data block	Requires a cross-tenant publishing user with the super administrator or system administrator role, or a data block architect for the corresponding block.
	Compute engine	Requires a cross-tenant publishing user who also has one of the following roles or permissions: super administrator, system administrator, data block architect for the block that is bound to the compute engine, or compute engine owner.
	Project	Requires a cross-tenant publishing user who also has one of the following roles or permissions: super administrator, system administrator, data block architect for the block that is bound to the compute engine, or project owner.
	Data source	Requires a cross-tenant publishing user with the data source administrator or data source owner role.
Data architecture	Business object Business activity Subject area	Requires a cross-tenant publishing user with the super administrator or system administrator role, or a data block architect for the corresponding block.
Development object	Integration Tasks Modeling development Metric development File management Compute Task Offline physical table	Requires a cross-tenant publishing user with super administrator permissions. Alternatively, the user must be a cross-tenant publishing user and a member of the project that contains the object, and have submit permissions for Dev or Basic projects or publish permissions for Prod projects.
Tag architecture Tag	Tag entity Tag entity ID Workbench object	Requires a cross-tenant publishing user with the super administrator or system administrator role.
Data standard	Lookup table folder Data standard set folder Public standard property Standard template Data standard set Data standard Mapping rule Mapping relationship (asset granularity) Lookup table Root	Requires a cross-tenant publishing user with the super administrator or system administrator role.
Data quality	Quality rule template Quality rule (object granularity)	Requires a cross-tenant publishing user with the super administrator or system administrator role.
Data security	Data categorization Data classification Identification result (table granularity) Key	Requires a cross-tenant publishing user with the super administrator or system administrator role.

Recommended publishing order

Publish objects in the following order based on their dependencies.

Global (Compute engine -> Data source -> Statistic period -> Global variable -> Public calendar -> Object property -> Python third-party package -> Data block -> Project -> Identification feature)
Data architecture (Subject area -> Business activity -> Business object)
Data security (Key -> Data categorization -> Data classification -> Identification feature)
Data standard (Lookup table folder -> Lookup table -> Root -> Data standard set folder -> Data standard set -> Public standard property -> Standard template)
Data quality (Rule template)
Standard (Data standard -> Mapping rule)
Development (Offline physical table -> Node)
Tag architecture (Tag entity -> Tag entity ID)
Tag (Workbench object)
Data quality (Quality rule)
Data standard (Mapping relationship)
Data security (Identification result)