Document Center
DataWorks
Update Records
Release notes of key features
Version history
DataWorks V2.0
DataWorks V3.0
Change history
Product Introduction
What is DataWorks?
Concepts
Scenarios
Data development process
Basic mode and standard mode
Pricing
Purchase guide
Billing
View spending details
Pay-as-you-go
Subscription (pre-payment)
DataWorks exclusive resources
DataWorks resource plans
DataWorks advanced editions
Appendix
DataWorks resource groups
Feature comparison among DataWorks editions
Function downgrades of DataWorks advanced editions upon expiration
Performance metrics and billing standards of exclusive resource groups for Data Integration
Performance metrics and billing standards of exclusive resource groups for scheduling
DataWorks billing details in pay-as-you-go mode
Preparation
Administrator Operations
Prepare an Alibaba Cloud account
Prepare a RAM user
Create a workspace
Add workspace members
Work as a workspace administrator
Use a RAM user
Quick Start
Overview
Create tables and import data
Create a workflow
Create a batch synchronization node
Configure recurrence and dependencies for a node
Run a node and troubleshoot errors
Optional: Use an ad hoc query node to run SQL statements
Tutorials
Workshop
Overview
Prepare the environment
Collect data
Process data
Monitor data quality
Visualize data on a dashboard
Use Function Studio to develop a UDF
DataWorks for EMR Workshop
Prepare the environment
Collect data
Process data
Collect and view metadata
Monitor data quality
Build and optimize a data warehouse
Overall process
Business survey
Determine requirements
Analyze business processes
Divide data domains
Define dimensions and build a bus matrix
Specify statistical metrics
Architecture and model design
Select a technical architecture
Divide a data warehouse into layers
Design a data model
Specify the principles for using data at different layers
Project allocation and security
Performance benchmark establishment
Data warehouse performance optimization
Result verification
Build an online operation analysis platform
Business scenario and development process
Prepare the environment
Prepare data
Build data models and analyze data
Create tables
Design workflows
Configure nodes
Commit and test nodes
Display data on dashboards
Guarantee data quality
Overview
Data quality management process
Classify data
Verify data during data generation
Use Data Quality to monitor data accuracy, consistency, and integrity
Use Monitor to monitor data timeliness
Workbench
DataWorks console overview
Workspace list
Resource group list
Add and use exclusive resource groups for scheduling
O&M Assistant
Add a route
Exclusive resource mode
Compute engine list
MaxCompute Management
Workspace management
Configure a workspace
Manage workspace members
Permission list
Configure MaxCompute
Manage connections
Upgrade the workspace mode
Data Aggregation
Overview
Homepage
Common configurations
Test data store connectivity
Configure a whitelist
Configure a security group
Batch data synchronization
Connections
Supported data stores and plug-ins
Connection isolation
Node configuration
Create a sync node by using the codeless UI
Create a sync node by using the code editor
Synchronize incremental data
Migrate databases to MaxCompute
Rules and restrictions
Migrate a MySQL database
Migrate an Oracle database
Migrate multiple tables to the cloud at a time
Migrate multiple tables to the cloud at a time
Add multiple connections at a time
Real-time synchronization
Create, commit, and manage real-time sync nodes
Supported data stores
Fields used for real-time synchronization
Reader
MySQL binlog reader
Oracle CDC reader
Datahub reader
LogHub reader
Kafka reader
ApsaraDB for POLARDB reader
Writer
MaxCompute writer
Hologres writer
Datahub writer
Kafka writer
Transformation
Data filtering
Groovy
String replacement
Sync solutions
Node optimization
Optimize synchronization performance
Optimize a sync node
Resource groups
Overview
Use the default resource group
Use exclusive resource groups for data integration
Add a custom resource group
Appendixes
Connection configuration
Reader configuration
Writer configuration
Data Development
Solution
SQL coding guidelines and specifications
GUI elements
Overview
Workflow Parameters
Lineage
Versions
Code Structure
Workflow
Overview
Node group
Node types
Data Integration
Batch Sync node
MaxCompute
ODPS SQL node
SQL script template
ODPS Spark node
PyODPS node
ODPS Script node
ODPS MR node
Table
Resource
Function
AnalyticDB for PostgreSQL
AnalyticDB for PostgreSQL node
Table
E-MapReduce
EMR Presto node
EMR HIVE node
EMR MR node
EMR SPARK SQL node
EMR SPARK node
Algorithm
Machine Learning experiment node
General
Assignment node
for-each node
Zero-load node
Shell node
Branch node
OSS Object Inspection node
MERGE node
do-while node
Cross-tenant collaboration node
Custom nodes
Data Lake Analytics node
Hologres node
Create AnalyticDB for MySQL nodes
MaxCompute
MaxCompute modules
MaxCompute functions
MaxCompute resources
Schedule
Basic attributes
Scheduling parameters
Scheduling properties
Dependencies
Configure the resource group
Immediate instance generation
Cross-cycle dependencies
Context-based parameters
Logic of scheduling dependencies
Script template management
Create a script template
Use a script template
Ad hoc query
Workspace tables
Runtime logs
Manually triggered workflow
Table
Functions
Recycle bin
Setup
Setup
Configuration center
Workspace settings
Template management
Folder management
Level management
Workspace backup and restoration
Editor shortcuts
External table
Custom node type
Overview of custom node types
Create a custom node type
Create a wrapper
Data Application Development
Features
Navigation page
Project management
Version control
Code editing
Debugging
Collaborative coding
App deployment
Access third-party services
WYSIWYG designer
Overview
Version history
Get started
DataService Studio
DataService studio overview
Introduction
Use workflows
Data Filter
Use filters
Generate API
Configure the Data Source
Generate API in Wizard Mode
Generate API in Script Mode
Register API
API service test
Publish an API
Call an API
DataAnalysis
Overview
Workbook
Edit a workbook
Create a workbook
Dimension table
Create a dimension table
Edit a dimension table
Report
Edit a report
Create a report
Charts
Area charts
Pie charts
Horizontal bar charts
Scatter charts
Column charts
Line charts
Task Operation
Operation Center
Overview
Dashboard
Auto triggered node O&M
Auto triggered nodes
Retroactive instances
Auto triggered node instances
Instance diagnosis
Test instances
Manually triggered node O&M
Manually triggered nodes
Manually triggered node instances
Monitor
Overview
Features
Instructions
Publish nodes
Deploy a node
Delete a node
Cross-workspace cloning
Overview
Clone nodes across workspaces
Data governance
Data Guard
Data Guard overview
Quick start
My Permissions
Authorizations
Approval Center
Data quality
Overview
Go to the Overview page
View my subscriptions
Configure monitoring rules
View monitoring results
Manage templates
Manage report templates
Manage rule templates
User manual
Configure monitoring rules for Datahub
Configure monitoring rules for MaxCompute
Built-in rule templates for offline data
Data security guard
Access Data Security Guard
Data distribution
Access analysis
Data risks
Audit
Rule setting
Customize desensitization rules
Classification management
Manual ajust
Manage risk rules
Data Map
Overview
View the overall information
Manage data
Manage configurations
Table details
View table details
Apply for table permissions
Add a table to favorites
Go to DataService Studio to create API operations
Data discovery
Collect metadata from an E-MapReduce data store
Collect metadata from a MySQL data store
Collect metadata from an SQL Server data store
Collect metadata from a PostgreSQL data store
Collect metadata from an Oracle data store
Collect metadata from an AnalyticDB for PostgreSQL data store
Collect metadata from an AnalyticDB for MySQL 2.0 data store
Collect metadata from an AnalyticDB for MySQL 3.0 data store
Collect metadata from an OSS data store
Requirements Management
Overview
Create a requirement
Search for a requirement
Manage a requirement
Best practices
Best Practices
Data migration
Best practices of migrating data from Hadoop to MaxCompute
Migrate JSON data from OSS to MaxCompute
Migrate JSON data from MongoDB to MaxCompute
Add a relational database driver for RDBMS Reader
Use Data Integration to import data to Elasticsearch
Migrate data from a user-created MySQL database on an ECS instance to MaxCompute
Use Data Integration to import data to DataHub
Use Data Integration to ship data collected by LogHub to destinations
Migrate data from Oracle to MaxCompute
Automatically synchronize IoT data to the cloud
Data development
Best practices for setting scheduling dependencies
Use MaxCompute to analyze IP sources
Reference a third-party package in a PyODPS node
Performing a task at a specific time with branch node
Connect DataV to DataWorks DataService Studio
Use a PyODPS node to segment Chinese text based on Jieba
Build a data warehouse for an enterprise based on AnalyticDB for MySQL
Use a PyODPS node to send emails
Data security
Grant access to a specific UDF to a specified user
Log on to DataWorks through a specific IP address with a RAM user
Data analysis
Use MaxCompute to analyze data and Quick BI to present the analysis results
Analyze offline data in the Internet and e-commerce industries
Intelligently recommend items on e-commerce websites
FAQ
Data Integration
Batch synchronization
Custom resource groups
Exclusive resource groups
Scheduling parameters
Scheduling properties
Dependencies
Data Analytics
Monitor
DataService Studio
Security Center
App Studio
Stream Studio
Videos
API
SDK
Install the Alibaba Cloud SDK for Java
All Products
Search
Document Center
DataWorks
Data Aggregation
Appendixes
Connection configuration
This Product
This Product
All Products
DataWorks
Configure an AnalyticDB for MySQL 2.0 connection
Configure an SQL Server connection
Configure a MongoDB connection
Configure a Datahub connection
Configure a DM connection
Configure a DRDS connection
Configure an FTP connection
Configure an HDFS connection
Configure a LogHub connection
Configure a Memcache connection
Configure a MySQL connection
Configure an Oracle connection
Configure an OSS connection
Configure a Table Store connection
Configure a PostgreSQL connection
Configure a Redis connection
Configure a HybridDB for MySQL connection
Configure an AnalyticDB for PostgreSQL Connection
Configure a POLARDB connection
Configure an AnalyticDB for MySQL 3.0 connection
Configure a DLA connection
Configure a MaxCompute connection
Configure a GDB connection
Configure a GBase 8a connection
Configure a Hologres connection
Configure an HBase connection
Configure an ApsaraDB for OceanBase connection
Configure a Vertica connection
Configure a Hive connection
Free Trial
Free Trial