Use DataWorks and EMR together for big data development and analysis. A user persona analysis case demonstrates DataWorks capabilities in Data Integration, Data Studio, and Operation Center.
Case description
To refine business strategies, you need basic profile data of website user groups, such as geographic and social attributes, derived from user behavior on the website. This enables scheduled persona analysis and fine-grained traffic operations. DataWorks and EMR together support the full workflow: data synchronization, processing, management, and consumption.
Before you begin, read Tutorial objectives and design for a workflow overview.
Data development platform
This tutorial uses the DataWorks legacy Data Studio (DataStudio) platform. Ensure that your workspace does not have Use the New Data Studio enabled.
-
When you create a workspace, do not select the Use Data Studio (New Version) option.
-
After February 18, 2025, when an Alibaba Cloud account activates DataWorks for the first time and creates a workspace in the following regions, the new Data Studio is enabled by default. If the new Data Studio is enabled by default in your workspace, see Get started with the new Data Studio for the corresponding tutorial.
China (Hangzhou), China (Shanghai), China (Beijing), China (Zhangjiakou), China (Ulanqab), China (Shenzhen), China (Chengdu), China (Hong Kong), Japan (Tokyo), Singapore, Malaysia (Kuala Lumpur), Indonesia (Jakarta), Thailand (Bangkok), Germany (Frankfurt), UK (London), US (Silicon Valley), US (Virginia)
Procedure
-
Create the EMR cluster and DataWorks workspace required for this tutorial, and complete the related resource group network configuration.
-
In DataWorks, configure a data synchronization pipeline to sync the user information and website log data provided by this tutorial to OSS. Then create an EMR external table to parse the data stored in OSS, sync the data to the associated EMR compute resource, and query the synchronized data.
-
Use an EMR Hive node in DataWorks to process the data in the user information table and the access log table that are synced to EMR, and produce the target user persona data.
-
Configure data quality monitoring
Configure data quality monitoring for the tables generated during data processing to detect and block dirty data early, preventing its impact from spreading.
-
After the user persona analysis task flow is complete, the corresponding data tables are created in EMR. You can view the lineage between data tables in Data Map.
-
Consume data
After the user persona analysis is complete, use the Data Analysis module to Data visualization the processed data, so that you can quickly extract key information and gain insights into the business trends behind the data.