In this tutorial, you use MaxCompute and DataWorks to perform extract, transform, and load (ETL) on business and log data from an e-commerce scenario. You then synchronize the processed data to AnalyticDB for MySQL for real-time analysis and use Quick BI to create interactive visualizations and user personas.
Services used
-
MaxCompute: Large-scale distributed data computing.
-
AnalyticDB for MySQL: Real-time, high-concurrency online analysis of massive data.
-
DataWorks: ETL pipeline to collect, transform, and analyze complex datasets.
-
Quick BI: Report creation and visual display of analysis results.
Scenarios
This solution applies to business intelligence (BI) analysis in the following scenarios:
-
Websites, apps, and mini apps in industries such as the internet, e-commerce, and gaming.
-
BI reporting across a variety of website types.
Solution overview
The following steps describe the end-to-end flow for big data BI analysis using MaxCompute:
-
Use data integration to synchronize business and log data to MaxCompute.
-
Use MaxCompute and DataWorks to perform ETL on the data.
-
Synchronize the processed data to AnalyticDB for MySQL.
-
Use Quick BI to create and visualize user personas.
Benefits
-
Fast, real-time analysis: The combination of AnalyticDB for MySQL and Quick BI provides fast, real-time data analysis. This solution also simplifies the synchronization of business and log data to Alibaba Cloud analytic databases.
-
Broad ecosystem integration: This solution integrates with the Alibaba Cloud Simple Log Service ecosystem and seamlessly connects with products such as Blink, Elasticsearch, AnalyticDB for MySQL, E-MapReduce, and DataV to enhance the user experience.
-
Lower barrier to big data platforms: The powerful data transformation and analysis capabilities of MaxCompute and AnalyticDB for MySQL lower the barrier to building big data platforms and make it easy to handle massive data computation. This solution also reduces enterprise costs and ensures data security.
-
Open source compatibility: This solution seamlessly integrates with third-party open source ecosystems. Logs can be sent to Simple Log Service without modifying user applications, which lowers the barrier to entry.
Solution details
For detailed implementation steps and configuration guidance, see Big Data BI Analysis Based on MaxCompute.