Alibaba Cloud Data Lake
Alibaba Cloud Data Lake allows you to store, manage, and analyze massive structured, semi-structured, and unstructured streaming data, enabling you to break down data silos and gain business insights. You can store data of all sizes and formats as-is, configure rules throughout the data lifecycle to flexibly store hot and cold data in response to changing business requirements, and seamlessly integrate your data lake with different computing and AI engines (such as MaxCompute, Hologres, DataBricks, Platform for AI, etc.) for unified batch and stream processing.
-
Limit-Free Storage
Unified data storage with unlimited scalability integrates on-premises and cloud data with low cost and no O&M.
-
Centralized Management
Centralized metadata services with high compatibility for data storage formats enable unified data governance and support for different compute engines.
-
Cloud-Native
Containerized compute empowers hyper-scale elasticity and near-real-time data analysis by streaming data to the data lake.
Power up with Alibaba Cloud Data Lake
-
![]()
Fully-Managed Data Lake
Reduce the burden of O&M workload and facilitate data development and management on a fully-managed Serverless architecture that features multiple data analysis scenarios
-
![]()
Unified Batch and Stream Processing
Unify real-time data processing and offline (batch) processing in one programming model, replacing the operational complexity of code with accuracy, consistency, and high performance
-
![]()
One-Stop Data Management
Complete data integration, development, catalog, and security and service management for data of all types and sizes in a data lake with 99.9999999999% (12 9's) durability, and backed by industry-leading SLA
-
![]()
Elastic Data Processing Resources
Create and scale compute nodes in/out dynamically for the processing requirements of Flink on Alibaba Cloud E-MapReduce that decouples compute and storage resources and supports multiple open-source compute engines
Learn more about Data Lake on Alibaba Cloud
Contact SalesHow It Works
Alibaba Cloud Data Lake is based on a cohesively layered architecture. Each layer features a range of products and tools designed to integrate, store, and process data.
-
Data Lake Storage Layer: ingests raw data of all types in a scalable and secure storage, with corresponding storage classes to store hot and cold data for different access requirements
Data Lake Formation Layer: Builds a cloud-native data lake that supports batch and stream data processing by centralizing the metadata from different data sources throughout the data lifecycle, with enterprise-level permission control.
Data Lake Computing Layer: Seamlessly connects to a variety of computing engines and AI platforms to execute user queries, perform advanced data analysis, and derive business insights from managed data
Data Development and Governance Layer: Provides efficient, secure and reliable data development and governance services based on data computing engines
Alibaba Cloud Data Lake Architecture in Four Layers
Data Lake Storage
Alibaba Cloud Object Storage Service (OSS) provides industry-leading scalability, durability, and performance. You can store and protect any amount of data on it with 99.9999999999% (12 9's) durability as the scalable, secure, and cost-effective storage foundation for your data lake. You can easily ingest data from IoT devices, on-premises, and cloud environments into your data lake and configure data lifecycle rules to store hot and cold data in different storage classes based on data access requirements and costs. You can also leverage JindoFS to cache hot data and accelerate data access through the HDSF interface for data analytics frameworks (such as Apache Spark, Apache Hive, Presto, and TensorFlow).
Learn More >
Data Lake Formation
Data Lake Formation (DLF) is a key component of the cloud-native data lake framework and provides an easy way to build a cloud-native data lake. DLF seamlessly integrates with a variety of compute engines. It allows you to manage data lake metadata in a centralized manner and control enterprise-class permissions. It features an architecture that separates computing from storage, so you can plan resources on demand at low costs and improve data processing efficiency. You can connect it to different types of data computing and analytics platforms to gain insight into business value and use JindoFS to accelerate data lake analytics with high performance.
Learn More >
Data Lake Computing
Alibaba Cloud provides a variety of data computing engines to fulfill various data processing needs. Elastic MapReduce (EMR) allows you to use the Hadoop and Spark ecosystem components (such as Apache Hive, Apache Kafka, Flink, Druid, and TensorFlow) to analyze and process data stored on different Alibaba Cloud data storage services, including Object Storage Service (OSS), Log Service (SLS) and Relational Database Service (RDS). MaxCompute supports different data lake formats (such as Delta Lake and Hudi). You can connect it to different data sources to enable effective queries on massive datasets. Hologres seamlessly connects to Data Lake Formation to read metadata and data in real-time and analyzes PB-scale data with high concurrency and low latency. You can perform data mining and analysis to support intelligent business services by connecting Platform for AI to these data engines.
Data Development and Governance
DataWorks is a turnkey platform that provides professional, efficient, secure, and reliable big data development and governance services based on big data compute engines (such as MaxCompute, E-MapReduce (EMR), and Hologres). DataWorks integrates the best practices of Alibaba data mid-end and data governance to help schedule, run, and monitor a large amount of tasks in different types (such as data integration, machine learning, and MaxCompute SQL) and process hundreds of PB of data every day with high stability. You can drag and drop to customize your data workflow and get visualized information on data development.
Start for Free and Enjoy 60% in Renewal Discounts
Try 50+ free tier products and enjoy a 60% renewal discount after concluding the free trial
Security and Compliance
-
CSA STAR -
ISO 27001 -
SOC2 Type II Report -
C5 -
MLPS 2.0 -
MTCS
Related Resources
Blog
Data Lake Is Becoming the Innovation Standard
for Enterprise Data Applications
This short article discusses the rise and future of data lakes as a standard practice.
Blog
An Overview of Alibaba Cloud's Comprehensive Cloud-Native Data Lake System
This article introduces the establishment of a cloud-native data lake system based on Alibaba Cloud products.
Blog
Construction, Analysis, and Development Governance of a Cloud-Native Data Lake
This article introduces the best practices and cases for building, analyzing, developing, and governing cloud-native data lakes.
Video
Cloud-Native Data Lake: Driving Agile Enterprise Innovation
This video introduces the challenges and advantages of data lakes and how Alibaba Cloud can help build your data lake to power enterprise innovation.
Video
Build a Unified, Secure, and Intelligent Data Lake Governance System
This video introduces how to leverage Alibaba Cloud solutions and services to build a unified, secure, and intelligent data lake governance system.
Video
Data Lake Storage: The Power Source of Innovation
This video introduces how Alibaba Cloud Data Lake solution supports innovation in enterprises.
