Alluxio is an open source data orchestration technology for cloud-based data analytics and artificial intelligence. Alluxio builds a bridge between data-driven applications and storage systems. It moves data from the storage layer closer to data-driven applications for easier data access. It also allows applications to connect to multiple storage systems through a common interface.
Background information
In the big data ecosystem, Alluxio sits between data-driven frameworks or applications, such as Apache Spark, Presto, TensorFlow, Apache Flink, and Apache Hive, and various persistent storage systems, such as HDFS and Alibaba Cloud OSS. This allows upper-layer computing applications to access persistent storage systems, including HDFS and OSS, through a unified client API and a global namespace.
Benefits
Provides memory-level I/O throughput and reduces the cost overhead of elastically scaling data-driven applications.
Simplifies access to cloud storage and Object Storage Service.
Simplifies data management and provides single-point access to multiple data sources.
Simplifies application deployment.
For more information, see Alluxio.