New Features

E-MapReduce - Supports EMR Remote Shuffle Service

Jan 05 2021

Alibaba Cloud E-MapReduce (EMR) supports EMR Remote Shuffle Service (ESS).

Target customers: head companies in the digital marketing, online education, and Internet entertainment fields. Features released: EMR now supports ESS. It is an extension to optimize the shuffle operations of computing engines. ESS uses push-style shuffle, instead of pull-style shuffle, to reduce the memory pressure caused by mappers. ESS supports I/O aggregation, reduces the number of connections in a shuffle read task from M × N to N, and converts random read to sequential read. ESS uses a two-replica mechanism to reduce the probability of fetch failures. ESS allows the shuffle service to be deployed in a separated hardware environment to support compute-storage separation. ESS eliminates the dependency on local disks when Spark on Kubernetes is used.

7th Gen ECS Is Now Available

Increase instance computing power by up to 40% and Fully equipped with TPM chips.
Powered by Third-generation Intel® Xeon® Scalable processors (Ice Lake).

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.