Alibaba is deploying Alibaba Open Channel SSD as part of its next generation data center infrastructure, marking a major milestone after its announcement of Open Channel storage architecture in FAST 2018 conference.
Alibaba Open Channel SSD, or AOC SSD, is Alibaba's 3rd homebrew storage product and the first productionized Open Channel SSD in the industry. Its deployment not only marks a key step of Alibaba's next-generation storage architecture, but also lays ground for an innovative Open Channel ecosystem.
In FAST 2018 conference held in February, Alibaba presented a software/hardware integrated storage architecture for its next-generation data centers. The new architecture is designed to tackle new challenges for data centers as the proliferation of AI, Cloud Computing and Big Data applications. Some challenges include:
Neither traditional standard SSDs nor proprietary host-based SSDs addresses these challenges efficiently. Therefore, Alibaba proposed a new software/hardware integrated storage architecture for next-generation data centers, with the core being Alibaba Open Channel SSD along with Fusion Engine storage engine software on top.
Alibaba's Software/Hardware Integrated Storage Architecture
As the core hardware of Alibaba's new storage architecture, AOC SSD not only delivers a white-box design and ability for customization, but also a standardized platform. The AOC SSD Specification that defines the AOC SSD platform is written by Alibaba based on its business needs and use cases, and has no affiliation with the "Open Channel Spec 1.2/2.0" from other companies.
AOC SSD architecture is designed with idea of openness and collaboration. Alibaba has been trying to build an AOC SSD ecosystem along with vendors and industry partners. The goal is to reduce time and complexity of product qualification, improve supply elasticity, so that all participants can benefit from the collaboration.
At the heart of AOC SSD is AliFSC, Alibaba's first customized high-performance storage controller.
AliFSC Storage Controller
AliFSC is a high-performance controller customized for Alibaba's Open Channel SSD requirements. It features 6 cores and 16 channels design, PCIe G3x8 interface, and can work with all major 3D TLC NAND components. Support for QLC NAND is also included, with preliminary QLC firmware development already started.
AliFSC supports all commands specified by AOC SSD specifications and provides hardware accelerations -- commands include system metadata (MBR) management, flexible parity groups, XOR engines, multiple write streams, as well as program/erase failure handling in Open Channel mode.
First productionized in industry, the AOC SSD (AliFlash V3) is built with same physical form factor as standard 2.5-inch U.2 NVMe SSDs. Therefore it is compatible with all server models with NVMe port in Alibaba's data centers. After product development was completed in March 2018, AOC SSD has undergone several round of software/firmware optimizations and is now being deployed for trial run in Alibaba's data centers.
Alibaba Open Channel SSD (AliFlash V3)
AOC SSD works with its host-side software stack in order to get full benefit from its software/hardware integrated design. In parallel with hardware development, Alibaba developed AOC host-side software stack for different use cases:
The entire AOC SSD host-side software stack is developed by Alibaba, which is different than the lightnvm solution in open source community. In fact, AOC SSD host-side software is by far the only Open Channel software solution that reaches production quality and is deployment-ready. Moreover, AOC SSD's user-space software is also the first full user-space Open Channel software solution in industry.
AOC SSD works with Alibaba's Fusion Engine to deliver software/hardware integrated solutions for Alibaba's business units. Several different solutions has already been developed.
Solution based on kernel-space AOC Driver and Block Device FTL, covering most of the legacy use cases.
Significant improvement and extension has been done on AOC Block Device FTL since its development. Preliminary tests show random read and write IOPS of 700K and 120K respectively, exceeding major alternative of standard NVMe SSD.
In addition to basic I/O performance, AOC SSD further optimized QoS capability along with Fusion Engine software, resulting in much lower read/write latencies for high-priority applications.
Read latency of high-priority applications. Average latency reduced by 75%, and 99% latency reduced by 83%.
High-priority application's read/write latency in mixed workload. Average read/write latency reduced by 81% and 99% respectively, and 99% read latency reduced by 49%.
Solution based on User-space AOC SSD Software.
Using User-Space AOC SSD Software, customized FTLs are developed for specific use cases to achieve higher level of software/hardware co-optimization. For example, Alibaba developed an "Object SSD FTL" for the Key-Value use cases, which is widely used by Alibaba's business units. The Object SSD FTL works with Alibaba's user-space KV engine. By exposing its AOC SSD's parity groups as objects to KV engine, and by combining the internal Garbage Collection with application's compaction operations, the KV-Object SSD solution is expected to reduce write-amplification factor by up to 4 times and 99% latency by up to 80%.
Comparing AOC SSD to standard NVMe SSD, in summary:
AOC SSD architecture is designed as a platform. Alibaba is working with major SSD vendors to develop compatible AOC SSD products. In these collaborations, SSD vendors are responsible for SSD hardware and firmware, while Alibaba is responsible for host-side software. Both sides work together in a joint-development-and-debug model, in order to reduce time of product development and qualification. Alibaba is deploying the vendor-supplied AOC SSD products in data center, and will adopt AOC SSD in to all Alibaba server models.
As the core hardware of Alibaba's next-generation storage architecture, Alibaba has a long-term plan for AOC SSD.
The deployment of Alibaba Open Channel SSD is not only a key step of Alibaba's next-generation storage architecture, but it also marks Alibaba's transition from a follower to leader in storage technology. The massive deployment of AOC SSD will benefit Alibaba's infrastructure, making it more efficient and competitive in support for Alibaba's business innovations and globalization.
FortiGuard Labs Report – Exponential Growth of IoT Device Attacks
2,605 posts | 747 followers
FollowAlibaba Clouder - August 17, 2018
Alibaba Clouder - August 13, 2019
Alibaba Clouder - March 21, 2018
Alibaba Cloud ECS - September 10, 2020
Alibaba Clouder - August 12, 2019
Alibaba Clouder - January 15, 2019
2,605 posts | 747 followers
Follow
OSS(Object Storage Service)
An encrypted and secure cloud storage service which stores, processes and accesses massive amounts of data from anywhere in the world
Learn More
ECS(Elastic Compute Service)
Elastic and secure virtual cloud servers to cater all your cloud hosting needs.
Learn More
Apsara File Storage NAS
Simple, scalable, on-demand and reliable network attached storage for use with ECS instances, HPC and Container Service.
Learn MoreMore Posts by Alibaba Clouder
Raja_KT March 8, 2019 at 7:27 am
Plethora of FFs, types of storage ...HDD,SSD(SATA,SAS,NVMe), computational..... and many others ....are really creating problems. I think a lot of work in this space too :)