Container Service for Kubernetes:ack-fluid component introduction and release notes - Container Service for Kubernetes

ack-fluid is a distributed dataset orchestration and acceleration engine in the cloud-native AI suite. It abstracts remote storage as Kubernetes-native datasets, orchestrates a distributed cache layer on top of them, and exposes data to AI workloads through standard persistent volume claims (PVCs), reducing I/O latency for model training and inference without changing application code.

How it works

ack-fluid defines two CustomResourceDefinitions (CRDs)—Dataset and Runtime—that map directly onto the Kubernetes resource model. Declare a Dataset to describe where your data lives. Declare a Runtime to spin up a distributed cache on top of it. ack-fluid then manages the full data lifecycle: caching, scheduling, and teardown.

Applications access data by mounting the PVC that backs a Dataset. In standard ACK clusters, the Fluid CSI plugin handles the mount. In serverless ACK clusters, the Fluid FUSE Sidecar plugin injects a sidecar container to provide the same interface. Either way, the application sees a standard POSIX path—the underlying runtime is invisible.

Supported cache runtimes:

Runtime	Description
AlluxioRuntime	Alluxio-based distributed cache
JuiceFSRuntime	JuiceFS-based distributed cache
JindoRuntime	JindoFS-based distributed cache, with JindoCache as the default cache engine
EFCRuntime	EFC-based distributed cache
ThinRuntime	Generic extensible interface; connects to self-managed storage systems with minimal code and reuses Fluid's core data orchestration, management, and scheduling capabilities

For a deeper look at the Dataset model, see Elastic datasets.

Usage notes

ack-fluid supports only ACK Pro clusters, ACK Serverless Pro clusters, and ACK Edge Pro clusters running Kubernetes 1.18 or later.

To install ack-fluid and start accelerating data access, see Accelerate data access.

Release notes

April 2024

Version

Changes

Release date

Impact

v1.0.8

New features

Fluid now supports dynamic dataset mounting. When a dataset's mount target changes, all PVs and PVCs referencing that dataset are automatically updated—no manual remounting required.

April 25, 2024

No impact on workloads.

February 2024

Version

Changes

Release date

Impact

v1.0.7

New features

Supports FUSE client affinity scheduling semantics.
Supports automatic enabling of control plane components based on the cluster resource type.

Enhancements

JindoRuntime now uses JindoCache as the default cache engine.
Enhanced security across Fluid components.

Bug fixes

Fixed an issue where a dataset's default read-only permission was not passed through to the ThinRuntime client.

February 4, 2024

No impact on workloads.

December 2023

Version

Changes

Release date

Impact

v1.0.6

New features

Data operations now support setting resource requests and limits.
Supports custom configuration of multi-level affinity scheduling policies.
JindoRuntime now supports accelerated data access for PVs and hostPath volumes.

December 14, 2023

No impact on workloads.

November 2023

Version

Changes

Release date

Impact

v1.0.5

New features

Supports multi-level affinity scheduling policies.
JindoRuntime now supports persistent storage for Master component metadata.
JuiceFSRuntime now supports dynamic updates for FUSE components.
Data operations now support a scheduled reclamation feature.
Pods for automatic CRD upgrade jobs can be reclaimed on a schedule.

Bug fixes

Fixed a mount point propagation issue in the Fluid CSI plugin.
Fixed redundant mounting of AccessKey pairs and tokens in the JindoFSx cache engine.
Fixed an issue where the Alluxio cache engine failed to parse sharedOptions.

November 17, 2023

No impact on workloads.

September 2023

Version

Changes

Release date

Impact

v1.0.4

New features

Supports configuring the FUSE sidecar to start in non-blocking mode.
Supports dynamic updates for JuiceFSRuntime configurations.
Supports deployment in ACK LINGJUN Cluster environments.

Bug fixes

Fixed bugs related to the Fluid CSI plugin.

September 18, 2023

No impact on workloads.

August 2023

Version

Changes

Release date

Impact

v1.0.3

New features

Added support for the FUSE sidecar privileged mount mode.

Bug fixes

Fixed an out-of-memory (OOM) issue in the JuiceFSRuntime controller.
Fixed issues related to the FUSE auto-recovery feature.
Fixed an issue where runtime resources remained after an upgrade.

August 18, 2023

No impact on workloads.

July 2023

Version

Changes

Release date

Impact

v1.0.2

New features

ThinRuntime now supports connecting to third-party storage systems. ConfigMaps are used to store parameter information.
Local disks of ECI instances can now be used as the cache storage medium.
Supports scheduled DataLoad cache prefetching jobs.

Enhancements

The Helm backend storage driver (HELM_DRIVER) is switched to ConfigMap mode, which further limits the Role-Based Access Control (RBAC) permissions of Fluid control plane components.

July 18, 2023

Switching the Helm backend storage driver may leave behind some Helm-related Secret resources.
If your cluster uses ThinRuntime to connect to third-party storage, newly created ThinRuntime clients may fail after upgrading to v1.0.2 or later due to compatibility issues. For details, see Fluid. ThinRuntime clients already running are not affected.

June 2023

Version

Changes

Release date

Impact

v1.0.1

New features

Added support for anti-affinity scheduling constraints for ARM64 nodes.
Added support for configuring automatic CRD upgrades.

Bug fixes

Fixed an issue where the Fluid CSI plugin left residual hostPath mount targets.
Fixed a compatibility issue with Kubernetes versions earlier than 1.21.

June 19, 2023

No impact on workloads.

v1.0.0

New features

JuiceFSRuntime now supports scheduled DataMigrate jobs.

Enhancements

Optimized the Dataset status update logic to reduce pod startup latency.
Runtime deployment failures now include detailed error messages.

Bug fixes

Fixed a volume injection issue in the EFCRuntime FUSE sidecar mode.

June 7, 2023

No impact on workloads.

May 2023

Version

Changes

Release date

Impact

v0.9.10

New features

Added the EFCRuntime controller component.

Enhancements

Increased resources for control plane components in ACK Serverless environments.

May 9, 2023

No impact on workloads.

April 2023

Version	Changes	Release date	Impact
v0.9.9	New features JindoRuntime now supports environment variable configuration. The JuiceFSRuntime controller now supports configuring controller concurrency. JuiceFSRuntime now supports subdirectory quota configuration. Enhancements Optimized binding time for Fluid PVCs and PVs. Bug fixes Fixed inconsistent path handling between DataMigrate and DataLoad.	April 25, 2023	No impact on workloads.
v0.9.8	New features DataMigrate now supports using PVCs as data sources. JindoRuntime now supports setting container image information. Supports mounting subpaths of dataset PVCs. Supports monitoring Fluid control plane components.	April 18, 2023	No impact on workloads.
v0.9.7	Enhancements Enhanced the security of Fluid components. Bug fixes Fixed bugs related to Alluxio component template rendering.	April 6, 2023	This upgrade includes security vulnerability fixes. No impact on workloads.

March 2023

Version

Changes

Release date

Impact

v0.9.6

New features

Added support for DataMigrate data migration.
DataLoad now supports configurable node affinity scheduling.

Enhancements

Optimized the Fluid CSI mounting logic.

March 22, 2023

No impact on workloads.