SmartData is a storage service for the E-MapReduce (EMR) Jindo engine. SmartData provides centralized storage, caching, and computing optimization for EMR compute engines. This service also provides additional features. SmartData consists of JindoFS, JindoTable, and related tools. This topic describes the updates in SmartData 3.7.X.
JindoFS
The following table describes the updates to JindoFS.
| Feature | Description |
|---|---|
| Display of statistics | SmartData 3.7.2 and later versions support this feature.
JindoFS collects statistics on important metrics, such as Object Storage Service (OSS) read/write throughput, cache read/write throughput, and cache usage. You can connect JindoFS to Prometheus to monitor metrics in a visualized manner. |
| Cold Archive storage class supported for tiered storage of data | SmartData 3.7.3 and later versions support this storage class.
You can specify the -c option in the Archive command to store data to Cold Archive storage. This helps reduce the storage costs of cold data. For more information, see Use tiered-storage commands of JindoFS. |
JindoSDK
The following table describes the updates to JindoSDK.
| Feature | Description |
|---|---|
| Support for access to Amazon Simple Storage Service (S3) | The JindoFS client supports Amazon S3. You can access data in Amazon S3 by using the JindoFS client. |
| OSS PrefixLink feature | The JindoFS client supports the OSS PrefixLink feature. You can use this feature to improve the rename performance of JindoFS. This effectively accelerates Hive jobs and has a significant optimization effect in extract, transform, load (ETL) scenarios of Hive jobs. |
| Support for atomicity of the rename operation | SmartData 3.7.2 and later versions support this feature.
The JindoFS client supports atomicity of the rename operation based on the configuration of the x-oss-forbid-overwrite request header. This is suitable for scenarios in which Delta Lake is supported. |
JindoTable
The following table describes the updates to JindoTable.
| Feature | Description |
|---|---|
| Conversion of the storage class to Cold Archive and unarchiving of data stored to Cold Archive storage | SmartData 3.7.2 and later versions support this feature.
JindoTable allows you to run commands in SDK mode to convert the storage class to Cold Archive and to unarchive data stored to Cold Archive storage. For more information, see Archive and unarchive data in SDK mode. |