All Products
Search

This Product

    E-MapReduce:Access heat collection for JindoTable

    Document Center

    E-MapReduce:Access heat collection for JindoTable

    Last Updated:Jun 20, 2026

    The JindoTable access frequency statistics collection feature helps you distinguish between cold and hot data, reducing overall storage costs and improving cache efficiency.

    Prerequisites

    A cluster has been created. For more information, see Create a cluster.

    Background information

    JindoTable collects access records for Hive tables. The collected data is stored in the namespace of the SmartData service.

    SmartData 3.2.x and later supports the Spark, Hive, and Presto engines. By default, access frequency statistics collection is enabled for Spark and Presto but disabled for Hive. To disable this feature, see Disable heat collection. To enable this feature for Hive, see Enable heat collection for Hive.

    Data query

    JindoTable provides a command to query access frequency information.
    • Syntax
      jindo table -accessStat <-d [days]> <-n [topNums]>

      The days and topNums parameters are positive integers. If you set days to 1, the command queries all access records from 00:00 local time on the current day to the current time.

    • Function

      Queries the top N most frequently accessed tables or partitions within a specified time range.

    • Example: Query the 20 most frequently accessed tables or partitions in the last seven days.
      jindo table -accessStat -d 7 -n 20

    For more information about using JindoTable, see JindoTable User Guide.

    Enable heat collection for Hive

    1. Log on to the E-MapReduce console.
    2. In the top navigation bar, select a region and resource group.
    3. Click the Clusters tab.
    4. On the Clusters page, find your cluster and click Details in the Actions column.
    5. Modify a Hive parameter.
      1. In the navigation pane on the left, choose Services > Hive.
      2. Click the Configure tab.
      3. Search for the hive.exec.post.hooks parameter and append com.aliyun.emr.table.hive.HivePostHook to its value. If other values exist, use a comma (,) as a separator.
    6. Save the configuration.
      1. In the upper-right corner, click Save.
      2. In the Confirm dialog box, enter a Execution Reason and turn on Auto-update Configuration.
      3. Click OK.
    7. Restart the service.
      1. On the Hive service page, choose Actions > > Restart HiveServer2 from the upper-right corner.
      2. In the Cluster Activities dialog box, enter a Execution Reason.
      3. Click OK.
      4. ConfirmIn the confirmation dialog box, click OK.

    Disable heat collection

    1. Log on to the E-MapReduce console.
    2. In the top navigation bar, select a region and resource group.
    3. Click the Clusters tab.
    4. On the Clusters page, find your cluster and click Details in the Actions column.
    5. Modify the parameter values.
      • Hive service:
        1. In the navigation pane on the left, choose Services > Hive.
        2. Click the Configure tab.
        3. Search for the hive.exec.post.hooks parameter and remove com.aliyun.emr.table.hive.HivePostHook from its value.
      • Spark service:
        1. In the navigation pane on the left, choose Services > Spark.
        2. Click the Configure tab.
        3. Search for the spark.sql.queryExecutionListeners parameter and remove com.aliyun.emr.table.spark.SparkSQLQueryListener from its value.
      • Presto service:
        1. In the navigation pane on the left, choose Services > Presto.
        2. Click the Configure tab.
        3. Search for the event-listener.name parameter and clear its value.
    6. Save the configuration.
      1. In the upper-right corner, click Save.
      2. In the Confirm dialog box, enter a Execution Reason and turn on Auto-update Configuration.
      3. Click OK.
    7. Restart the services.
      • Hive service:
        1. On the Hive service page, choose Actions > > Restart HiveServer2 from the upper-right corner.
        2. In the Cluster Activities dialog box, enter a Execution Reason.
        3. Click OK.
        4. ConfirmIn the confirmation dialog box, click OK.
      • Spark service:
        1. On the Spark service page, choose Actions > > Restart ThriftServer from the upper-right corner.
        2. In the Cluster Activities dialog box, enter a Execution Reason.
        3. Click OK.
        4. ConfirmIn the confirmation dialog box, click OK.
      • Presto service:
        1. On the Presto service page, choose Actions > > Restart All Components from the upper-right corner.
        2. In the Cluster Activities dialog box, enter a Execution Reason.
        3. Click OK.
        4. ConfirmIn the confirmation dialog box, click OK.