Learn how to adjust Hive memory parameters.
Adjustment scenarios
As your business workload grows, you may notice increased job latency from metadata operations. If you also observe HiveMetaStore service exceptions and monitoring metrics that indicate insufficient memory (for example, when HiveMetaStore garbage collection (GC) metrics exceed their threshold), increase the HiveMetaStore heap size. If HiveServer2 shows similar symptoms, adjust its heap size as well.
Usage notes
If you use Data Lake Formation (DLF) unified metadata when you create your cluster, the built-in HiveMetaStore service is not enabled. For more information about different metadata options, see Select a metadata service.
Procedure
On the Configure page for the Hive component, select the hive-env tab. Enter heap in the search box to find the hive_server2_heapsize and hive_metastore_heapsize parameters. The default value for both parameters is 512 MB.
-
Adjust HiveMetaStore memory
Set the value of the hive_metastore_heapsize parameter according to your workload and the host machine's available memory. For example, you can set the value to 2048 to specify a 2 GiB heap size. After modifying the parameter, click Save. Then, go to the component's status page to restart the HiveMetaStore component and monitor its status.
-
Adjust HiveServer2 memory
Set the value of the hive_server2_heapsize parameter according to your workload and the host machine's available memory. For example, you can set the value to 2048 to specify a 2 GiB heap size. After modifying the parameter, click Save. Then, go to the component's status page to restart the HiveServer2 component and monitor its status.