Apache Tez is a distributed computing framework built on Apache Hadoop that uses directed acyclic graphs (DAGs) to execute big data tasks. In EMR on ECS, Tez serves as an alternative execution engine for Apache Hive, delivering higher query performance and stability than the default MapReduce backend.
The following figure shows how Hive submits tasks using MapReduce versus Tez.
For more information about Apache Tez, see the Apache Tez documentation.
Enable the Tez engine
Set the hive.execution.engine parameter to tez and restart Hive to make Tez the active execution engine for all Hive SQL queries on your cluster.
Prerequisites
Before you begin, make sure that you have:
An EMR on ECS cluster with Hive installed
Access to the EMR console
Steps
Go to the Services tab for your cluster.
Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.
In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
On the EMR on ECS page, click Services in the Actions column of the cluster that you want to manage.
On the Services tab, click Configure in the Hive section.
Set the
hive.execution.engineparameter totez.In the search box, enter
hive.execution.engine.Set the value to
tezand click Save.In the dialog box that appears, enter a reason in the Execution Reason field and click Save.
Restart Hive to apply the change.
Click the Status tab.
In the upper-right corner, choose More > Restart.
In the dialog box that appears, enter a reason in the Execution Reason field and click OK.
In the Confirm dialog box, click OK.
Access the Tez web UI
On the Access Links and Ports tab, click the URL that corresponds to Tez UI to open the Tez web UI.
For more information, see Access the web UIs of open source components.