E-MapReduce (EMR) Presto provides several built-in connectors for querying external data sources. You can modify these connectors or add custom ones.
Built-in connectors
EMR Presto includes the following built-in connectors.
|
Connector |
Function |
|
hive |
Queries data stored in a Hive data warehouse. |
|
kudu |
Queries, inserts, and deletes data stored in Kudu. |
|
mysql |
Queries and creates tables in an external MySQL instance. |
|
iceberg |
Queries data files stored in the Iceberg format. |
|
hudi |
Queries Copy-on-Write (COW) and Merge-on-Read (MOR) tables. |
|
delta |
Queries Delta Lake tables. |
|
jmx |
Provides system monitoring and debugging capabilities. |
|
system |
Queries basic information and metrics about the cluster. Note
The system connector requires no configuration. All information is available in the |
Modify a built-in connector
To modify a built-in connector, modify its configuration file on the Configure page of the Presto service in the EMR console and then restart the service.
|
Parameter |
Configuration file |
|
hive-hadoop2 |
hive.properties |
|
kudu |
kudu.properties |
|
mysql |
mysql.properties |
|
iceberg |
iceberg.properties |
|
hudi |
hudi.properties |
|
delta |
delta.properties |
|
jmx |
jmx.properties |
Example: Modify the Hive connector
-
In the EMR console, go to the Configure page of the Presto service. In the Service Configuration area, click the hive.properties tab.
-
Modify the configuration items as needed.
For details about modifying configuration items, see Manage configuration items.
-
After you save the configuration, choose More > Restart in the upper-right corner.
ImportantThe changes take effect after you restart the service.
Add a custom connector
EMR Presto provides five placeholder connectors (connector1 through connector5) for adding custom connectors. They correspond to the connector1.properties, connector2.properties, connector3.properties, connector4.properties, and connector5.properties files on the Configure page of the Presto service. You can configure a placeholder connector in the same way as a built-in connector.
To add a custom connector, configure an unused placeholder connector.
Example: Add a MongoDB connector
-
In the EMR console, go to the Configure page of the Presto service. In the Service Configuration area, click the connector1.properties tab.
-
Set connector.name to mongodb.
-
Add custom configuration items as needed.
For details about adding configuration items, see Modify configuration items.
-
After you save the configuration, choose More > Restart in the upper-right corner.