All Products
Search
Document Center

Limits

Last Updated: Feb 28, 2022

This topic describes the limits of Data Lake Formation (DLF). When you use the DLF console or call API operations, make sure that relevant requirements are met. Otherwise, an error occurs.

Metadata

Item

Quota

Queries on a single table per second

2,000

Number of partitions in a single table

1,000,000

Preprocessing of data import

Item

Quota

Number of data import tasks per region

1,000

Maximum number of resources for each data import task, which are measured by compute units (CUs)

1,000

Connected engines

Limits related to Hive:

  • Authentication: Native authentication of Hive is not supported. AccessKey- or Resource Access Management (RAM)-based authentication must be used.

  • Constraint: Constraints on Hive are not supported.

  • Index: Index-related API operations in Hive are not supported.

  • Transaction: Transaction- or lock-related API operations in Hive are not supported.

Inconsistency with the databases in Hive metastore:

  • If you use DLF to store the data of the Hive metastore, DLF does not create a default database when catalogs are initialized.

Limits related to Presto:

  • Table statistics are not supported.

  • Authentication: Native authentication of Hive is not supported. AccessKey- or RAM-based authentication must be used.

  • Transaction: Transaction- or lock-related API operations in Hive are not supported.