Content

Target customers: all users who use OSS data sources. Features released: DLA supports automatic crawling of metadata on OSS. This feature allows DLA to automatically create and update the data lake metadata of files stored on OSS, which facilitates data analysis and computation. This feature can automatically discover the fields and types of data in files, create mappings between directories and partitions, detect new columns and partitions, and group files and then create tables based on the file groups. The key functions of this feature include automatic format discovery, incremental data discovery, and scalability.