Metadata management is an important part of building a data lake. Effective centralized metadata management can enhance the value of data assets. This topic describes related operations of databases, tables, and functions in data lake formation.
Database
Create a database
Log on to the Data Lake Formation console.
In the left-side navigation pane, select .
Click the Database tab, select the target Catalog List, and click Create Database.
Configure the following database information and click OK.
Catalog: Select the data catalog.
Database Name: Enter the database name.
Database Description: Optional, enter the database description.
Select Path: Enter the location of the database.
View the database details
Click the Database tab.
In the database list, click the target database name to view the Basic Information of the database.
Click the corresponding tabs to view the Table List, Functions, Data Permission, Data Overview, and Storage Rule of the database.
Edit a database
Click the Database tab, and select the target Catalog List.
Find the target database and click Edit in the Actions column.
Modify the following information and click Update.
Database Description: Enter the database description.
Select Path: Enter the location of the database.
Delete a database
Click the Database tab, and select the target Catalog List.
Find the target database and click Delete in the Actions column.
In the pop-up dialog box, click Delete.
The default database is created by default in DLF and cannot be deleted. We recommend to use other databases in a production environment.
Deleting a database on the DLF page does not delete the data stored in OSS. To delete data, execute the Drop Database operation from the E-MapReduce/MaxCompute side.
Table
Create a table
After creating a database, click the Table tab, select the target Catalog List and Database Name, and click Create Table.
Configure the following data table information and click OK.
Table Name: Enter the name of the table.
Catalog: Select the data catalog.
Database: Select the database under the data catalog.
Table Description: Optional, enter the table description.
Data Storage Location: Select the location where the data in the table is stored.
Format and Serialization: Select the data format and output format of the table.
Delimiter: Optional, when the data format is CSV, select the separator for the table.
Manually define the common columns and partition key columns of the table. Specify the column name, data type, description, and other information.
View the table details
Click the Table tab.
In the table list, click the target table name to view the Basic Information of the table.
Click the corresponding tabs to view the Data Permission, Data Overview, Version Management, and Storage Rule of the table.
For details about the Data Overview of the table, see Data overview of data tables.
Edit a table
Click the Table tab, and select the target Catalog List and Database Name.
Find the target data table and click Edit in the Actions column.
Modify the data table information and click Update.
Delete a table
Click the Table tab, and select the target Catalog List and Database Name.
Find the target data table and click Delete in the Actions column.
In the pop-up dialog box, click Delete.
Deleting a table on the DLF page does not delete the data stored in OSS. To delete data, execute the Drop Table operation from the E-MapReduce/MaxCompute side.
Function
Create a function
In the left-side navigation pane, select .
Click the Function tab, select the target Catalog List and Database Name, and click Create Function.
Configure the following function information and click OK.
Function Name: Enter the function name.
Function Type: Only JAVA is supported.
Catalog: Select the data catalog.
Database: Select the database under the data catalog.
Class Name: Optional, enter the class name.
Resource URI: Optional, click Add Column, and enter the Type and URI. Resource types support JAR, FILE, and ARCHIVE.
View the function details
Click the Function tab, and select the target Catalog List and Database Name.
In the function list, click the target function name to view the basic information of the function.
Edit a function
Click the Function tab, and select the target Catalog List and Database Name.
Find the target function and click Edit in the Actions column.
Configure the Class Name information and click OK.
Delete a function
Click the Function tab, and select the target Catalog List and Database Name.
Find the target function and click Delete in the Actions column.
In the pop-up confirmation box, click Delete.