This topic describes how to collect metadata and view table information in Data Map.

Prerequisites

The operations described in Process data are performed.

Background information

Metadata describes data attributes, data structures, and other relevant information. Data attributes include the name, size, and data type, data structures include the field, type, and length, and other relevant information includes the location, owner, output node, and access permissions. In DataWorks, metadata refers to information about tables or databases. DataMap is the main service used to manage metadata.

Collect metadata

After you associate an EMR cluster with your workspace as a compute engine instance, the Data Map service of DataWorks creates a crawler to collect the metadata of the cluster. If you cannot view the metadata of the cluster on the DataMap page, the metadata fails to be collected. In this case, use the crawler to collect the metadata again on the DataMap page. If the following errors occur, the metadata of the cluster fails to be collected:
  • You cannot view the metadata of the cluster on the DataMap page. For more information about how to view the metadata, see Search for tables.
  • You cannot create tables on the Workspace Tables tab of the DataStudio page. For more information about how to create a table, see Manage tables.
For more information about how to collect the metadata of an EMR cluster, see Collect metadata from an EMR data source.

View table information

  1. In the top navigation bar of the DataMap page, click the All Data tab.
  2. On the All Data tab, select E-MapReduce from the drop-down list to the left of the search box.
  3. In the table list that appears, click the table named rpt_user_info_d to view the details of the table.
    You can also enter a keyword in the search box to search for an EMR table and view the details of the table.
  4. On the page that appears, click Lineage to view the lineages of the table.

What to do next

After you learn how to collect metadata and view table information in Data Map, you can proceed with the next tutorial to learn how to configure rules to monitor and ensure the quality of the data that is generated by the developed nodes. For more information, see Configure rules to monitor data quality.