This topic describes how to create a crawler to collect metadata from an AnalyticDB for PostgreSQL data source. You can manage the tables that store the collected AnalyticDB for PostgreSQL metadata on the Data Map page.

Prerequisites

An AnalyticDB for PostgreSQL instance is associated with a workspace. You must associate a AnalyticDB for PostgreSQL instance with a workspace before you collect metadata from the AnalyticDB for PostgreSQL data source. For more information, see Associate an AnalyticDB for PostgreSQL compute engine instance with a workspace.

Procedure

  1. Go to the Data Discovery page.
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Workspaces.
    3. After you select the region in which the workspace that you want to manage resides, find the workspace and click Data Analytics in the Actions column.
    4. On the DataStudio page, click the More icon icon in the upper-left corner and choose All Products > Data governance > DataMap.
    5. In the top navigation bar, click Data Discovery.
  2. In the left-side navigation pane, click AnalyticDB for PostgreSQL.
  3. On the AnalyticDB for PostgreSQLMetadata Crawler page, click Create Crawler.
  4. In the Create Crawler dialog box, set the parameters in each step.
    1. In the Basic Information step, set the parameters as required.
      Basic Information step
      Parameter Description
      Crawler Name Required. The name of the crawler. You must set a unique name.
      Crawler Description The description of the crawler.
      Workspace The workspace of the data source from which you want to collect metadata.
      Data Source Type The type of the data source from which you want to collect metadata. The default value is AnalyticDB for PostgreSQL and cannot be changed.
    2. In the Select Collection Object step, select a data source from the Data Source drop-down list.
      If no data source is available, click Create to go to the Data Source page and add an AnalyticDB for PostgreSQL data source. For more information, see Add an AnalyticDB for PostgreSQL data source.
    3. Click Start Testing next to Test Crawler Connectivity. If the message The connectivity test is successful appears, the DataWorks metadata service can connect to the AnalyticDB for PostgreSQL data source.
    4. Click Next.
  5. On the AnalyticDB for PostgreSQLMetadata Crawler page, find the created crawler and click Run in the Actions column.
    After the crawler is run, click the number in the Updated Tables in Last Run or Added Tables in Last Run column to view the details of the updated or created tables.
    Notice The Run button is available only in the Actions column of a crawler that needs to be manually triggered.
    You can also perform the following operations on the AnalyticDB for PostgreSQLMetadata Crawler page:
    • Click Details in the Actions column of a crawler. In the Crawler Details dialog box, view the detailed information about the crawler.
    • Click Edit in the Actions column of a crawler. In the Edit Crawler dialog box, modify the configurations of the crawler.
    • Click Delete in the Actions column of a crawler. In the Confirm message, click Ok to delete the crawler.
    • Click Stop in the Actions column of a crawler that is running to stop the crawler.