This topic describes how to create a crawler to collect metadata from an AnalyticDB for PostgreSQL data store to DataWorks. After the metadata is collected, you can manage tables in the AnalyticDB for PostgreSQL data store on the Data Map page.

Procedure

  1. Go to the Data Discovery page.
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Workspaces.
    3. In the top navigation bar, select a region as required, find the workspace where you want to create a crawler, and then click Data Analytics in the Actions column.
    4. On the DataStudio page, click the DataWorks icon icon in the upper-left corner and choose All Products > Data governance > DataMap. The homepage of Data Map appears.
    5. In the top navigation bar, click Data Discovery.
  2. In the left-side navigation pane, click AnalyticDB for PostgreSQL.
  3. On the AnalyticDB for PostgreSQLMetadata Crawler page, click Create Crawler.
  4. In the Create Crawler dialog box, perform the following steps:
    1. In the Basic Information step, set the basic parameters.
      Basic Information section
      Parameter Description
      Crawler Name Required. The name of the crawler. You must specify a unique name.
      Crawler Description The description of the crawler.
      Workspace The workspace of the data store from which metadata will be collected.
      Connection Type The type of the data store from which metadata will be collected. The default value is AnalyticDB for PostgreSQL and cannot be changed.
    2. Click Next.
    3. In the Select Collection Object step, select a connection from the Connection drop-down list.
      If the required connection does not exist, click Create Connection to go to the Data Source page in Workspace Management and create the connection.
    4. Click Test Crawler Connectivity. If the message The connectivity test has been passed appears, the DataWorks metadata service can access the AnalyticDB for PostgreSQL data store.
    5. Click Next.
  5. On the AnalyticDB for PostgreSQLMetadata Crawler page, find the created crawler and click Run in the Actions column.
    After the crawler is run, click the number in the Updated Tables in Last Run or Added Tables in Last Run column to view the details about the updated or added tables.
    Notice The Run button is displayed only in the Actions column of a crawler that needs to be manually triggered.
    You can also perform the following operations on the AnalyticDB for PostgreSQLMetadata Crawler page:
    • Click Details in the Actions column of a crawler. In the Crawler Details dialog box, view the detailed information about the crawler.
    • Click Edit in the Actions column of a crawler. In the Edit Crawler dialog box, modify the configuration of the crawler.
    • Click Delete in the Actions column of a crawler. In the Confirm message, click OK to delete the crawler.
    • Click Stop in the Actions column of a running crawler to stop the crawler.