This topic describes how to create a crawler to collect metadata from an AnalyticDB for PostgreSQL data source. You can manage the tables that store the collected AnalyticDB for PostgreSQL metadata on the Data Map page.

Prerequisites

An AnalyticDB for PostgreSQL instance is associated with a workspace. You must associate a AnalyticDB for PostgreSQL instance with a workspace before you collect metadata from the AnalyticDB for PostgreSQL data source. For more information, see Create and manage workspaces.

Procedure

  1. In the left-side navigation pane, click Data Recognition. The Data Recognition page appears.
  2. In the left-side navigation pane, click AnalyticDB for PostgreSQL.
  3. On the AnalyticDB for PostgreSQLMetadata Crawler page, click Create Crawler.
  4. In the Create Crawler dialog box, set the parameters in each step.
    1. In the Basic Information step, set the parameters as required.
      Basic Information step
      ParameterDescription
      Crawler NameRequired. The name of the crawler. You must set a unique name.
      Crawler DescriptionThe description of the crawler.
      WorkspaceThe workspace of the data source from which you want to collect metadata.
      Data Source TypeThe type of the data source from which you want to collect metadata. The default value is AnalyticDB for PostgreSQL and cannot be changed.
    2. Click Next.
    3. In the Select Collection Object step, select a data source from the Data Source drop-down list.
      If no data source is available, click Create to go to the Data Source page and add an AnalyticDB for PostgreSQL data source. For more information, see Add an AnalyticDB for PostgreSQL data source.
    4. Click Start Testing next to Test Crawler Connectivity. If the message The connectivity test is successful appears, the DataWorks metadata service can connect to the AnalyticDB for PostgreSQL data source.
    5. Click Next.
  5. On the AnalyticDB for PostgreSQLMetadata Crawler page, find the created crawler and click Run in the Actions column.
    After the crawler is run, click the number in the Updated Tables in Last Run or Added Tables in Last Run column to view the details of the updated or created tables.
    Important The Run button is available only in the Actions column of a crawler that needs to be manually triggered.
    You can also perform the following operations on the AnalyticDB for PostgreSQLMetadata Crawler page:
    • Click Details in the Actions column of a crawler. In the Crawler Details dialog box, view the detailed information about the crawler.
    • Click Edit in the Actions column of a crawler. In the Edit Crawler dialog box, modify the configurations of the crawler.
    • Click Delete in the Actions column of a crawler. In the Confirm message, click Ok to delete the crawler.
    • Click Stop in the Actions column of a crawler that is running to stop the crawler.