This topic describes how to create a crawler to collect metadata from an AnalyticDB for MySQL 3.0 data store to DataWorks. You can view the collected metadata on the Data Map page.

Procedure

  1. Go to the Data Discovery page.
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Workspaces.
    3. In the top navigation bar, select a region as required, find the workspace where you want to create a crawler, and then click Data Analytics in the Actions column.
    4. On the DataStudio page, click the DataWorks icon icon in the upper-left corner and choose All Products > Data governance > DataMap. The homepage of Data Map appears.
    5. In the top navigation bar, click Data Discovery.
  2. In the left-side navigation pane, click AnalyticDB for MySQL 3.0.
  3. On the AnalyticDB for MySQL 3.0Metadata Crawler page, click Create Crawler.
  4. In the Create Crawler dialog box, perform the following steps:
    1. In the Basic Information step, set the basic parameters.
      Basic Information section
      Parameter Description
      Crawler Name Required. The name of the crawler. You must specify a unique name.
      Crawler Description The description of the crawler.
      Workspace The workspace of the data store from which metadata will be collected.
      Connection Type The type of the data store from which metadata will be collected. The default value is AnalyticDB for MySQL 3.0 and cannot be changed.
    2. Click Next.
    3. In the Select Collection Object step, select a connection from the Connection drop-down list.
      If the required connection does not exist, click Create Connection to go to the Data Source page in Workspace Management and create the connection.
    4. Click Test Crawler Connectivity.
      If the database is configured with a whitelist, you must add the IP address of DataWorks based on the region where the workspace resides to the whitelist.
    5. When the message The connectivity test has been passed appears, click Next.
    6. In the Configure Execution Plan step, specify the execution plan.
      Valid values of the Execution Plan parameter: On-demand Execution, Monthly, Weekly, Daily, and Hourly.
    7. Click Next.
    8. In the Confirm Information step, verify that the configuration of the crawler is correct and click OK.
  5. On the AnalyticDB for MySQL 3.0Metadata Crawler page, find the created crawler and click Run in the Actions column.
    After the crawler is run, click the number in the Updated Tables in Last Run or Added Tables in Last Run column to view the details about the updated or added tables.
    You can also perform the following operations on the OSSMetadata Crawler page:
    • Click Details in the Actions column of a crawler. In the Crawler Details dialog box, view the detailed information about the crawler.
    • Click Edit in the Actions column of a crawler. In the Edit Crawler dialog box, modify the configuration of the crawler.
    • Click Delete in the Actions column of a crawler. In the Confirm message, click OK to delete the crawler.
    • Click Stop in the Actions column of a running crawler to stop the crawler.