This topic describes how to create a crawler to collect metadata from a MySQL data
source. You can view the collected metadata on the Data Map page.
Procedure
- Log on to the DataWorks console and go to the DataMap page. For more information, see Go to the homepage of DataMap.
- In the top navigation bar, click Data Discovery.
- In the left-side navigation pane, click MySQL.
- On the MySQLMetadata Crawler page, click Create Crawler.
- In the Create Crawler dialog box, set the parameters in each step.
- In the Basic Information step, set the parameters as required.
Parameter |
Description |
Crawler Name |
Required. The name of the crawler. You must set a unique name. |
Crawler Description |
The description of the crawler. |
Workspace |
The workspace of the data source from which you want to collect metadata. |
Data Source Type |
The type of the data source from which you want to collect metadata. The default value
is MySQL and cannot be changed.
|
- Click Next.
- In the Select Collection Object step, select a data source from the Data Source drop-down list.
If no data source is available, click
Create to go to the page and add a MySQL data source. For more information, see
Add a MySQL data source.
Note You can select an ApsaraDB RDS for MySQL instance or a MySQL data source that is accessible
from the Internet by using a Java Database Connectivity (JDBC) connection string.
- Click Start Testing next to Test Crawler Connectivity.
- If the message The connectivity test is successful appears, click Next.
- In the Configure Execution Plan step, configure an execution plan.
Valid values of the Execution Plan parameter are On-demand Execution, Monthly, Weekly, Daily, and Hourly.
- Click Next.
- In the Confirm Information step, check the information that you specified and click Confirm.
- On the MySQLMetadata Crawler page, find the created crawler and click Run in the Actions column.
After the metadata in the MySQL data source is collected, click in the top navigation bar. Select
MySQL from the drop-down list in the upper part of the page. You can view the tables that
store the collected MySQL metadata.
You can click the name of a table to view the table details.