Hologres:Data map

Limitations

• Data Map requires Hologres V1.1 or later. If your instance runs an earlier version, see Common upgrade preparation errors for troubleshooting, or join the Hologres DingTalk group for feedback. For more information, see How do I get more online support?.

• Data lineage is available in the following regions only: China (Hangzhou), China (Shanghai), China (Beijing), China (Shenzhen), China (Hong Kong), and Singapore.

• After you configure the crawler, data lineage information becomes available within one hour.

Prerequisites

Before you begin, make sure that you have:

• A Hologres instance running V1.1 or later

• A DataWorks workspace with the Hologres instance associated as a compute engine instance

• A Hologres data source configured in DataWorks. If none exists, click Create to create one. For more information, see Add a Hologres data source

Collect metadata

Configure a metadata crawler to sync Hologres table metadata into Data Map.

1. Go to the Data Map page. Log on to the DataWorks console. In the top navigation bar, select your region. In the left-side navigation pane, choose Data Governance > Data Map, then click Go to Data Map.

2. In the top navigation bar, click Data Discovery.

3. In the left-side navigation pane, choose Metadata Collection > Hologres.

4. On the Hologres Metadata Crawler page, click Create Crawler.

5. In the Create Crawler dialog box, complete the following steps. Step 1: Basic information Set the following parameters, then click Next. Step 2: Select a data source Step 3: Configure an execution plan Select how often the crawler collects metadata. The Cron Expression field updates automatically based on your selections. Click Next. Step 4: Confirm settings Review all settings in the Confirm Information step, then click Confirm.

   1. From the Data Source drop-down list, select your Hologres data source. Only Hologres instances associated with your workspace as compute engine instances appear in this list. If no data source is available, click Create to create one.

   2. Click Start Testing next to Test Crawler Connectivity. Wait for the The connectivity test is successful message. > Note: If the test fails, find and resolve the connection error before proceeding.

   3. Click Next.

   Important

   If you select a Monthly schedule, avoid selecting the 29th, 30th, or 31st as the collection date. Some months do not have these dates, and the crawler skips collection on those days.

   Parameter	Description
   Crawler Name	Required. Enter a unique name for the crawler.
   Crawler Description	Optional. Add a description for the crawler.
   Workspace	Select the workspace that contains the Hologres data source.
   Data Source Type	Defaults to Hologres and cannot be changed.

   Execution plan	Behavior	Example schedule
   On-demand Execution	Runs only when you trigger it manually.	—
   Hourly	Runs once per hour at a minute value that is a multiple of 5.	At the 5th and 10th minutes of each hour.
   Daily	Runs once per day at a specified time.	At 01:00 each day.
   Weekly	Runs once per week on specified days at a specified time. If no time is set, defaults to 00:00:00.	At 03:00 on Sunday and Monday.
   Monthly	Runs once per month on specified dates at a specified time.	At 09:00 on the 1st, 11th, and 21st of each month.

   

View crawler status

After the crawler is created, it appears on the Hologres Metadata Crawler page. For each crawler, you can view:

Manage crawlers

In the Actions column, use the following operations to manage your crawlers:

Explore data assets

After metadata is collected, use the following Data Map features to explore your Hologres data assets.

Data overview

On the Data Overview page, view statistics and table information for all Hologres databases that have a crawler configured in the current region. For more information, see Data overview.

Search for tables

Search for tables in Data Map by table name, table description, field name, or field description. Filter results by category, project, or database. For more information, see Find tables.