This topic describes how to create a crawler to collect metadata from an E-MapReduce data store to DataWorks. You can view the collected metadata on the Data Map page.

Procedure

  1. Go to the Data Discovery page.
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Workspaces.
    3. In the top navigation bar, select a region as required, find the workspace where you want to create a crawler, and then click Data Analytics in the Actions column.
    4. On the DataStudio page, click the DataWorks icon icon in the upper-left corner and choose All Products > Data governance > DataMap. The homepage of Data Map appears.
    5. In the top navigation bar, click Data Discovery.
  2. In the left-side navigation pane, click E-MapReduce. On the Obtain Metadata from E-MapReduce page, click Create Crawler.
  3. In the Create Crawler dialog box, select an engine instance from the Select Engine Instance drop-down list and click Authorize.
    Create Crawler
  4. On the page that appears, click the Metadata tab and click Enable.
    Enable
  5. In the Confirm Operation message, click OK.
  6. Return to the Create Crawler dialog box on the Data Map page and click Refresh.
  7. After the authorization status changes to Authorized, click Commit.
  8. On the Obtain Metadata from E-MapReduce page, find the created crawler and click Obtain All in the Actions column.
    Click Refresh in the upper-right corner of the page and verify that the value in the Running Status column of the created crawler changes to The data has been collected.
    Note After full metadata is collected from the E-MapReduce data store, the system automatically synchronizes new metadata from the data store.

    If you want to delete the created crawler, click Delete in the Actions column. In the Delete Instance message, click OK.

  9. View the metadata collected from the E-MapReduce data store.
    1. In the top navigation bar, click All Data.
    2. Click the E-MapReduce tab.
    3. On the E-MapReduce tab, click the name of the table that stores the collected metadata and view the table details.