Community

Blog Events Webinars Tutorials Forum
  1. Blog
  2. Events
  3. Webinars
  4. Tutorials
  5. Forum
Create Account
×
Community Blog Using the Table Wizard Feature of Data Lake Analytics

Using the Table Wizard Feature of Data Lake Analytics

This article shows you how to enable the Table Wizard feature for creating Object Storage Service (OSS) mapping databases and tables in Data Lake Analytics (DLA).

By Zhao Yongchun, Data Lake Analytics Team

The Table Wizard feature in Data Lake Analytics (DLA) is designed for simplifying the process for creating Object Storage Service (OSS) mapping databases and tables in DLA. You can enable the Table Wizard in just three steps:

  1. Check authorization
  2. Data source configuration
    1. Configure the location of OSS tables
    2. Configure the location of DLA databases
    3. Other configurations
  3. Import configuration

This article describes how to quickly create OSS tables through the Table Wizard feature.

Step 1: Check Authorization

This step ensures that the DLA service has access to OSS data. If you already have permission to access OSS data sources, you can skip this step.

  1. Log on to the DLA console.
  2. In the left-side navigation pane, select Table wizard, and then click Agree to authorize.

    1

  3. On the Cloud Resource Access Authorization pane, click Confirm Authorization Policy to complete the OSS authorization.

    2

Step 2: Data Source Configuration

This step configures the storage location for OSS tables and DLA databases.

Note: You need to configure the OSS tables' location, and the DLA databases' location, and then set other configurations.

Configuring the Location of OSS Tables

3

Click OSS Console in the preceding figure to obtain the URL of an OSS data table. The URL is the OSS data table address. You can obtain the URL using the following three methods:

Method 1: Accessing the File URL

4

Method 2: Using File Preview

5

Method 3: Using ossbrowser

Obtain the URL using the OSS official tool ossbrowser.

6

7

8

After you enter the URL of an OSS file, click Parse URL to automatically display Table name and Storage location.

Configuring the Location of DLA Databases

The DLA databases location must be the path or the parent path where the OSS files are located. For example, if an OSS path is oss://analyticdb-bucket/table/2019/1.24/, the corresponding DLA database path can be any of the following options:

? /
? /table/
? /table/2019/
? /table/2019/1.24/

Scenario 1: Creating an OSS Table in DLA without DLA Database Creation Requirements

If you do not need to create a DLA database when creating an OSS table in DLA, click Schema list , and select a DLA database from the Choose a schema drop-down list.

9

Scenario 2: Creating an OSS Table in DLA with DLA Database Creation Requirements

If you need to create a DLA database when creating an OSS table in DLA, click New schema, and select a DLA database path from the Storage location drop-down list.

10

Other Configurations

  • Data format: The data formats JSON and Text are supported.
  • Compression: No compression is selected by default.
  • Scan mode: Scan child folder mode is selected by default.

Other configurations, such as Skip header rows, Column embedded level, Select file only, and more can be set according to your requirements.

Step 3: Import Configuration

  1. Click Next to import configurations.

    11

  2. Click Execute to go to the Execute window, and then click OK.

    12

  3. After configurations are executed successfully, you are prompted the OSS table has been created. You can click Back to go to the Table wizard tab page, or click Log on to DMS Console to analyze the OSS data.
Database Storage Big Data Data Analytics Data Lake Data Lake Analytics
0 0 0
Share on

Alibaba Cloud Data Lake Analytics

1 posts | 0 followers

You may also like

Comments

Alibaba Cloud Data Lake Analytics

1 posts | 0 followers

Related Products