All Products
Search
Document Center

E-MapReduce:Getting started

Last Updated:Aug 03, 2023

This topic describes how to create a table and query data in a Doris cluster.

Prerequisites

A Doris cluster is created. For more information, see Create a Doris cluster.

Procedure

  1. Log on to the Doris cluster in SSH mode. For more information, see Log on to a cluster.

    To obtain the public IP address of the master node, perform the following operations: On the Nodes tab of the cluster, find the node group emr_master and click the Plus icon to the left of the node group. The public IP address is displayed in the IP Addresses column.

  2. Run the following command to connect to the cluster:

    mysql -h127.0.0.1  -P 9031 -uroot
  3. Run the following command to create a database if no database exists:

    CREATE DATABASE IF NOT EXISTS load_test;
    USE load_test;
  4. Run the following command to create a table:

    CREATE TABLE insert_wiki_edit
    (
        event_time DATETIME,
        channel VARCHAR(32) DEFAULT '',
        user VARCHAR(128) DEFAULT '',
        is_anonymous TINYINT DEFAULT '0',
        is_minor TINYINT DEFAULT '0',
        is_new TINYINT DEFAULT '0',
        is_robot TINYINT DEFAULT '0',
        is_unpatrolled TINYINT DEFAULT '0',
        delta INT SUM DEFAULT '0',
        added INT SUM DEFAULT '0',
        deleted INT SUM DEFAULT '0'
    )
    AGGREGATE KEY(event_time, channel, user, is_anonymous, is_minor, is_new, is_robot, is_unpatrolled)
    PARTITION BY RANGE(event_time)
    (
        PARTITION p06 VALUES LESS THAN ('2015-09-12 06:00:00'),
        PARTITION p12 VALUES LESS THAN ('2015-09-12 12:00:00'),
        PARTITION p18 VALUES LESS THAN ('2015-09-12 18:00:00'),
        PARTITION p24 VALUES LESS THAN ('2015-09-13 00:00:00')
    )
    DISTRIBUTED BY HASH(user) BUCKETS 10
    PROPERTIES("replication_num" = "1");
  5. Run the following command to import test data:

    INSERT INTO insert_wiki_edit VALUES("2015-09-12 00:00:00","#en.wikipedia","GELongstreet",0,0,0,0,0,36,36,0),("2015-09-12 00:00:00","#ca.wikipedia","PereBot",0,1,0,1,0,17,17,0);
  6. Run the following command to query the test data:

    select * from insert_wiki_edit;

    The following information is returned:

    +---------------------+---------------+--------------+--------------+----------+--------+----------+----------------+-------+-------+---------+
    | event_time          | channel       | user         | is_anonymous | is_minor | is_new | is_robot | is_unpatrolled | delta | added | deleted |
    +---------------------+---------------+--------------+--------------+----------+--------+----------+----------------+-------+-------+---------+
    | 2015-09-12 00:00:00 | #en.wikipedia | GELongstreet |            0 |        0 |      0 |        0 |              0 |    36 |    36 |       0 |
    | 2015-09-12 00:00:00 | #ca.wikipedia | PereBot      |            0 |        1 |      0 |        1 |              0 |    17 |    17 |       0 |
    +---------------------+---------------+--------------+--------------+----------+--------+----------+----------------+-------+-------+---------+