MaxCompute:TPC-DS performance testing

Preparations

1. Prepare an environment.

   • Before you perform a TPC-DS test, activate MaxCompute and create a project. For more information, see Create a project.

   • Activate MaxCompute Query Acceleration (MCQA) for a subscription MaxCompute project. For more information, see MaxCompute Query Acceleration.

2. Prepare a test tool.

   MaxCompute provides a TPC-DS automated performance test tool to help you quickly complete a TPC-DS test and automatically generate test results.

   Important

   The test tool can be used only in Linux in which a Java Development Kit (JDK) of 1.7 or later is installed.

   You can click mc_tpcds_benchmark to download the package of the test tool and run the following command on the Linux server to decompress the package:

   unzip mc_tpcds_benchmark.zip

   The following code shows the directory structure of the decompressed file.

   .
   |_t1c7039e3-2a1d-451b-bfda-d14c49016243-tpc-ds-tool.zip
   |_config
   |_init_tools.sh
   |_load_table.sh
   |_logs
   |_odps_clt
   |_patches
   |_pt.sh
   |_queries_1
   |_queries_1.quality
   |_queries_10
   |_queries_100
   |_queries_1000
   |_queries_10000
   |_queries_100000
   |_querygen.sh
   |_results
   |_run_stream.sh
   |_run_stream.sh.offline
   |_sqls
   |_start_session_only.sh
   |_start_session.sql
   |_start_session.sql_tmp
   |_tools_file
   |_tt.sh
   |_v2.10.1rc3

3. Obtain a test dataset.

   MaxCompute provides public datasets. You do not need to prepare test data. All test data is stored in the public project BIGDATA_PUBLIC_DATASET of MaxCompute. For more information, see Overview.

   TPC-DS test datasets are divided into 10 GB, 100 GB, 1 TB, and 10 TB datasets based on the data size. The following table describes the datasets.

   Type	Description	Dataset name	Schema name
   TPC-DS	TPC-DS is a decision support benchmark that models several generally applicable aspects of a decision support system, including queries and data maintenance. TPC-DS enables emerging technologies, such as big data systems, to perform benchmark tests.	TPC-DS 10-GB performance test dataset TPC-DS 100-GB performance test dataset TPC-DS 1-TB performance test dataset TPC-DS 10-TB performance test dataset	tpcds_10g tpcds_100g tpcds_1t tpcds_10t

Procedure

nohup sh pt.sh > pt.log 2>&1 &

tail -f pt.log

Test result references

The following table provides the TPC-DS 1-TB performance test result for subscription MaxCompute projects that use 64 compute units (CUs) and 128 CUs.

The following table describes the test result of each query.