Alibaba Cloud Elastic Compute Service (ECS) provides a variety of instance families for different cloud scenarios. This topic describes how to use the Standard Performance Evaluation Corporation, Integer (SPECInt) benchmark suite to test the computing performance of Linux and Windows ECS instances. In the examples, the g7 general-purpose instance family, c7 compute-optimized instance family, and r7 memory-optimized instance family are used.
Description of test results
In this topic, the example benchmark scores provided are calculated by running the SPEC CPU® 2017 suite on the tested instance types. The instance types are tested 10 times in total based on the performance benchmarks in the benchmark suite. Then, the average scores and standard deviations of the 10 tests are calculated. In these examples, SPECrate® 2017 Integer is used. When you perform the test, the number of vCPUs in the ECS instances is the same as the number of copies, which is the value of the copies parameter. You can run multiple copies on the instances based on the performance benchmarks in SPECrate® 2017 Integer. A higher score indicates a higher throughput per unit of time.
- To obtain the SPEC benchmark suite, visit SPEC CPU® 2017.
- For more information about instance types, see Instance families.
- For more information about how to test the computing performance of ECS instances, see Computing performance stress testing for instances.
- The test results are updated every six months.
The following table compares the testing environments of Linux and Windows Server operating systems used in the tests.
| Item | Linux | Windows Server |
|---|---|---|
| Service provider | Alibaba Cloud | |
| Compiler | gcc v7.3.0 | Intel C++ Compiler (ICC) |
| SPEC tool | SPEC CPU® 2017 (version: 1.0.5) | |
| Benchmark suite | SPECrate ®2017 Integer | |
| Alibaba Cloud image | centos_7_04_64_20G_alibase_201701015.vhd | win2016_1607_x64_dtc_en-us_40G_alibase_20211217.vhd |
| CPU model of tested instance | Intel ® Xeon ® Platinum 8369B | |
Test results
The ecs.g7.32xlarge, ecs.c7.32xlarge, and ecs.r7.32xlarge instance types are configured with the non-uniform memory access (NUMA) architecture. When the computing performance of Windows instances of these instance types is tested, the test results are optimized based on NUMA.
- g7, general-purpose instance family
Table 1. Test results of the Linux g7 instance family Instance type vCPUs Memory (GiB) Tests Average speed Standard deviation ecs.g7.large 2 8 10 5.8186 0.0069 ecs.g7.xlarge 4 16 10 11.1766 0.0431 ecs.g7.2xlarge 8 32 10 21.6673 0.0839 ecs.g7.3xlarge 12 48 10 32.2675 0.1046 ecs.g7.4xlarge 16 64 10 42.3126 0.0933 ecs.g7.6xlarge 24 96 10 61.2287 0.0781 ecs.g7.8xlarge 32 128 10 78.9842 0.1101 ecs.g7.16xlarge 64 256 10 130.2915 0.2380 ecs.g7.32xlarge 128 512 10 249.9570 0.2525 Table 2. Test results of the Windows g7 instance family Instance type vCPUs Memory (GiB) Tests Average speed Standard deviation ecs.g7.large 2 8 10 7.4637 0.0019 ecs.g7.xlarge 4 16 10 14.5434 0.0081 ecs.g7.2xlarge 8 32 10 28.2745 0.0337 ecs.g7.3xlarge 12 48 10 41.6595 0.0541 ecs.g7.4xlarge 16 64 10 54.4861 0.0606 ecs.g7.6xlarge 24 96 10 79.4152 0.1140 ecs.g7.8xlarge 32 128 10 102.7128 0.1058 ecs.g7.16xlarge 64 256 10 168.1141 0.1498 ecs.g7.32xlarge 128 512 10 308.5300 6.1720 - c7, compute-optimized instance family
Table 3. Test results of the Linux c7 instance family Instance type vCPUs Memory (GiB) Tests Average speed Standard deviation ecs.c7.large 2 4 10 5.8411 0.0107 ecs.c7.xlarge 4 8 10 11.0014 0.0240 ecs.c7.2xlarge 8 16 10 21.7460 0.0430 ecs.c7.3xlarge 12 24 10 31.8608 0.0689 ecs.c7.4xlarge 16 32 10 41.6846 0.0611 ecs.c7.6xlarge 24 48 10 60.3827 0.6099 ecs.c7.8xlarge 32 64 10 77.9913 0.1101 ecs.c7.16xlarge 64 128 10 123.5306 0.1050 ecs.c7.32xlarge 128 256 10 247.0297 0.2739 Table 4. Test results of the Windows c7 instance family Instance type vCPUs Memory (GiB) Tests Average speed Standard deviation ecs.c7.large 2 4 10 7.3802 0.0169 ecs.c7.xlarge 4 8 10 14.5096 0.0233 ecs.c7.2xlarge 8 16 10 28.1013 0.9569 ecs.c7.3xlarge 12 24 10 41.7500 0.1573 ecs.c7.4xlarge 16 32 10 54.6235 0.1615 ecs.c7.6xlarge 24 48 10 79.6197 0.0228 ecs.c7.8xlarge 32 64 10 103.2759 0.2285 ecs.c7.16xlarge 64 128 10 170.0403 1.3272 ecs.c7.32xlarge 128 256 10 317.7099 4.7920 - r7, memory-optimized instance family
Table 5. Test results of the Linux r7 instance family Instance type vCPUs Memory (GiB) Tests Average speed Standard deviation ecs.r7.large 2 16 10 5.5738 0.0487 ecs.r7.xlarge 4 32 10 11.3001 0.0458 ecs.r7.2xlarge 8 64 10 21.8778 0.0599 ecs.r7.3xlarge 12 96 10 32.2260 0.0605 ecs.r7.4xlarge 16 128 10 41.9806 0.1457 ecs.r7.6xlarge 24 192 10 61.0157 0.0980 ecs.r7.8xlarge 32 256 10 78.4831 0.1109 ecs.r7.16xlarge 64 512 10 129.1414 0.1103 ecs.r7.32xlarge 128 1024 10 251.0140 0.2683 Table 6. Test results of the Windows r7 instance family Instance type vCPUs Memory (GiB) Tests Average speed Standard deviation ecs.r7.large 2 16 10 7.3204 0.0426 ecs.r7.xlarge 4 32 10 14.5137 0.0371 ecs.r7.2xlarge 8 64 10 27.5150 0.3057 ecs.r7.3xlarge 12 96 10 40.8867 0.2269 ecs.r7.4xlarge 16 128 10 53.9508 0.1899 ecs.r7.6xlarge 24 192 10 78.6178 0.1303 ecs.r7.8xlarge 32 256 10 102.0341 0.1252 ecs.r7.16xlarge 64 512 10 164.1658 0.1881 ecs.r7.32xlarge 128 1024 10 307.3209 1.7847