Adolph
Engineer
Engineer
  • UID623
  • Fans2
  • Follows1
  • Posts72
Reads:841Replies:0

[MySQL]Test RocksDB for RDS

Created#
More Posted time:Nov 16, 2016 13:44 PM
RocksDB for RDS
Recently we integrated MyRocks to our RDS MySQL 5.6 branch and RDS 5616 has another storage engine - RocksDB.
This article makes a comparison test on the RocksDB of RDS MySQL 5.6 with InnoDB and TokuDB.
Test environment
Host configuration:
CPU: Intel(R) Xeon(R) CPU E5-2682 v4 @ 2.50GHz
OS kernel: Linux 2.6.32
Memory: 512 G
Disk: SSD
Testing method and parameter setting
The test adopts the Sysbench tool.
Main parameters of Sysbench:
--max-requests=1000000
--max-time=200
--oltp_tables_count=20
--oltp_table_size=200000
--report-interval=10


MySQL parameters
#SQL layer
sync_binlog=1
gtid_mode=on
master_info_repository=table
relay_log_info_repository=table

#InnoDB uncompressed
innodb_buffer_pool_size=12G
innodb_flush_log_at_trx_commit=1


#TokuDB zlib compressed by default
tokudb_cache_size=12G
tokudb_fsync_log_period=1000

#rocksdb
rocksdb_max_open_files=-1
rocksdb_base_background_compactions=1
rocksdb_max_background_compactions=8
rocksdb_max_total_wal_size=4G
rocksdb_max_background_flushes=4
rocksdb_block_size=16384
rocksdb_block_cache_size=12G
rocksdb_lock_wait_timeout=2
rocksdb_default_cf_options=write_buffer_size=128m;target_file_size_base=32m;max_bytes_for_level_base=512m;level0_file_num_compaction_trigger=4;level0_slowdown_writes_trigger=10;level0_stop_writes_trigger=15;max_write_buffer_number=4;compression_per_level=kNoCompression:kNoCompression:kNoCompression:kZlibCompression:kZlibCompression:kZlibCompression:kZlibCompression;compression_opts=-14:6:0;block_based_table_factory={cache_index_and_filter_blocks=1;filter_policy=bloomfilter:10:false;whole_key_filtering=0};prefix_extractor=capped:12;level_compaction_dynamic_level_bytes=true;optimize_filters_for_hits=true


Performance test results:
insert.lua

update_non_index.lua
select.lua


oltp.lua



Compression test and results
The data is contributed by third-party scientific and research data sets. The SQL file is 207 GB.
Import: InnoDB (uncompressed) 312 GB, TokuDB (zlib compressed) 61 GB and RocksDB (zlib compressed) 56 GB.
Compression performance by RocksDB is improved by around 10% over TokuDB.
Guest