天天看點

sysbench 基準測試簡介   《sysbench安裝、使用、結果解讀》

1.簡介

sysbench是一款開源的多線程性能測試工具,可以執行CPU/記憶體/線程/IO/資料庫等方面的性能測試。資料庫目前支援MySQL/Oracle/PostgreSQL。本文隻是簡單示範一下幾種測試的用法,後續準備利用sysbench來對MySQL進行一系列的測試。具體的一些參數設定,需要根據不同的測試要求來進行調整。

2.安裝

#安裝yum包及配置環境變量
yum -y install bzr libtool 
wget http://imysql.com/wp-content/uploads/2014/09/sysbench-0.4.12-1.1.tgz
echo 'export LD_LIBRARY_PATH=/Data/apps/mysql/lib' >> /etc/profile
source /etc/profile

# 安裝sysbench
mkdir -p /Data/apps/sysbench
mkdir -p /Data/apps/sysbench/log
tar -zxvf sysbench-0.4.12-1.1.tgz
cd sysbench-0.4.12-1.1
./autogen.sh
./configure --prefix=/Data/apps/sysbench --with-mysql-includes=/Data/apps/mysql/include --with-mysql-libs=/Data/apps/mysql/lib
make && make install
cp /Data/apps/sysbench/bin/sysbench /usr/local/bin/

# /Data/package/sysbench-0.4.12-1.1為安裝包目錄
cp -a /Data/package/sysbench-0.4.12-1.1/sysbench/tests /Data/apps/sysbench/
           

3.測試

  3.1 Mysql資料庫測試

mysql > create database sbtest;
    sysbench --mysql-host=127.0.0.1 --mysql-port=3306 --mysql-user=root --mysql-password='' --test=/Data/apps/sysbench/tests/db/oltp.lua --oltp_tables_count=10 --oltp-table-size=100000 --rand-init=on prepare      

# --test=tests/db/oltp.lua 表示調用 tests/db/oltp.lua 腳本進行 oltp 模式測試

# --oltp_tables_count=10 表示會生成 10 個測試表

# --oltp-table-size=100000 表示每個測試表資料行數

# --rand-init=on 表示每個測試表都是用随機資料來填充的

sysbench --mysql-host=127.0.0.1 --mysql-port=3306 --mysql-user=root --mysql-password='' --test=/Data/apps/sysbench/tests/db/oltp.lua --oltp_tables_count=10 --oltp-table-size=10000000 --num-threads=8 --oltp-read-only=off --report-interval=10 --rand-type=uniform --max-time=120 --max-requests=0 --percentile=99 run >> /Data/apps/sysbench/log/sysbench_oltp.log      

# --num-threads=8 表示發起 8個并發連接配接

# --oltp-read-only=off 表示不要進行隻讀測試,也就是會采用讀寫混合模式測試

# --report-interval=10 表示每10秒輸出一次測試進度報告

# --rand-type=uniform 表示随機類型為固定模式,其他幾個可選随機模式:uniform(固定),gaussian(高斯),special(特定的),pareto(帕累托)

# --max-time=120 表示最大執行時長為 120秒

# --max-requests=0 表示總請求數為 0,因為上面已經定義了總執行時長,是以總請求數可以設定為 0;也可以隻設定總請求數,不設定最大執行時長

# --percentile=99 表示設定采樣比例,預設是 95%,即丢棄1%的長請求,在剩餘的99%裡取最大值

==========================測試結果解讀如下==========================

sysbench 0.5:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 8
Report intermediate results every 10 second(s)
Random number generator seed is 0 and will be ignored

Threads started!


[  10s] threads: 8, tps: 26.60, reads/s: 410.22, writes/s: 115.11, response time: 1050.29ms (99%)
[  20s] threads: 8, tps: 32.40, reads/s: 462.00, writes/s: 131.60, response time: 699.68ms (99%)
[  30s] threads: 8, tps: 33.00, reads/s: 467.60, writes/s: 133.20, response time: 496.50ms (99%)
[  40s] threads: 8, tps: 30.80, reads/s: 441.00, writes/s: 125.30, response time: 617.02ms (99%)
[  50s] threads: 8, tps: 35.80, reads/s: 504.00, writes/s: 143.80, response time: 526.03ms (99%)
[  60s] threads: 8, tps: 33.20, reads/s: 468.50, writes/s: 133.30, response time: 774.87ms (99%)
                                        .........
[3540s] threads: 8, tps: 41.90, reads/s: 602.00, writes/s: 170.90, response time: 483.88ms (99%)
[3550s] threads: 8, tps: 43.40, reads/s: 616.00, writes/s: 175.40, response time: 383.69ms (99%)
[3560s] threads: 8, tps: 38.00, reads/s: 543.20, writes/s: 154.40, response time: 475.41ms (99%)
[3570s] threads: 8, tps: 39.60, reads/s: 560.00, writes/s: 159.60, response time: 425.82ms (99%)
[3580s] threads: 8, tps: 42.10, reads/s: 600.60, writes/s: 170.80, response time: 384.04ms (99%)
[3590s] threads: 8, tps: 38.10, reads/s: 547.40, writes/s: 155.40, response time: 542.17ms (99%)
[3600s] threads: 8, tps: 40.40, reads/s: 574.00, writes/s: 163.40, response time: 459.05ms (99%)
OLTP test statistics:
    queries performed:
        read:                            2068584    -- 讀總數
        write:                           588759      -- 寫總數
        other:                           293247	-- 其他操作總數(SELECT、INSERT、UPDATE、DELETE之外的操作,例如COMMIT等)
        total:                           2950590	-- 全部總數
    transactions:                        145491 (40.41 per sec.)		-- 總事務數(每秒事務數)
    deadlocks:                           2265   (0.63 per sec.)		-- 發生死鎖總數
    read/write requests:                 	2657343 (738.12 per sec.)	-- 讀寫總數(每秒讀寫次數)
    other operations:                    	293247 (81.45 per sec.)		-- 其他操作總數(每秒其他操作次數)


General statistics:
    total time:                          3600.1452s	-- 總耗時
    total number of events:              	145491		-- 共發生多少事務數
    total time taken by event execution: 		28800.5977s	-- 所有事務耗時相加(不考慮并行因素)
    response time:
         min:                                 49.84ms	-- 最小耗時
         avg:                                197.95ms	-- 平均耗時
         max:                               1355.40ms	-- 最長耗時
         approx.  99 percentile:             	433.54ms	-- 超過99%平均耗時


Threads fairness:
    events (avg/stddev):           18186.3750/63.14
    execution time (avg/stddev):   3600.0747/0.04      

 3.2 CPU測試

   sysbench CPU測試使用64位整數,測試計算素數直到某個最大值所需要的時間

shell> sysbench --test=cpu --cpu-max-prime=2000 run
sysbench 0.5:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 1
Random number generator seed is 0 and will be ignored


Primer numbers limit: 2000

Threads started!


Test execution summary:
    total time:                          2.2452s
    total number of events:              10000
    total time taken by event execution: 2.2347s
    per-request statistics:
         min:                                  0.20ms
         avg:                                  0.22ms
         max:                                  3.35ms
         approx.  95 percentile:               0.27ms

Threads fairness:
    events (avg/stddev):           10000.0000/0.00
    execution time (avg/stddev):   2.2347/0.00

補充:
檢視CPU資訊方法
檢視實體cpu個數
 grep "physical id" /proc/cpuinfo | sort -u | wc -l
檢視核心數量
 grep "core id" /proc/cpuinfo | sort -u | wc -l
檢視線程數量
 grep "processor" /proc/cpuinfo | sort -u | wc -l

在sysbench的測試中,--num-threads取值為"線程數量"即可      

  3.3 線程(thread)測試

   測試線程排程器的性能。對于高負載情況下測試線程排程器的行為非常有用

shell> sysbench --test=threads --num-threads=64 --thread-yields=100 --thread-locks=2 run
sysbench 0.5:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 64
Random number generator seed is 0 and will be ignored


Threads started!


Test execution summary:
    total time:                          1.9581s
    total number of events:              10000
    total time taken by event execution: 124.8938s
    per-request statistics:
         min:                                  0.05ms
         avg:                                 12.49ms
         max:                                151.15ms
         approx.  95 percentile:              50.83ms

Threads fairness:
    events (avg/stddev):           156.2500/14.48
    execution time (avg/stddev):   1.9515/0.00      

  3.4 檔案IO性能測試

  • 生成需要的測試檔案,檔案總大小5G,16個并發線程。執行完後會在目前目錄下生成一堆小檔案。
shell> sysbench --test=fileio --num-threads=16 --file-total-size=5G prepare      
  • 執行測試,指定随機讀寫模式

指定讀寫模式:

  1. seqwr 順序寫入
  2. seqrewr 順序重寫
  3. seqrd 順序讀取
  4. rndrd 随機讀取
  5. rndwr 随機寫入
  6. rndrw 混合随機讀/寫
shell> sysbench --test=fileio --num-threads=16 --init-rng=on --file-total-size=5G --file-test-mode=rndrw run
sysbench 0.5:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 16
Random number generator seed is 0 and will be ignored


Threads started!

Operations performed:  5999 reads, 4001 writes, 12800 Other = 22800 Total
Read 93.734Mb  Written 62.516Mb  Total transferred 156.25Mb  (9.2561Mb/sec)   ##吞吐量
  592.39 Requests/sec executed

Test execution summary:
    total time:                          16.8808s
    total number of events:              10000
    total time taken by event execution: 176.1816s
    per-request statistics:
         min:                                  0.01ms
         avg:                                 17.62ms
         max:                                416.73ms
         approx.  95 percentile:             104.82ms

Threads fairness:
    events (avg/stddev):           625.0000/62.39
    execution time (avg/stddev):   11.0114/0.67      
  • 清除測試檔案
shell> sysbench --test=fileio --num-threads=16 --file-total-size=5G cleanup      

  3.5 互斥鎖(Mutex)測試

   測試互斥鎖的性能,方式是模拟所有線程在同一時刻并發運作,并都短暫請求互斥鎖。

shell> sysbench --test=mutex --num-threads=16 --mutex-num=1024 --mutex-locks=10000 --mutex-loops=5000 run
sysbench 0.5:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 16
Random number generator seed is 0 and will be ignored


Threads started!


Test execution summary:
    total time:                          0.0135s
    total number of events:              16
    total time taken by event execution: 0.0411s
    per-request statistics:
         min:                                  0.70ms
         avg:                                  2.57ms
         max:                                  9.19ms
         approx.  95 percentile:               9.16ms

Threads fairness:
    events (avg/stddev):           1.0000/0.00
    execution time (avg/stddev):   0.0026/0.00      

  3.6 記憶體測試

   記憶體測試測試了記憶體的連續讀寫性能。

shell> sysbench --test=memory --num-threads=16 --memory-block-size=8192 --memory-total-size=1G run
sysbench 0.5:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 16
Random number generator seed is 0 and will be ignored


Threads started!

Operations performed: 131072 (381158.38 ops/sec)

1024.00 MB transferred (2977.80 MB/sec)       ##吞吐量


Test execution summary:
    total time:                          0.3439s
    total number of events:              131072
    total time taken by event execution: 3.9915s
    per-request statistics:
         min:                                  0.00ms
         avg:                                  0.03ms
         max:                                 51.02ms
         approx.  95 percentile:               0.00ms  ##大約95%的時間分布

Threads fairness:
    events (avg/stddev):           8192.0000/1166.77
    execution time (avg/stddev):   0.2495/0.02      

相關參考:

  《sysbench安裝、使用、結果解讀》

  《sysbench 0.5 基準測試》