Gather trace Trace statistics Replay trace Record result and analyze
Links--trace
1. 2. 3.
/storage/ /SSP/
Bonnie++
>bonnie++ -d /global/oradata -s 8192 -m d2org -u oracle Version 1.03 ------Sequential Output------ --Sequential Input- --Random-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP d2org 8G 15681 55 26302 23 13877 31 26420 91 88215 49 462.6 5 ------Sequential Create------ --------Random Create-------Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 1245 10 +++++ +++ 3541 27 2837 21 +++++ +++ 385 3 d2org,8G,15681,55,26302,23,13877,31,26420,91,88215,49,462.6,5,16,1245,10,+++ ++,+++,3541,27,2837,21,+++++,+++,385,3
Synthetic benchmark
Iozone, Iometer, Bonnie++, Postmahmark
TPC-C, TPC-H, Spec SFS97, SPEC WEB99, SPEC SDM, etc.
Iozone
A benchmark for testing file I/O performance: Read, write, re-read, re-write, read backwards, read strided, fread, fwrite, random read/write, pread/pwrite variants, aio_read, aio_write, mmap Examples of running Iozone ./iozone -s 2g -i0 -i1 -i2 -f /mnt/test -Rab 20040619-2g_1_1_1_1m.xls
Iozone
Command line options
-a Used to select full automatic mode. Produces output that covers all tested file operations for record sizes of 4k to 16M for file sizes of 64k to 512M. -b filename Iozone will create a binary file format file in Excel compatible output of results. -f filename Used to specify the filename for the temporary file under test. -i # Used to specify which tests to run. (0=write/rewrite, 1=read/reread, 2=random-read/write, …) -s # Used to specify the size, in Kbytes, of the file to test. -R Generate Excel report.
Zhongying Niu niel@
Agenda
Benchmark
Macro-benchmark Micro-benchmark
Trace-driven benchmark Monitor tools Performance comparison
Macro-benchmark
Iometer
An I/O subsystem measurement and characterization tool for single and clustered systems. Both a workload generator and a measurement tool. Iometer consists of two programs, Iometer and Dynamo.
Monitor tools
Ethereal Vmstat Iostat Netstat …
Iometer
Bonnie++
Usage: bonnie++ [-d scratch-dir] [-s size(Mb)[:chunksize(b)]] [-n number-to-stat[:max-size[:minsize][:num-directories]]] [-m machine-name] [-r ram-size-in-Mb] [-x number-of-tests] [-u uid-touse:gid-to-use] [-g gid-to-use] [-q] [-f] [-b] [-p processes | -y] Examples of running Bonnie++ bonnie++ -d /global/oradata –m sun3510 –s 2048 –r 1024
Iometer is the controlling program. Dynamo is the workload generator.
Iometer
Iometer can be used for measurement and characterization of:
Performance of disk and network controllers. Bandwidth and latency capabilities of buses. Network throughput to attached drives. Shared bus performance. System-level hard drive performance. System-level network performance.
Postmark
To simulate heavy small-file system loads PostMark was designed to create a large pool of continually changing files and to measure the transaction rates for a workload approximating a large Internet email server PostMark configuration parameters: The number of files created: 500 Files range: between 500 bytes and 9.77 kilobytes in size The number of transactions: 500/per file Block sizes for reads and writes: 512 bytes …
Micro-benchmark
per operation latency, completion time common operations: creat, link, rename, chmod, stat, access, write and mkdir, etc.
Trace-driven benchmark