Re: StarWind iSCSI SAN V5.7 Build 20110524
Posted: Fri May 27, 2011 1:24 pm
The delayed ACK is turned off on the ESX servers.
This is an SQLIO on one of the StarWind servers not using file or disk cache to the 24 drive 7.2K RAID 60:
C:\Program Files (x86)\SQLIO>sqlio -kW -BN -o64 -fsequential -b64 -Fparam.txt
sqlio v1.5.SG
parameter file used: param.txt
file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 30 secs to file e:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to not use file nor disk caches (as is SQL Server)
size of file e:\testfile.dat needs to be: 4194304000 bytes
current file size: 1048576000 bytes
need to expand by: 3145728000 bytes
expanding e:\testfile.dat ... done.
using specified size: 4000 MB for file: e:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 13099.62
MBs/sec: 818.72
This is it with caching turned on:
C:\Program Files (x86)\SQLIO>sqlio -kW -BY -o64 -fsequential -b64 -Fparam.txt
sqlio v1.5.SG
parameter file used: param.txt
file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 30 secs to file e:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use both file and disk caches
using specified size: 4000 MB for file: e:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 82755.73
MBs/sec: 5172.23
Without cache to 40 drive 15K RAID 60:
C:\Program Files (x86)\SQLIO>sqlio -kW -BN -o64 -fsequential -b64 -Fparam.txt
sqlio v1.5.SG
parameter file used: param.txt
file f:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 30 secs to file f:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to not use file nor disk caches (as is SQL Server)
size of file f:\testfile.dat needs to be: 4194304000 bytes
current file size: 0 bytes
need to expand by: 4194304000 bytes
expanding f:\testfile.dat ... done.
using specified size: 4000 MB for file: f:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 18956.30
MBs/sec: 1184.76
With cache to 40 drive 15K RAID 60:
C:\Program Files (x86)\SQLIO>sqlio -kW -BY -o64 -fsequential -b64 -Fparam.txt
sqlio v1.5.SG
parameter file used: param.txt
file f:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 30 secs to file f:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use both file and disk caches
using specified size: 4000 MB for file: f:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 82983.90
MBs/sec: 5186.49
I'm going to have to do some reconfiguring to test a non virtual system with 10GbE iSCSI HA writes and don't think I have time to get that done today.
This is an SQLIO on one of the StarWind servers not using file or disk cache to the 24 drive 7.2K RAID 60:
C:\Program Files (x86)\SQLIO>sqlio -kW -BN -o64 -fsequential -b64 -Fparam.txt
sqlio v1.5.SG
parameter file used: param.txt
file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 30 secs to file e:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to not use file nor disk caches (as is SQL Server)
size of file e:\testfile.dat needs to be: 4194304000 bytes
current file size: 1048576000 bytes
need to expand by: 3145728000 bytes
expanding e:\testfile.dat ... done.
using specified size: 4000 MB for file: e:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 13099.62
MBs/sec: 818.72
This is it with caching turned on:
C:\Program Files (x86)\SQLIO>sqlio -kW -BY -o64 -fsequential -b64 -Fparam.txt
sqlio v1.5.SG
parameter file used: param.txt
file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 30 secs to file e:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use both file and disk caches
using specified size: 4000 MB for file: e:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 82755.73
MBs/sec: 5172.23
Without cache to 40 drive 15K RAID 60:
C:\Program Files (x86)\SQLIO>sqlio -kW -BN -o64 -fsequential -b64 -Fparam.txt
sqlio v1.5.SG
parameter file used: param.txt
file f:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 30 secs to file f:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to not use file nor disk caches (as is SQL Server)
size of file f:\testfile.dat needs to be: 4194304000 bytes
current file size: 0 bytes
need to expand by: 4194304000 bytes
expanding f:\testfile.dat ... done.
using specified size: 4000 MB for file: f:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 18956.30
MBs/sec: 1184.76
With cache to 40 drive 15K RAID 60:
C:\Program Files (x86)\SQLIO>sqlio -kW -BY -o64 -fsequential -b64 -Fparam.txt
sqlio v1.5.SG
parameter file used: param.txt
file f:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 30 secs to file f:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use both file and disk caches
using specified size: 4000 MB for file: f:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 82983.90
MBs/sec: 5186.49
I'm going to have to do some reconfiguring to test a non virtual system with 10GbE iSCSI HA writes and don't think I have time to get that done today.
Bohdan (staff) wrote:Is it possible to perform the tests with SQLIO and iometer (64K, 64 outstanding, 8 or 16 threads/workers)?
On 10Gb cards (Intel AT) we are observing 70% sync channel utilization and 850MB/s. The difference is that we are running the tests on the physical machine but not the virtual one.
And one more question: have you tried to enable/disable delayed ACK option on the ESX side?
http://www.starwindsoftware.com/forums/ ... 98-15.html