Page 1 of 1

2-node cluster - low storage performance

Posted: Sun Jan 31, 2021 5:34 pm
by primo
Hello,

we have configured a 2-node cluster according to the manuals, but the storage performance seems to be lower than expected (when copying files, we get sometimes 250 MB/s and sometimes much lower speeds).

Here is an example, when we start copying we get 200 MB/s+ and after a while we are at 40 MB/s.
copy.PNG
copy.PNG (95.25 KiB) Viewed 6222 times
This is our storage config (each host):

HDD: 4x 2.4TB 10K SAS
Hardware RAID (1 GB BBWC)
- RAID type: RAID 10
- Disk cache policy: Disabled
- Write policy: Write-back
- Read policy: Read-ahead
- Stripe Size: 64K

The vHDDs inside VSA appliances are thick provision eager zeroed and Heartbeat/iSCSI and Sync networks are 10GbE with jumbo frames enabled.

Device settings:
ds1.png
ds1.png (24.58 KiB) Viewed 6224 times
ds2.png
ds2.png (18.47 KiB) Viewed 6224 times
Is there anything else we can do to improve storage performance?
Would changing the VSA VM performance profile make a difference?

Thanks!

Best Regards,
primo

Re: 2-node cluster - low storage performance

Posted: Mon Feb 01, 2021 4:19 am
by yaroslav (staff)
Welcome to StarWind Forum. That's the known issue of SMB data transfer in Windows Server (see the workaround here https://docs.microsoft.com/en-us/window ... e-transfer).
May I ask about the bandwidth of the Management link (data is likely to be copied over it)?

Re: 2-node cluster - low storage performance

Posted: Mon Feb 01, 2021 10:47 am
by primo
Hello,

thank you! The Management link is 1Gb/s, while the Heartbeat/iSCSI/vMotion and Synchronization links are 10 Gb/s.

10.20.10.0/24 = Mgmt
172.16.10.0/24 = Heartbeat/iSCSI/vMotion
172.16.20.0/24 = Sync
sync.PNG
sync.PNG (31.17 KiB) Viewed 6206 times
Best Regards!

Re: 2-node cluster - low storage performance

Posted: Mon Feb 01, 2021 12:05 pm
by primo
I've performed another test - I've added two 20 GB drives to a VM. The first was located on a "StarWind" datastore, the other was directly on the VMware's datastore.
Native.PNG
Native.PNG (136.84 KiB) Viewed 6204 times
StarWind.PNG
StarWind.PNG (135.29 KiB) Viewed 6204 times

Re: 2-node cluster - low storage performance

Posted: Mon Feb 01, 2021 12:19 pm
by yaroslav (staff)
primo wrote:The Management link is 1Gb/s, while the Heartbeat/iSCSI/vMotion and Synchronization links are 10 Gb/s.
Copying most probably is done over 1 Gbps link

Use a larger file, please. Run tests using diskspd as described here https://www.starwindsoftware.com/best-p ... practices/.

Re: 2-node cluster - low storage performance

Posted: Mon Feb 01, 2021 9:12 pm
by primo
I've checked, but the management link is not being used (see the ~300 MB/s (+-50 MB/s) limit in both tests.
Capture5.PNG
Capture5.PNG (247.68 KiB) Viewed 6189 times
What I find quite interesting is the huge difference when using small I/O sizes (16 KB :o)

Re: 2-node cluster - low storage performance

Posted: Wed Feb 03, 2021 9:01 pm
by yaroslav (staff)
Is it possible to connect the underlying storage as RDM disk or PCI device?