Page 1 of 1
vSAN on a single bare metal server?
Posted: Fri Feb 16, 2024 7:10 pm
by LT286
Hi guys,
I am new to this so please pardon me if my questions look stupid or naïve.
I have one bare metal DELL R750 server that I have to set up mimicking a data center with a server, an HPC and storage nodes. I use OL8 as KVM hypervisor that runs two OL8 guest VMs for server and HPC, and I was thinking to use Starwind vSAN to control two RAID arrays that both should be accessible to both VMs. These RAIDs physically are parts of the BM machine.
All setup documents that are available on the SW website are speaking entirely about high availability, complex networking, etc. In my case none of these things are applicable. Does anyone know if the Starwind vSAN free appliance can be used in my single rack server setup? Where can I read about such setup if it is possible?
Thank you!
Re: vSAN on a single bare metal server?
Posted: Fri Feb 16, 2024 7:31 pm
by yaroslav (staff)
Welcome to StarWind Forum.
Yes, you can use StarWind VSAN as an iSCSI-connected (soon NVMe-oF-connected) storage array!
Feel free to contact me if you have more questions.
Re: vSAN on a single bare metal server?
Posted: Mon Mar 10, 2025 1:46 am
by vertigomike
In same boat here. I've trying to connect a 740xd that i've installed Starwinds on. That portion is fine. On the vsan box I've got a single nic for management and two interfaces in two separate subnets that i have setup for data. I'm trying to ensure the actual iscsi traffic goes over the data interfaces. trying to initiate the iscsi though if i point to interface on the data interfaces it finds nothing but finds the initiator if i point to the mgt interface. Trying to figure out what I'm missing or not understanding here.
Re: vSAN on a single bare metal server?
Posted: Mon Mar 10, 2025 5:15 am
by yaroslav (staff)
Firewall rules and Access rights. If the client host is ESXi, see if there is any port binding.
Re: vSAN on a single bare metal server?
Posted: Mon Mar 10, 2025 3:10 pm
by vertigomike
It's a proxmox cluster. i didn't have any luck pointing it to the data interface IPs but it would point to the mgt interfaces. I assume its using that as the transfer is super slow. Difference in 1g interface vs 2 40g interfaces.
Re: vSAN on a single bare metal server?
Posted: Mon Mar 10, 2025 3:54 pm
by vertigomike
I figured out my issue. apparently when I added the two new VSAN vlans i setup i neglected to add them into my OSPF config on switch so the interfaces weren't reachable from the PVE servers. Once I updated it looks like its gonna work now. I just need to get rid of the old target address.
Re: vSAN on a single bare metal server?
Posted: Mon Mar 10, 2025 4:05 pm
by yaroslav (staff)
Hi,
I am very glad to read that you've fixed it:)
Good luck with your project.
Re: vSAN on a single bare metal server?
Posted: Mon Jun 16, 2025 8:11 pm
by vertigomike
Back to working on this setup in my lab. Performance has been terrible. I ended up enabling jumbo frames on my nexus switch and have updated the QOS settings on the switch (specific model doesn't support per-interface MTU settings) and have changed the MTU on both Starwinds data interfaces to 9000 and my proxmox san interfaces to this network to 9000 MTU as well. However speeds still appear slow. I do see jumbo frames now on the switch but I kicked off the clone of one of the VMs that the template is on the Starwinds storage. VM is 300GB. So far in 2hr 48m its managed to clone 210GB of the image. This is nuts. I can do on local storage usually in 20-25min on average.
Re: vSAN on a single bare metal server?
Posted: Mon Jun 16, 2025 9:00 pm
by yaroslav (staff)
What does the storage performance look like on the storage servers?
Re: vSAN on a single bare metal server?
Posted: Wed Jun 18, 2025 3:40 pm
by vertigomike
Looking in the dashboard it shows IOPS of 5.4 Read 0.2 write. Disk throughput 889KB Read 782KB Write. Network throughput 73Kbit Receive, 8 Mbit Send.
This is a dell R740xd server. It had a BOSS card with SSDs in RAID1 that the primary Starwinds OS is installed on. It has a Perc H730P Mini Raid controller that has one virtual Disk in RAID-10 configuration consisting of 24 drives.
Re: vSAN on a single bare metal server?
Posted: Wed Jun 18, 2025 4:40 pm
by yaroslav (staff)
Thanks for your update.
The dashboard shows the demand. Please run the FIO inside the VM.
Re: vSAN on a single bare metal server?
Posted: Wed Jun 18, 2025 5:58 pm
by vertigomike
This isn't a VM itself. This is me trying to clone a VM template in Proxmox to create a new VM. I have a template that i've used via API that after the Starwinds setup i've been unable to use as the cloning process takes hours. If i launch manual clone in the Prox GUI i get the same behavior.
Re: vSAN on a single bare metal server?
Posted: Wed Jun 18, 2025 8:35 pm
by yaroslav (staff)
Sorry, my bad. Measure storage performance on StarWind bare-metal installation, you can see the sample commands here
https://www.starwindsoftware.com/best-p ... practices/
Is the underlying storage SSD- or HDD-based?