Starwind 8 Beta 3 - Device mount failed

Public beta (bugs, reports, suggestions, features and requests)

Moderators: anton (staff), art (staff), Max (staff), Anatoly (staff)

Post Reply
k0nf1gt
Posts: 4
Joined: Sat Mar 08, 2014 9:17 pm

Sat Mar 08, 2014 9:49 pm

Hello,

I have been testing the Starwind 8 Beta for a vSphere lab and noticed yesterday things were a bit slower than usual (been testing for about a week). Everything has been performing really well but yesterday I noticed in vSphere that latency on the LUN went up to about 5000 ms. The average according to the graph is about 2-5 ms. I only had about 5 active VM's running on this LUN and they dont really do much as far as disk access. I shut down the VM's on this particular datastore and rebooted the Starwind server. After reboot I opened the Starwind console and connected to the Starwind service which indicated that it was mounting the lsfs device. After about 15-20 minutes I received an errror "Device Mount Failed!". I tried rebooting again, still no luck. Looks to me like my VM's that were running on this datastore are history... Anyway to force mount the lsfs disk?

On another note, when I initially setup this test environment I created a lsfs disk and an imagefile disk to test performance. The imagefile disk never had an issue and mounts fine. Unfortunately I had my VM's running on the LSFS disk at the time. I also checked my RAID controller and it shows all disks healthy and RAID status Operational. My Windows server running Starwind never showed more than 2 GB's of memory utilized.

Info about my Starwind setup:

Windows Server 2012 R2
Starwind 8 Beta 3
Raid controller: Perc 6i
RAID: (4) disk RAID 10 Write Back enabled
Server has 4Gb RAM
CPU: Xeon L5639
Network: (3) 1Gbps NIC's (1 NIC is management, 2 NIC's for iSCSI)
iSCSI Setup: A side and b side on different VLAN's /seperate subnets - also modified the "<iScsiDiscoveryListInterfaces value="1"/" per the MPIO document
VMware showed both targets in the LUN path and I configured Round Robin for the Path Selection

LSFS Device Info:

Size 300GB
Cache enable: 256MB
Dedupe: No

Thanks in advance, look forward to your response.
User avatar
anton (staff)
Site Admin
Posts: 4008
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Sat Mar 08, 2014 9:53 pm

Beta 3 is outdated. Please upgrade to Release Candidate as it would be quite stupid to hunt for bugs being (at least potentially) fixed in ~500 intermediate builds :) Thank you!
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
User avatar
Ironwolf
Posts: 59
Joined: Fri Jul 13, 2012 4:20 pm

Mon Mar 10, 2014 4:59 pm

I had this problem too, but I have not been to reproduce it, leading me to a system stability issue and not a Starwind issue, my image files are fine, my LSFS files failed, it makes me wonder now as I write this if a “Reset button” during a write would produce the same results

Setup:

16GB Memory, 2 CPUs 2 Cores, 2008R2
V8 RC 8.0.6441
5 LUNs(in test) all sitting on same NTFS partition on SW iSCSI host, 128 WB cache no SSD cache, 10GB
1 IMG formatted to NTFS
1 LSFS with DeDup formatted to NTFS
1 LSFS without DeDup formatted to NTFS
1 LSFS with DeDup formatted to REFS
1 LSFS without DeDup formatted to NTFS

Test: ISO File Copies
Purpose Observe behavior of resource utilization, and active LSFS thin with delete

Copied 4 ISO files, (Windows Server 2012R2, 2008R2, Forefront TMG, Forefront UAG)
Repeated steps various times, all tests seems to only use 1 CPU but both cores will run up to 100%
1) Copied all 4(ISO) to the different LUNs one at a time, then Deleted (too big for cache)
2) Copied all 4(ISO) to all test LUNs at the same time, then deleted (too big for cache)
3) Copied 1 3GB ISO to LUNs one at a time, then deleted (all in cache)
4) Copied 1 3GB ISO to LUNs all at the same time, CRASH (really good throughput but still only 2 cores/1 CPU in use)

The CRASH turned into a reboot
All 4 LSFS failed to mount, all images were fine include the one in the test set
Removing and reattaching does not resolve the failed drives
Attachments
127.0.0.1-3261-service-starwind-20140307-111239.zip
(16.16 KiB) Downloaded 469 times
After Crash 4 LFSF failed to mount.PNG
After Crash 4 LFSF failed to mount.PNG (58.76 KiB) Viewed 7656 times
k0nf1gt
Posts: 4
Joined: Sat Mar 08, 2014 9:17 pm

Mon Mar 10, 2014 11:58 pm

Sounds like the exact same issue I have. I never did figure out a way to remount or recover the LSFS disk. I also tried upgrading to the RC and remount but it wont even recognize the files. I agree the throughput was pretty good using LSFS, but it definitely needs some form of recovery. I'm going to hang on to the LSFS files and see if it can be mounted in a later release but I doubt it. I noticed others on the forum mentioning extremely long mount times for small LUNs, but at least they mounted...
User avatar
Bohdan (staff)
Staff
Posts: 435
Joined: Wed May 23, 2007 12:58 pm

Tue Mar 11, 2014 9:34 am

k0nf1gt wrote:Sounds like the exact same issue I have. I never did figure out a way to remount or recover the LSFS disk. I also tried upgrading to the RC and remount but it wont even recognize the files. I agree the throughput was pretty good using LSFS, but it definitely needs some form of recovery. I'm going to hang on to the LSFS files and see if it can be mounted in a later release but I doubt it. I noticed others on the forum mentioning extremely long mount times for small LUNs, but at least they mounted...
Please check this with RC build and let us know about the results.
Beta3 can not be updated to RC due to LSFS format changes.
k0nf1gt
Posts: 4
Joined: Sat Mar 08, 2014 9:17 pm

Tue Mar 11, 2014 6:47 pm

I have uninstalled beta 3 and am now running RC. Will continue testing and will update if I can recreate the issue.
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Thu Mar 20, 2014 10:51 am

Hi!
May I ask if you have any new results to share with us?
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
k0nf1gt
Posts: 4
Joined: Sat Mar 08, 2014 9:17 pm

Fri Mar 21, 2014 10:59 pm

On the RC everythings been stable so far although I havent been able to recover the old LSFS data. I also have only been using the imagefile devices...
User avatar
Bohdan (staff)
Staff
Posts: 435
Joined: Wed May 23, 2007 12:58 pm

Mon Mar 31, 2014 1:12 pm

k0nf1gt wrote:On the RC everythings been stable so far although I havent been able to recover the old LSFS data. I also have only been using the imagefile devices...
Thank you for keeping us updated.
Post Reply