* RESERVE_OUT: PREEMPT_ABORT is not implemented

[ArnoldJudasRimmer]

Hi,

I'm running Solaris 10 x86 virtual machine in ESX 3.5. Starwind is running in a Windows 2003 server virtual machine in ESX 3.5. The Solaris 10 x86 virtual machine has Storage Foundation HA 5.0 installed. I'm trying to setup I/O Fencing within the Veritas Cluster Server... Annoyingly the very lst test fails with "Preempt and abort key KeyA using key keyB on node unixs101 failed!"

When I look at the Starwind target logs the following error is logged:
7/20 23:02:34.953 f14 PR: * RESERVE_OUT: PREEMPT_ABORT is not implemented!

7/20 23:02:35.203 a18 PR: iqn.2003-06.com.rocketdivision.starwind.microsof-y2ukvd.home.com.diskbridge0 RESERVE_IN: READ_KEYS.

7/20 23:02:35.281 a18 PR: iqn.2003-06.com.rocketdivision.starwind.microsof-y2ukvd.home.com.diskbridge0 RESERVE_IN: READ_RESERVATIONS.

7/20 23:02:37.218 f14 PR: S[d] LUN 0 is PR reserved with key 4B6579412D2D2D2D

7/20 23:02:37.218 f14 PR: iqn.2003-06.com.rocketdivision.starwind.microsof-y2ukvd.home.com.diskbridge0 RESERVE_IN: READ_KEYS.

7/20 23:02:37.828 f14 PR: S[d] LUN 0 is PR reserved with key 4B6579412D2D2D2D

7/20 23:02:37.828 f14 PR: iqn.2003-06.com.rocketdivision.starwind.microsof-y2ukvd.home.com.diskbridge0 RESERVE_IN: READ_RESERVATIONS.

7/20 23:02:40.140 a18 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)

7/20 23:02:40.140 a18 PR: Unregistering key 4B6579412D2D2D2D owned by iqn.1986-03.com.sun:01:4aeaabf5ffff.487002a4,4000002A0000


Question.....
Is there any chance I can get this working? It doesn't look like this version supports preemptive aborts... this means I can't do I/O fencing with VCS in my cluster... which bites!

Thanks in advance for any feedback!
AJR

[Val (staff)]

Hi,

StarWind 3.5.x does not support the feature.

Currently the persistent reservation subset that is implemented in StarWind supports the MS Windows Server 2008 clustering according to the MS specification.

Are there any white-papers on the persistent reservation's features that are needed for your software to run?

[ArnoldJudasRimmer]

Hi Valery,

That's too bad. I was hoping on getting it setup. I think the details you are looking for are not documented in the manuals. Symantec discusses I/O fencing feature .


I'm not sure if Starwind already has a relationship with Symantec, they could probably share the test routines with you.

This is a detailed log of the I/O fencing tests. I think it failed on "SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY" (see down below).

If this could be included in a future release it would surpass OpenFiler and FreeNAS iSCSI capabilities. Right now I'm using OpenFiler, but I would have purchased a copy of Starwind iSCSI if it had this function.


# cat vxfen.log.7239

Starting vxfensthdw...

manual_vxfentsthdw() called for unixs100 and unixs101

manual_vxfentsthdw() serial1 = 4CC75A83F38DDCBA , serial2 = 4CC75A83F38DDCBA

run_tests() called for unixs100 and unixs101

register() passed for /dev/rdsk/c3t12d0s2

chk_registrations() passed for /dev/rdsk/c3t12d0s2

read_disk() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

read_disk() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

reserve() passed for /dev/rdsk/c3t12d0s2

chk_reservations() passed for /dev/rdsk/c3t12d0s2

read_disk() passed for /dev/rdsk/c3t12d0s2

read_disk() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

nowrite_disk() passed for /dev/rdsk/c3t12d0s2

registerignore() passed for /dev/rdsk/c3t12d0s2

chk_registrations() passed for /dev/rdsk/c3t12d0s2

chk_registrations() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

preempt_abort() failed for unixs101

SCSI Registration Keys for unixs100 are..:-

Device Name: /dev/rdsk/c3t12d0s2
Total Number Of Keys: 2
key[0]:
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
key[1]:
Key Value [Numeric Format]: 75,101,121,66,45,45,45,45
Key Value [Character Format]: KeyB----
SCSI Reservation Keys for unixs100 are..:-

Device Name: /dev/rdsk/c3t12d0s2
Total Number Of Keys: 1
Key[0]:
Reservation Type: SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
/dev/rdsk/c3t12d0s2
SCSI Registration Keys for unixs101 are..:-

Device Name: /dev/rdsk/c3t12d0s2
Total Number Of Keys: 2
key[0]:
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
key[1]:
Key Value [Numeric Format]: 75,101,121,66,45,45,45,45
Key Value [Character Format]: KeyB----
SCSI Reservation Keys for unixs101 are..:-

Device Name: /dev/rdsk/c3t12d0s2
Total Number Of Keys: 1
Key[0]:
Reservation Type: SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
/dev/rdsk/c3t12d0s2


Thanks again!
AJR

[Val (staff)]

Hi,

StarWind does support the SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY feature.

Could you send the log files from your StarWind/logs directory to my email?

The log files should shed some light on the problem...

[capelink]

Hi,

I'm trying to get Veritas I/O fencing working with Solaris 10 on sparc too. When running the Veritas vxfentsthdw test routine I get a similar failure :-

Testing sparc1 /dev/rdsk/c3t5d0s2 sparc2 /dev/rdsk/c3t5d0s2

Evaluate the disk before testing ........................ No Pre-existing keys
Register keys on disk /dev/rdsk/c3t5d0s2 from node sparc1 .............. Passed
Verify registrations for disk /dev/rdsk/c3t5d0s2 on node sparc1 ........ Passed
Read from disk /dev/rdsk/c3t5d0s2 on node sparc1 ....................... Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc1 ...................... Passed
Read from disk /dev/rdsk/c3t5d0s2 on node sparc2 ....................... Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc2 ...................... Passed
Reserve disk /dev/rdsk/c3t5d0s2 from node sparc1 ....................... Passed
Verify reservation for disk /dev/rdsk/c3t5d0s2 on node sparc1 .......... Passed
Read from disk /dev/rdsk/c3t5d0s2 on node sparc1 ....................... Passed
Read from disk /dev/rdsk/c3t5d0s2 on node sparc2 ....................... Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc1 ...................... Passed
Expect no writes for disk /dev/rdsk/c3t5d0s2 on node sparc2 ............ Passed
RegisterIgnoreKeys on disk /dev/rdsk/c3t5d0s2 from node sparc2 ......... Passed
Verify registrations for disk /dev/rdsk/c3t5d0s2 on node sparc1 ........ Passed
Verify registrations for disk /dev/rdsk/c3t5d0s2 on node sparc2 ........ Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc1 ...................... Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc2 ...................... Passed
Preempt and abort key KeyA using key KeyB on node sparc2 ............... Failed

The detailed logfile contains :-

Wed Oct 29 17:56:19 GMT 2008 Starting vxfensthdw...

Wed Oct 29 17:56:23 GMT 2008 manual_vxfentsthdw() called for sparc1 and sparc2

Wed Oct 29 17:56:30 GMT 2008 manual_vxfentsthdw() serial1 = F8405644DF168E40 , serial2 = F8405644DF168E40

Wed Oct 29 17:56:30 GMT 2008 run_tests() called for sparc1 and sparc2

Wed Oct 29 17:56:31 GMT 2008 register() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:31 GMT 2008 chk_registrations() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:32 GMT 2008 read_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:33 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:34 GMT 2008 read_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:35 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:36 GMT 2008 reserve() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:36 GMT 2008 chk_reservations() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:37 GMT 2008 read_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:38 GMT 2008 read_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:40 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:40 GMT 2008 nowrite_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:40 GMT 2008 registerignore() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:40 GMT 2008 chk_registrations() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:41 GMT 2008 chk_registrations() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:42 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:43 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:43 GMT 2008 preempt_abort() failed for sparc2

Wed Oct 29 17:56:43 GMT 2008 SCSI Registration Keys for sparc1 are..:-

Device Name: /dev/rdsk/c3t5d0s2
Total Number Of Keys: 2
key[0]:
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
key[1]:
Key Value [Numeric Format]: 75,101,121,66,45,45,45,45
Key Value [Character Format]: KeyB----
Wed Oct 29 17:56:44 GMT 2008 SCSI Reservation Keys for sparc1 are..:-

Device Name: /dev/rdsk/c3t5d0s2
Total Number Of Keys: 1
Key[0]:
Reservation Type: SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
/dev/rdsk/c3t5d0s2
Wed Oct 29 17:56:44 GMT 2008 SCSI Registration Keys for sparc2 are..:-

Device Name: /dev/rdsk/c3t5d0s2
Total Number Of Keys: 2
key[0]:
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
key[1]:
Key Value [Numeric Format]: 75,101,121,66,45,45,45,45
Key Value [Character Format]: KeyB----
Wed Oct 29 17:56:44 GMT 2008 SCSI Reservation Keys for sparc2 are..:-

Device Name: /dev/rdsk/c3t5d0s2
Total Number Of Keys: 1
Key[0]:
Reservation Type: SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
/dev/rdsk/c3t5d0s2

Looks very familiar to the original post. Anything that has been or can be done with this ?

Starwind Version 3.5.5 20080930

Thanks

[Val (staff)]

The corresponding StarWind's log files could help to understand what's wrong.

Also a Wireshark's dump of network packets on TCP/IP port 3260 for the same test could give some information...

[anton (staff)]

We've finally managed to have this feature implemented and upcoming V5.5. is going to have Veritas cluster & file system supported.

[donypie]

Very good news, I'm also testing StarWind with Veritas and I have also the problem :

Preempt and abort key KeyA using key KeyB on node linsys34 ............. Failed

Can you please tell me when version 5.5 will be available ?

Thanks a lot.
Kind regards.
Pierre.

[anton (staff)]

We don't have release date yet. Had to put this on hold as we're facing other issues here. Sorry...

[donypie]

Hello,

Can you please tell me if this problem is now solved ?

Thanks.
Kind regards
Pierre.

[Val (staff)]

Can you please tell me if this problem is now solved ?

Not yet.

We are working on the feature to be included in a future release of StarWind.

[donypie]

Ok thanks. Indeed, it is not yet solved, in starwind log, I have still error messages.
When do you plan to implement a solution ?

Thanks a lot.
Kind regards,
Pierre.

*** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:39:52.512 1f0 IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:39:52.932 1ec IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:42:27.785 1e8 IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:42:27.795 1f0 IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:42:27.805 1ec IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:53:59.840 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:11.307 fb0 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:15.623 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:15.623 f24 PR: Unregistering key 4B6579412D2D2D2D (1) owned by iqn.1994-05.com.redhat:82a161c7eac,00023D030000
5/25 22:54:16.835 fb0 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:16.835 fb0 PR: Unregistering key 4B6579422D2D2D2D (1) owned by iqn.1994-05.com.redhat:bed9b8f28b60,00023D030000
5/25 22:54:20.850 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:45.426 fb0 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:54.659 fb0 PR: * RESERVE_OUT: PREEMPT_ABORT is not implemented!
5/25 22:54:54.659 fb0 PR: * RESERVE_OUT: PREEMPT_ABORT is not implemented!
5/25 22:55:18.023 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:55:18.023 f24 PR: * RESERVE_OUT: REGISTER change ReservationKey 4B6579412D2D2D2D -> 4572617365722D2D.
5/25 22:55:18.033 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)

[anton (staff)]

Apply for Beta program and get RC with this issue fixed immediately. Or wait for the official release (31st of May estimated).

[donypie]

Anton,

Thanks for your answer. I will request Beta version.

Kind regards,
Pierre.

[donypie]

Anton,

Can you please tell me how which Beta version I have to install. When I download the file starwind_beta.exe, I bget the version v5.3.0 20100323, SwSAN Win32.

Is it the version with the preempt_abord problem solved ?

Thanks.
Best regards,
Pierre.