StarWind iSCSI SAN
StarWind Native SAN for Hyper-V
 

New Setup Lost localhost mgmt access

Pure software-based VM-centric and flash-friendly VM storage (iSCSI, SMB3, NFS, iSER and NVMe over Fabrics) including free version. Same software embedded on StarWind ready nodes.

Moderators: art (staff), anton (staff), Anatoly (staff), Max (staff)

New Setup Lost localhost mgmt access

Postby randy_srs » Tue Mar 03, 2020 8:34 pm

i have a 2 host setup for testing .

server 1 r1e01u01-hypv1 - 192.x.x.19 CSV3 HAimage3, sync HAIMAGE4
server 2 r1e01u03-hypv2 - 192.x.x 20 CSV4 HAimage4 , sync HAIMAGE3

if i connect the mgmt console on .19 i can connect to .20 and vs versa . but neither will now connect to localhost / 127.0.0.1 , yes i can ping localhost/127
i can connect to both .19 and .20 from the same console , but

they worked fine till one of them rebooted .

after reboot
CSV4 is in process of sync (from .19) HA
CSV4 is in process of sync (from .20) owner
CSV3 no sync partner (from .19 ) owner
CSV3 partner not sync (from .20 ) HA

uploaded server 1 .19 log , however log 2 is 30mb and would not compress down to the 256kb .


snip of server 20 , i see a ton of login failures but this was a stock setup didnt change anything from when it was working this morning .

3/3 10:49:41.254967 17c8 C[368], XPT_UP: iScsiConnection::doTransition: Event - LOGIN.
3/3 10:49:41.255034 17c8 Params: iScsiParameter::update: <<< String param 'InitiatorName': received 'iqn.1991-05.com.microsoft:r1e01u01-hypv1.xxxx.local', accepted 'iqn.1991-05.com.microsoft:r1e01u01-hypv1.xxxx.local'
3/3 10:49:41.255063 17c8 Params: iScsiParameter::update: <<< Enum param 'SessionType': received 'Normal', accepted 'Normal'
3/3 10:49:41.255081 17c8 Params: iScsiParameter::update: <<< String param 'TargetName': received 'iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.xxxx.local-csv4', accepted 'iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.xxxx.local-csv4'
3/3 10:49:41.255093 17c8 Params: iScsiParameter::update: <<< Enum param 'AuthMethod': received 'None', accepted 'None'
3/3 10:49:41.255175 a7c C[369], XPT_UP: iScsiConnection::handleFirstLogin: Login request: ISID 0x400001370001, TSIH 0x0000.
3/3 10:49:41.255216 a7c C[369], XPT_UP: iScsiConnection::doTransition: Event - LOGIN.
3/3 10:49:41.255283 a7c Params: iScsiParameter::update: <<< String param 'InitiatorName': received 'iqn.1991-05.com.microsoft:r1e01u01-hypv1.xxxx.local', accepted 'iqn.1991-05.com.microsoft:r1e01u01-hypv1.xxxx.local'
3/3 10:49:41.255306 a7c Params: iScsiParameter::update: <<< Enum param 'SessionType': received 'Normal', accepted 'Normal'
3/3 10:49:41.255319 a7c Params: iScsiParameter::update: <<< String param 'TargetName': received 'iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.xxxx.local-csv4', accepted 'iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.xxxx.local-csv4'
3/3 10:49:41.255348 a7c Params: iScsiParameter::update: <<< Enum param 'AuthMethod': received 'None', accepted 'None'
3/3 10:49:41.255832 17c8 HA: HASyncNode::registerSession: Client initiator iqn.1991-05.com.microsoft:r1e01u01-hypv1.xxxx.local is trying to register a session within the 'iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.xxxx.local-csv4' target... (sessId = 0x368, initiatorNameIsid = iqn.1991-05.com.microsoft:r1e01u01-hypv1.xxxx.local,400001370002)
3/3 10:49:41.255865 17c8 HA: HASyncNode::registerSession: Unable to register the new client session. The node is not active!
3/3 10:49:41.255877 17c8 HA: HASyncNode::registerSession: Return code 21.
3/3 10:49:41.255892 17c8 Tgt: *** iScsiTarget::openSession: iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.xxxx.local-csv4: can't register session. The device 'HAImage4' is not ready.
3/3 10:49:41.255908 17c8 T[368,1]: ***iScsiTask::startLoginPhase: *ERROR* Login request: device open failed.
3/3 10:49:41.256009 17c0 C[368], IN_LOGIN: iScsiConnection::doTransition: Event - LOGIN_REJECT.
3/3 10:49:41.256142 17c8 debug: *** Swn_SocketRecv: WSARecv() failed with error 10054 (0x2746)!
3/3 10:49:41.256171 17c8 Srv: *** SwSocket::Recv: Swn_SocketRecv() failed with error 10054 (0x2746)!
3/3 10:49:41.256182 17c8 C[368], IN_LOGIN: iScsiConnection::receive: recvData returned 10054 (0x2746)!
3/3 10:49:41.256417 a7c HA: HASyncNode::registerSession: Client initiator iqn.1991-05.com.microsoft:r1e01u01-hypv1.xxxx.local is trying to register a session within the 'iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.xxxx.local-csv4' target... (sessId = 0x369, initiatorNameIsid = iqn.1991-05.com.microsoft:r1e01u01-hypv1.xxxx.local,400001370001)
3/3 10:49:41.256458 a7c HA: HASyncNode::registerSession: Unable to register the new client session. The node is not active!
3/3 10:49:41.256482 a7c HA: HASyncNode::registerSession: Return code 21.
3/3 10:49:41.256417 2198 S[368]: iScsiSession::~iScsiSession: ~Session
3/3 10:49:41.256494 a7c Tgt: *** iScsiTarget::openSession: iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.xxxx.local-csv4: can't register session. The device 'HAImage4' is not ready.
3/3 10:49:41.256556 a7c T[369,1]: ***iScsiTask::startLoginPhase: *ERROR* Login request: device open failed.
3/3 10:49:41.256653 37c0 C[369], IN_LOGIN: iScsiConnection::doTransition: Event - LOGIN_REJECT.
3/3 10:49:41.256765 a7c debug: *** Swn_SocketRecv: WSARecv() failed with error 10054 (0x2746)!
3/3 10:49:41.256788 a7c Srv: *** SwSocket::Recv: Swn_SocketRecv() failed with error 10054 (0x2746)!
3/3 10:49:41.256804 a7c C[369], IN_LOGIN: iScsiConnection::receive: recvData returned 10054 (0x2746)!
3/3 10:49:41.256919 161c S[369]: iScsiSession::~iScsiSession: ~Session
3/3 10:49:42.922712 1114 Srv: iScsiServer::listenConnections: Accepted iSCSI connection from 127.0.0.1:54726 to 127.0.0.1:3260. (Id = 0x36a)
3/3 10:49:42.922768 1114 S[36a]: iScsiSession::iScsiSession: Session (000001A2EC211580)
3/3 10:49:42.922789 1114 C[36a], FREE: iScsiConnection::doTransition: Event - CONNECTED.
3/3 10:49:42.923182 3600 C[36a], XPT_UP: iScsiConnection::handleFirstLogin: Login request: ISID 0x400001370001, TSIH 0x0000.
3/3 10:49:42.923225 3600 C[36a], XPT_UP: iScsiConnection::doTransition: Event - LOGIN.
3/3 10:49:42.923282 3600 Params: iScsiParameter::update: <<< String param 'InitiatorName': received 'iqn.1991-05.com.microsoft:r1e01u03-hypv2.xxxx.local', accepted 'iqn.1991-05.com.microsoft:r1e01u03-hypv2.xxxx.local'
3/3 10:49:42.923312 3600 Params: iScsiParameter::update: <<< Enum param 'SessionType': received 'Normal', accepted 'Normal'
3/3 10:49:42.923332 3600 Params: iScsiParameter::update: <<< String param 'TargetName': received 'iqn.2008-08.com.starwindsoftware:x.x60.20-csv3', accepted 'iqn.2008-08.com.starwindsoftware:x.x60.20-csv3'
3/3 10:49:42.923346 3600 Params: iScsiParameter::update: <<< Enum param 'AuthMethod': received 'None', accepted 'None'
3/3 10:49:42.923394 3600 HA: HASyncNode::registerSession: Client initiator iqn.1991-05.com.microsoft:r1e01u03-hypv2.xxxx.local is trying to register a session within the 'iqn.2008-08.com.starwindsoftware:x.x60.20-csv3' target... (sessId = 0x36a, initiatorNameIsid = iqn.1991-05.com.microsoft:r1e01u03-hypv2.xxxx.local,400001370001)
3/3 10:49:42.923417 3600 HA: HASyncNode::registerSession: Unable to register the new client session. The node is not active!
3/3 10:49:42.923433 3600 HA: HASyncNode::registerSession: Return code 21.
3/3 10:49:42.923448 3600 Tgt: *** iScsiTarget::openSession: iqn.2008-08.com.starwindsoftware:x.x60.20-csv3: can't register session. The device 'HAImage3' is not ready.
3/3 10:49:42.923459 3600 T[36a,1]: ***iScsiTask::startLoginPhase: *ERROR* Login request: device open failed.
3/3 10:49:42.923548 31a8 C[36a], IN_LOGIN: iScsiConnection::doTransition: Event - LOGIN_REJECT.
3/3 10:49:42.923588 3600 debug: *** Swn_SocketRecv: WSARecv() failed with error 10054 (0x2746)!
3/3 10:49:42.923633 3600 Srv: *** SwSocket::Recv: Swn_SocketRecv() failed with error 10054 (0x2746)!
3/3 10:49:42.923646 3600 C[36a], IN_LOGIN: iScsiConnection::receive: recvData returned 10054 (0x2746)!
Attachments
starwind-20200303-113524server.19.rar
.20 log
(233.32 KiB) Downloaded 38 times
randy_srs
 
Posts: 1
Joined: Tue Mar 03, 2020 8:13 pm

Re: New Setup Lost localhost mgmt access

Postby yaroslav (staff) » Sat Mar 07, 2020 11:19 am

Sorry for the delayed reply.

May I get more logs?
For quicker and easier log collection from StarWind nodes please do not hesitate using StarWind Log Collector from our knowledge base article below:
https://knowledgebase.starwindsoftware. ... collector/
Send me the logs via Google Disk or any other file sharing service.
yaroslav (staff)
Staff
 
Posts: 218
Joined: Mon Nov 18, 2019 11:11 am

Re: New Setup Lost localhost mgmt access

Postby yaroslav (staff) » Thu Mar 19, 2020 5:44 pm

Greetings,

From what I saw in logs, there are multiple misconfigurations (e.g, you use synchronization link to present storage over iSCSI). This could be because you did not fine-tune the script for HA device creation (the sample needs to be modified).
There are devices with different synchronization priorities on each side. This may cause data loss. See my post here for more details viewtopic.php?f=5&t=5421

both systems after a fail over test lost localhost access in the management console

That looks like an authentication issue. Did you set/change any credentials?
Can you add both nodes using their IPs? Try adding 192.168.60.20 and 192.168.60.19 to the management console by typing these IPs.
Did you change the server access secret? It looks to me that there might be something wrong with the authentication side. I did compare the encrypted value to the standard one. They match. But I want you to confirm that you did not change the server access secret.
Did you modify the credentials management console uses to connect to StarWind Service?

2nd nvme drive i setup will not or cannot create a HA sync between the 2 servers . not sure this is broken or just limited to 1 HA per systems ?

It is totally OK to use 2 Sync connections. CSV3 was just created without fine-tuning script right.
Let me show what I am talking about.
Here is what I found on HYPV2
<transport type="iSCSI">
<links>
<link id="1" type="data" priority="1" connections="2">
<peer ip="192.168.60.19" port="3260"/>
</link>
<link id="2" type="data" priority="1" connections="2">
<peer ip="192.168.50.19" port="3260"/>
</link>
<link id="3" type="control" priority="1" connections="1">
<peer ip="192.168.10.19" port="3260"/>
</link>
</links>
Exactly the same part on HYPV1
<transport type="iSCSI">
<links>
<link id="2" type="data" priority="1" connections="2">
<peer ip="192.168.60.20" port="3260"/>
</link>
<link id="4" type="control" priority="1" connections="1">
<peer ip="192.168.10.20" port="3260"/>
</link>
</links>
</transport>

Links ID match, so there is no synchronization link...

CSV4 though has been configured right.
<storage id="2" name="iqn.2008-08.com.starwindsoftware:192.168.60.19-csv4" type="remote" lun="0x0">
<transport type="iSCSI">
<links>
<link id="1" type="data" priority="1" connections="2">
<peer ip="192.168.60.19" port="3260"/>
</link>
<link id="3" type="control" priority="1" connections="1">
<peer ip="192.168.10.19" port="3260"/>
</link>
</links>
</transport>
</storage>
and
<storage id="2" name="iqn.2008-08.com.starwindsoftware:r1e01u03-hypv2.srsnetworks.net-csv4" type="remote" lun="0x0">
<transport type="iSCSI">
<links>
<link id="2" type="data" priority="1" connections="2">
<peer ip="192.168.60.20" port="3260"/>
</link>
<link id="5" type="control" priority="1" connections="1">
<peer ip="192.168.10.20" port="3260"/>
</link>
</links>
</transport>
</storage>

Here is how to configure the script for HA device creation https://www.starwindsoftware.com/help/H ... ategy.html (find PowerShell part at the bottom).
yaroslav (staff)
Staff
 
Posts: 218
Joined: Mon Nov 18, 2019 11:11 am


Return to StarWind Virtual SAN / StarWind Virtual SAN Free / StarWind HyperConverged Appliance / StarWind Storage Appliance

Who is online

Users browsing this forum: No registered users and 9 guests