Cannot mount volume with linux target (nvmetcli)

Initiator (iSCSI, FCoE, AoE, iSER and NVMe over Fabrics), iSCSI accelerator and RAM disk

Moderators: anton (staff), art (staff), Max (staff), Anatoly (staff)

Post Reply
AMDStan420
Posts: 3
Joined: Tue Apr 11, 2023 7:20 pm

Tue Apr 11, 2023 7:43 pm

Hello. I have a home lab where I am attempting to get RDMA NVMEoF working. Here is the hardware setup:

Server:
Arch Linux with nvmetcli
ConnectX-3 VPI (VPI mode)

Desktop:
Windows 11
ConnectX-3 VPI card (VPI Mode)

I have setup nvmetcli on the remote side and have allowed all hosts and enabled the subsystem. My IP addressing is correct because I am able to ping back and forth using IPoIIB and via IBPing (RDMA) using LID. When I attempt discovery. I get this:

Code: Select all

PS C:\Program Files\StarWind Software\StarNVMeoF> StarNVMeoF_Ctrl.exe discovery 10.0.0.50 10.0.0.51

StarNVMeoF Controller Application v 1.9.0.578
Our Miniport #1 (ver 1.9 build 578)
Discovering of RDMA addr 10.0.0.50:4420 from 10.0.0.51...
        NET_LUID:       0x6008001000000
Discovery returned: gen 18983755448577, numrec 1689399632855040
1) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
2) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
3) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
4) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
5) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
6) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
7) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
8) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
9) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
10) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
11) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
12) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
13) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
14) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
15) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
16) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
17) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
18) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
19) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
20) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
21) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
22) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
23) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
24) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
25) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
26) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
27) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
28) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
29) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
30) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
31) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
32) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
33) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
34) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
35) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
36) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
37) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
38) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
39) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
40) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
41) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
42) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
43) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
44) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
45) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
46) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
47) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
48) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
49) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
50) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
51) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
52) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
53) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
54) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
55) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
56) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
57) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
58) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
59) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
60) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
61) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
62) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
63) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
64) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
65) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
66) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
67) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
68) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
69) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
70) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
71) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
72) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
73) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
74) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
75) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
76) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
77) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
78) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
79) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
80) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
81) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
82) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
83) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
84) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
85) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
86) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
87) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
88) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
89) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
90) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
91) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
92) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
93) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
94) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
95) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
96) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
97) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
98) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
99) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
100) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
101) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
102) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
103) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
104) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
105) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
106) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
107) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
108) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
109) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
110) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
111) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
112) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
113) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
114) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
115) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
116) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
117) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
118) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
119) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
120) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
121) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
122) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
123) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
124) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
125) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
126) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
127) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
128) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
129) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
130) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
131) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
132) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
133) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
134) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
135) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
136) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
137) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
138) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
139) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
140) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
141) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
142) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
143) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
144) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
145) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
146) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
147) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
148) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
149) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
150) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
151) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
152) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
153) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
154) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
155) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
156) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
157) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
158) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
159) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
160) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
161) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
162) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
163) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
164) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
165) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
166) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
167) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
168) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
169) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
170) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
171) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
172) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
173) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
174) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
175) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
176) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
177) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
178) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
179) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
180) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
181) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
182) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
183) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
184) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
185) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
186) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
187) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
188) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
189) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
190) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
191) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
192) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
193) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
194) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
195) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
196) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
197) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
198) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
199) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
200) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
201) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
202) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
203) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
204) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
205) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
206) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
207) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
208) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
209) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
210) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
211) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
212) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
213) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
214) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
215) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
216) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
217) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
218) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
219) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
220) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
221) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
222) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
223) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
224) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
225) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
226) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
227) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
228) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
229) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
230) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
231) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
232) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
233) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
234) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
235) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
236) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
237) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
238) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
239) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
240) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
241) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
242) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
243) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
244) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
245) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
246) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
247) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
248) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
249) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
250) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
251) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
252) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
253) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
254) subnqn
        Discovery: port 0x0, cntlid 0x0, trtype ?, addr  : , adrfam 0, asqsz 0
This output appears to be erroneous as if I switch the target IP to a random IP on my network I get the same output. Obviuously discovery isn't working, but I'd like to find out why exactly.
Top
yaroslav (staff)
Staff
Posts: 2351
Joined: Mon Nov 18, 2019 11:11 am

Tue Apr 11, 2023 8:19 pm

Hi,

May I ask what exactly target you use?
I think it is not able to discover the targets. Make sure to use the command this way on the initiator side:
StarNVMeoF_Ctrl.exe" discovery <TARGET-IP> <INITIATOR-IP>
Please make sure to have Jumbo MTU set to the same value across the networking and have the latest drivesr installed.
Top
AMDStan420
Posts: 3
Joined: Tue Apr 11, 2023 7:20 pm

Tue Apr 11, 2023 9:25 pm

I'm using standard linux nvmeof target via RDMA. TCP is not being used.

Initiator side is where I can't discover.
Top
yaroslav (staff)
Staff
Posts: 2351
Joined: Mon Nov 18, 2019 11:11 am

Wed Apr 12, 2023 1:34 pm

Try discovering over TCP for testing purposes.
Please check MTU values, and confirm drivers to be up-to-date.
Top
yaroslav (staff)
Staff
Posts: 2351
Joined: Mon Nov 18, 2019 11:11 am

Tue Apr 25, 2023 1:03 pm

Hi,

To be able to troubleshoot this system in-depth, we need the following information.
1. OS version and kernel version.
2. Try running this script

Code: Select all

cd /subsystems
create  nqn.2016-06.io.kernel:nvme0n1
cd /hosts
create nvme-subsystem
cd /subsystems/nqn.2016-06.io.kernel:nvme0n1
set attr allow_any_host=0
cd /subsystems/nqn.2016-06.io.kernel:nvme0n1/allowed_hosts/
create nvme-subsystem
cd /subsystems/nqn.2016-06.io.kernel:nvme0n1/allowed_hosts/
delete nvme-subsystem
cd /subsystems/nqn.2016-06.io.kernel:nvme0n1/
set attr allow_any_host=1
cd /subsystems/nqn.2016-06.io.kernel:nvme0n1/namespaces
create 1
cd 1
set device path=/dev/nvme0n1
enable
cd /ports/
create 1
cd 1/
set addr trtype=rdma
set addr adrfam=ipv4
set addr traddr=172.16.100.51
set addr trsvcid=4420
cd subsystems/
create nqn.2016-06.io.kernel:nvme0n1
Share the output with us.

Please also note that Mellanox ConnectX3 seems to be not supported in Windows 11. This implies potential connectivity issues.
Top
AMDStan420
Posts: 3
Joined: Tue Apr 11, 2023 7:20 pm

Fri May 12, 2023 10:58 pm

Ok apologies on this as I was busy with studies. I can spend some time on this now. I would need confirmation on the following:

Does starwind nvmeof initiator free edition support RDMA nvmeof targets over IB?

I was reading the product info and it appears only TCP/RoCE are supported. My setup is a direct point to point connection with Infinband. I am able to IBping from both host and server. I am still receiving an error if I attempt to connect:

Code: Select all

License expired. No new devices will be added. Contact support@starwind.com for valid free or commercial license.
Although I am using Starwind free version only. Is there anyway I could get confirmation that I can utilize infiniband? I do not have ROCE deployed.

I have tested this from a linux VM with my mellanox card passed through and it works just fine. I know my target is configured correctly. Thanks.
Top
yaroslav (staff)
Staff
Posts: 2351
Joined: Mon Nov 18, 2019 11:11 am

Mon May 15, 2023 9:39 am

StarWind NVMe-OF Initiator works over RDMA (RoCE v2) and TCP, but not InfiniBand.
For the license, you can contact support@starwind.com
Top
Post Reply

Return to “StarWind NVMe-oF Initiator [+Free], Deduplication Analyzer, RDMA Performance Benchmark”