Readynas 4200 losing iSCSI connection for 5 secs (15072737)

Hello,

we have 2x vmware ESXi 4.1 u1 servers with 4 GB paths each to the iSCSI SAN (ReadyNAS 4200).

We now have the problem that we sometimes loose the connection and the entire vmware environment hangs for 5 seconds. We let vmware analyse the logs and they have come up with this:

Hello Jeremy,

vm-support logs show that ESXi host lost access to NetGear ReadyNAS4200 iSCSI array :

messages.2:Mar 21 14:39:26 vmkernel: 4:19:08:18.685 cpu11:4844)WARNING: iscsi_vmk: iscsivmk_StopConnection: vmhba37:CH:1 T:0 CN:0: iSCSI connection is being marked "OFFLINE" (Event:6) messages.2:Mar 21 14:39:26 vmkernel: 4:19:08:18.685 cpu11:4844)WARNING: iscsi_vmk: iscsivmk_StopConnection: Sess [ISID: 00023d000003 TARGET: iqn.2010-12.BIGFOOT:vmware.lun0 TPGT: 1 TSIH: 0] messages.2:Mar 21 14:39:26 vmkernel: 4:19:08:18.685 cpu11:4844)WARNING: iscsi_vmk: iscsivmk_StopConnection: Conn [CID: 0 L: 192.168.0.52:51125 R: 192.168.0.3:3260]

messages.1:Mar 21 14:39:28 vmkernel: 4:19:08:20.654 cpu7:4103)NMP: nmp_CompleteCommandForPath: Command 0x28 (0x41027f1ca540) to NMP device "naa.60014052e10897000c6d002000000000" failed on physical path "vmhba37:C1:T0:L1" H:0x2 D:0x0 P:0x0 Possible sense data: 0 messages.1:Mar 21 14:39:28 vmkernel: 4:19:08:20.654 cpu7:4103)ScsiDeviceIO: 1672: Command 0x28 to device "naa.60014052e10897000c6d002000000000" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
messages.1:Mar 21 14:39:28 vmkernel: 4:19:08:20.676 cpu1:4097)NMP: nmp_CompleteCommandForPath: Command 0x12 (0x41027f9cc840) to NMP device "naa.60014052e10897000c6d003000000000" failed on physical path "vmhba37:C1:T0:L2" H:0x2 D:0x0 P:0x0 Possible sense data: 0 messages.1:Mar 21 14:39:28 vmkernel: 4:19:08:20.676 cpu1:4097)ScsiDeviceIO: 1672: Command 0x12 to device "naa.60014052e10897000c6d003000000000" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x5 0x24 0x0.

messages.1:Mar 21 14:39:31 vmkernel: 4:19:08:22.974 cpu2:4844)WARNING: iscsi_vmk: iscsivmk_StartConnection: vmhba37:CH:1 T:0 CN:0: iSCSI connection is being m arked "ONLINE"

On the other hand logs also show that iSCSI LUNs are using MRU as path policy and the Storage Array is detected as VMW_SATP_ALUA.
This is something that nees to be validated with your SAN Vendor as our HCL states that storage array type should be VMW_SATP_DEFAULT_AA and Path Policy should be VMW_PSP_FIXED.
Please engage your SAN Vendor to have this validated by them.

Please assist in fixing this!

We are on 4.2.15-SP1

Using with a Virtual Hypervisor

VMware

19 Replies

yoh-dah
Guide
Mar 22, 2011
Can you send the logs (see my sig)?
jeremyotten
Aspirant
Mar 23, 2011
logs send
matelukas
Aspirant
Mar 23, 2011
Taken by support. Case created.
beisser1
Tutor
Mar 23, 2011
i added the casenumber to the topic for reference.
jeremyotten
Aspirant
Apr 12, 2011
After updating to 4.2.16 and disabling CHAP and setting JUST ACL on iSCSI I haven''t had a single disconnect anymore.

Also when enabling the "VMWare round Robin" Path policy over my 4x 1GB MPIO Paths I get really really good performance.
glassware
Tutor
Apr 14, 2011
Given that we're both having problems with CHAP, what's the NetGear-recommended way to restrict access to specific shares to specific machines? Should we be using initiator IDs?
jeremyotten
Aspirant
Apr 14, 2011
Yes just ACL with initiator ID's
gradgrind
Aspirant
Nov 15, 2011
Did anyone ever get an answer to this?

I've got RN4200, connected now to the same 2960 switch as a single ESX 4i server. Server has 2 connections, jumbo frames not enabled, using a segregated VLAN to one of the RN NICs.
Keep getting the lost connection message.
jeremyotten
Aspirant
Nov 15, 2011
Only solutions is disable CHAP authentication on iSCSI on the Readynas 4200. Just use the ACL list with Initiator ID's the secure the connection.
gradgrind
Aspirant
Nov 15, 2011
Already on that...

Any idea on the best load balance strategy for paths? The options are:
Fixed
MRU
Round Robin
VMW-PSP-FIXED_AP

I've tried RR and VMW-PSP-FIXED-AP, but getting the same on both.