- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
NMI watchdog BUG:soft lockup - CPU6 stuck for 22s! [iscsi_trx:212712]
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
NMI watchdog BUG:soft lockup - CPU6 stuck for 22s! [iscsi_trx:212712]
ReadyNAS 4200, 6.9.3
ReadyDATA5200 6.9.4
NMI watchdog BUG:soft lockup - CPU6 stuck for 22s! [iscsi_trx:212712]
Hi, I have constant problems with NAS, they are freezing. This time I connect serial port from 4200 to server and I was able to see last errors.
NAS was working for 124 days, this was a record, as normally it is freezing every week or two.
I was not able to reboot it remotely, the Serial connection only inform me about the bug, and do not accept incoming commands, I could see what I was writing, but without response.
I expect this same problem with ReadyDATA, but this unit is a bit better, and when it disconnects iscsi, I am still able to reboot it, even without the web interface.
I send 3 logs, 1 from 4200, after reboot, and 2 logs from readydata when I lost iscsi connection, and after reboot. Perhaps someone will find the problem,
BTW, I know that I have problems with 2 HDDs in 4200, but I had this same problem without them. So it is not the reason.
Nov 22 01:31:58 RezDent-NAS kernel: Unexpected ret: -32 send data 48
Nov 22 01:31:58 RezDent-NAS kernel: tx_data returned -32, expecting 48.
Nov 22 01:31:58 RezDent-NAS kernel: iSCSI Login negotiation failed.
Nov 22 01:31:59 RezDent-NAS rpc.mountd[6033]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
Nov 22 01:32:10 RezDent-NAS kernel: Unexpected ret: -32 send data 112
Nov 22 01:32:10 RezDent-NAS kernel: tx_data returned -32, expecting 112.
Nov 22 01:32:10 RezDent-NAS kernel: iSCSI Login negotiation failed.
Nov 22 01:32:10 RezDent-NAS kernel: Unexpected ret: -32 send data 112
Nov 22 01:32:10 RezDent-NAS kernel: tx_data returned -32, expecting 112.
Nov 22 01:32:10 RezDent-NAS kernel: iSCSI Login negotiation failed.
Nov 22 01:32:14 RezDent-NAS kernel: Unexpected ret: -32 send data 48
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892804
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892804
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892800
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892800
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892799
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892799
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892798
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892798
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892802
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892802
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892800
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892800
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892799
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892799
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892798
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892798
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892785
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892785
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892786
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892786
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 91892802
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 91892802
Nov 22 01:32:14 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 28274086
Nov 22 01:32:16 RezDent-NAS kernel: Detected MISCOMPARE for addr: ffff880176416000 buf: ffff8801b20b4400
Nov 22 01:32:16 RezDent-NAS kernel: Target/fileio: Send MISCOMPARE check condition and sense
Nov 22 01:32:16 RezDent-NAS kernel: Detected MISCOMPARE for addr: ffff880211a01000 buf: ffff8801b20b5600
Nov 22 01:32:16 RezDent-NAS kernel: Target/fileio: Send MISCOMPARE check condition and sense
Nov 22 01:32:16 RezDent-NAS kernel: Detected MISCOMPARE for addr: ffff8801b1f07000 buf: ffff8800b4c0e200
Nov 22 01:32:16 RezDent-NAS kernel: Target/fileio: Send MISCOMPARE check condition and sense
Nov 22 01:32:16 RezDent-NAS kernel: Detected MISCOMPARE for addr: ffff88018bee4000 buf: ffff88022da92800
Nov 22 01:32:16 RezDent-NAS kernel: Target/fileio: Send MISCOMPARE check condition and sense
Nov 22 01:32:29 RezDent-NAS rpc.mountd[6033]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
Nov 22 01:32:45 RezDent-NAS readynasd[3605]: failed setting new fan speed target: Permission denied
Nov 22 01:32:55 RezDent-NAS readynasd[3605]: failed setting new fan speed target: Permission denied
Nov 22 01:32:59 RezDent-NAS rpc.mountd[6033]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
Nov 22 01:33:05 RezDent-NAS readynasd[3605]: failed setting new fan speed target: Permission denied
Nov 22 01:33:15 RezDent-NAS readynasd[3605]: failed setting new fan speed target: Permission denied
Nov 22 01:33:25 RezDent-NAS readynasd[3605]: failed setting new fan speed target: Permission denied
Nov 22 01:33:25 RezDent-NAS clamd[2812]: SelfCheck: Database status OK.
Nov 22 01:33:25 RezDent-NAS clamd[2812]: SelfCheck: Database status OK.
Nov 22 01:33:29 RezDent-NAS rpc.mountd[6033]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
Nov 22 01:33:36 RezDent-NAS readynasd[3605]: failed setting new fan speed target: Permission denied
Nov 22 01:33:44 RezDent-NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
Nov 22 01:33:44 RezDent-NAS kernel: Unexpected ret: -32 send data 48
Nov 22 01:33:44 RezDent-NAS kernel: tx_data returned -32, expecting 48.
Nov 22 01:33:44 RezDent-NAS kernel: iSCSI Login negotiation failed.
Nov 22 01:33:46 RezDent-NAS readynasd[3605]: failed setting new fan speed target: Permission denied
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 21917671
Nov 22 01:33:53 RezDent-NAS kernel: Unable to locate ITT: 0x014e6fe7 on CID: 0
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 21917671
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 21917667
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 21917667
Nov 22 01:33:53 RezDent-NAS kernel: Unable to locate RefTaskTag: 0x014e6fe7 on CID: 0.
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 21917668
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 21917668
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 21917674
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 21917674
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 21917666
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 21917666
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 21917667
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 21917667
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 21917668
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 21917668
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 107591408
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 107591408
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 107591406
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 107591406
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 107591407
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 107591407
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 107591409
Nov 22 01:33:53 RezDent-NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 107591409
Nov 22 01:33:59 RezDent-NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
Nov 22 01:33:59 RezDent-NAS kernel: Unexpected ret: -32 send data 48
Nov 22 01:33:59 RezDent-NAS kernel: tx_data returned -32, expecting 48.
Nov 22 01:33:59 RezDent-NAS kernel: iSCSI Login negotiation failed.
Nov 22 01:33:59 RezDent-NAS rpc.mountd[6033]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
[10805354.146102] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:21712]
[10805382.145140] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:21712]
[10805414.144038] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:21712]
[10805442.143072] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:21712]
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: NMI watchdog BUG:soft lockup - CPU6 stuck for 22s! [iscsi_trx:212712]
Can someone tell me what is going on, with this NAS?
[ 23:17:06.531] 23:17:05 NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 30006815
[ 23:17:06.540] 23:17:06 NAS kernel: ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 30006815
[ 23:17:06.551] 23:17:06 NAS kernel: ABORT_TASK: Found referenced iSCSI task_tag: 30006854
[ 23:17:06.559] 23:17:06 NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 30006854
[ 23:17:06.568] 23:17:06 NAS kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 30006814
[ 23:17:06.579] 23:17:06 NAS kernel: Detected MISCOMPARE for addr: ffff8801f42c1000 buf: ffff880233d7ac00
[ 23:17:06.590] 23:17:06 NAS kernel: Target/fileio: Send MISCOMPARE check condition and sense
[ 23:17:29.454] 23:17:29 NAS rpc.mountd[15735]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
[ 23:17:32.646] [116613.548167] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:17:32.954] 23:17:32 NAS kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:17:32.965] 23:17:32 NAS kernel: Modules linked in: vpd(PO)
[ 23:17:32.970] 23:17:32 NAS kernel: CPU: 6 PID: 10426 Comm: iscsi_trx Tainted: P O 4.4.116.x86_64.1 #1
[ 23:17:32.982] 23:17:32 NAS kernel: Hardware name: Supermicro X8SIE/X8SIE, BIOS 1.1 01/27/11
[ 23:17:32.993] 23:17:32 NAS kernel: task: ffff880198e63f00 ti: ffff880100764000 task.ti: ffff880100764000
[ 23:17:33.003] 23:17:32 NAS kernel: RIP: 0010:[<ffffffff88675f35>] [<ffffffff88675f35>] __iscsit_free_cmd+0x1d5/0x240
[ 23:17:33.014] 23:17:32 NAS kernel: RSP: 0018:ffff880100767d18 EFLAGS: 00000246
[ 23:17:33.023] 23:17:32 NAS kernel: RAX: 0000000000000000 RBX: ffff880100897580 RCX: ffff880100897760
[ 23:17:33.032] 23:17:32 NAS kernel: RDX: 0000000000000001 RSI: 0000000000000200 RDI: ffffffff8866bc24
[ 23:17:33.043] 23:17:32 NAS kernel: RBP: ffff880100767d48 R08: ffffffffffffffff R09: 0000000000000000
[ 23:17:33.053] 23:17:32 NAS kernel: R10: ffffffff88e880c0 R11: 0000000000000000 R12: 0000000000000000
[ 23:17:33.063] 23:17:32 NAS kernel: R13: 0000000000000000 R14: ffff8801005d6800 R15: 0000000000000001
[ 23:17:33.072] 23:17:32 NAS kernel: FS: 0000000000000000(0000) GS:ffff88023fd80000(0000) knlGS:0000000000000000
[ 23:17:33.083] 23:17:32 NAS kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 23:17:33.093] 23:17:32 NAS kernel: CR2: 00007f59b2b14011 CR3: 0000000008e8a000 CR4: 0000000000000670
[ 23:17:33.102] 23:17:32 NAS kernel: Stack:
[ 23:17:33.107] 23:17:32 NAS kernel: 0000000000767d28 ffff880100897580 0000000000000000 0000000000000000
[ 23:17:33.118] 23:17:32 NAS kernel: ffff880100897770 0000000000000001 ffff880100767d80 ffffffff8867600a
[ 23:17:33.128] 23:17:32 NAS kernel: ffff880100897580 ffff880100767da0 ffff8801005d6c18 ffff8801005d6a38
[ 23:17:33.140] 23:17:32 NAS kernel: Call Trace:
[ 23:17:33.145] 23:17:32 NAS kernel: [<ffffffff8867600a>] iscsit_free_cmd+0x6a/0x120
[ 23:17:33.152] 23:17:32 NAS kernel: [<ffffffff88677a91>] iscsit_ack_from_expstatsn+0x151/0x180
[ 23:17:33.162] 23:17:32 NAS kernel: [<ffffffff88678737>] iscsit_process_scsi_cmd+0x27/0xc0
[ 23:17:33.171] 23:17:32 NAS kernel: [<ffffffff8867b89e>] iscsi_target_rx_thread+0x41e/0xe00
[ 23:17:33.180] 23:17:32 NAS kernel: [<ffffffff8809e152>] ? pick_next_task_fair+0xf2/0x470
[ 23:17:33.189] 23:17:32 NAS kernel: [<ffffffff8867b480>] ? iscsi_target_tx_thread+0x1e0/0x1e0
[ 23:17:33.199] 23:17:32 NAS kernel: [<ffffffff88089356>] kthread+0xe6/0x100
[ 23:17:33.206] 23:17:32 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:17:33.216] 23:17:32 NAS kernel: [<ffffffff88a731c5>] ret_from_fork+0x55/0x80
[ 23:17:33.225] 23:17:32 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:17:33.235] 23:17:32 NAS kernel: Code: 00 02 48 89 46 18 e8 cb e8 ab ff e9 4b ff ff ff 48 89 df 89 55 d4 e8 eb 3d ff ff 8b 55 d4 e9 6b fe ff ff 89 55 d4 e8 9b 5c ff ff <48> 89 df e8 63 f2 ff ff 8b 83 a0 00 00 00 8b 55 d4 e9 44 fe ff
[ 23:17:33.453] 23:17:32 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:17:43.453] 23:17:42 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:17:49.453] 23:17:49 NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
[ 23:17:49.463] 23:17:49 NAS kernel: Unexpected ret: -32 send data 48
[ 23:17:49.470] 23:17:49 NAS kernel: tx_data returned -32, expecting 48.
[ 23:17:49.477] 23:17:49 NAS kernel: iSCSI Login negotiation failed.
[ 23:17:57.703] 23:17:57 NAS apache_access[5225]: 172.26.12.213 "GET /stimg?type=temperature&name=&value=deg&period=1_hour&width=2260&height=275&back=ffffff&randParam=0.04130017001367481 HTTP/1.1" 200
[ 23:17:58.704] 23:17:58 NAS apache_access[5225]: 172.26.12.213 "GET /stimg?type=network&name=&value=pkts&period=1_hour&width=2240&height=275&back=ffffff&proto=&randParam=0.3608568883704806 HTTP/1.1" 200
[ 23:17:58.721] 23:17:58 NAS apache_access[5225]: 172.26.12.213 "GET /stimg?type=volume&name=&value=utilizn&period=1_hour&width=2240&height=289&back=ffffff&randParam=0.8210939034783025 HTTP/1.1" 200
[ 23:17:58.740] 23:17:58 NAS apache_access[5225]: 172.26.12.213 "GET /stimg?type=volume&name=&value=oper&period=1_hour&width=2260&height=331&back=ffffff&randParam=0.4280183435616365 HTTP/1.1" 200
[ 23:17:59.454] 23:17:59 NAS rpc.mountd[15735]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
[ 23:18:00.646] [116641.545221] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:18:00.954] 23:18:00 NAS kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:18:00.965] 23:18:00 NAS kernel: Modules linked in: vpd(PO)
[ 23:18:00.971] 23:18:00 NAS kernel: CPU: 6 PID: 10426 Comm: iscsi_trx Tainted: P O L 4.4.116.x86_64.1 #1
[ 23:18:00.982] 23:18:00 NAS kernel: Hardware name: Supermicro X8SIE/X8SIE, BIOS 1.1 01/27/11
[ 23:18:00.992] 23:18:00 NAS kernel: task: ffff880198e63f00 ti: ffff880100764000 task.ti: ffff880100764000
[ 23:18:01.003] 23:18:00 NAS kernel: RIP: 0010:[<ffffffff8807276e>] [<ffffffff8807276e>] __local_bh_enable_ip+0x3e/0x90
[ 23:18:01.015] 23:18:00 NAS kernel: RSP: 0018:ffff880100767cd8 EFLAGS: 00000246
[ 23:18:01.023] 23:18:00 NAS kernel: RAX: 0000000000000000 RBX: ffff880100897580 RCX: ffff880100897760
[ 23:18:01.032] 23:18:00 NAS kernel: RDX: 0000000000000001 RSI: 0000000000000200 RDI: ffffffff8866bc24
[ 23:18:01.043] 23:18:00 NAS kernel: RBP: ffff880100767cd8 R08: 0000000000000001 R09: 0000000000000040
[ 23:18:01.053] 23:18:00 NAS kernel: R10: ffffffff88e880c0 R11: ffff8801e21bfc00 R12: ffff880100897664
[ 23:18:01.063] 23:18:00 NAS kernel: R13: 0000000000000000 R14: ffff8801005d6800 R15: 0000000000000001
[ 23:18:01.073] 23:18:00 NAS kernel: FS: 0000000000000000(0000) GS:ffff88023fd80000(0000) knlGS:0000000000000000
[ 23:18:01.084] 23:18:00 NAS kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 23:18:01.093] 23:18:00 NAS kernel: CR2: 00007f59b2b14011 CR3: 0000000008e8a000 CR4: 0000000000000670
[ 23:18:01.102] 23:18:00 NAS kernel: Stack:
[ 23:18:01.107] 23:18:00 NAS kernel: ffff880100767ce8 ffffffff88a72955 ffff880100767d08 ffffffff8866bc24
[ 23:18:01.118] 23:18:00 NAS kernel: ffff880100897580 0000000000000000 ffff880100767d48 ffffffff88675f35
[ 23:18:01.128] 23:18:00 NAS kernel: 0000000000767d28 ffff880100897580 0000000000000000 0000000000000000
[ 23:18:01.138] 23:18:00 NAS kernel: Call Trace:
[ 23:18:01.143] 23:18:00 NAS kernel: [<ffffffff88a72955>] _raw_spin_unlock_bh+0x15/0x20
[ 23:18:01.152] 23:18:00 NAS kernel: [<ffffffff8866bc24>] iscsit_stop_dataout_timer+0x54/0x80
[ 23:18:01.162] 23:18:00 NAS kernel: [<ffffffff88675f35>] __iscsit_free_cmd+0x1d5/0x240
[ 23:18:01.172] 23:18:00 NAS kernel: [<ffffffff8867600a>] iscsit_free_cmd+0x6a/0x120
[ 23:18:01.179] 23:18:00 NAS kernel: [<ffffffff88677a91>] iscsit_ack_from_expstatsn+0x151/0x180
[ 23:18:01.189] 23:18:00 NAS kernel: [<ffffffff88678737>] iscsit_process_scsi_cmd+0x27/0xc0
[ 23:18:01.198] 23:18:00 NAS kernel: [<ffffffff8867b89e>] iscsi_target_rx_thread+0x41e/0xe00
[ 23:18:01.207] 23:18:00 NAS kernel: [<ffffffff8809e152>] ? pick_next_task_fair+0xf2/0x470
[ 23:18:01.216] 23:18:00 NAS kernel: [<ffffffff8867b480>] ? iscsi_target_tx_thread+0x1e0/0x1e0
[ 23:18:01.229] 23:18:00 NAS kernel: [<ffffffff88089356>] kthread+0xe6/0x100
[ 23:18:01.234] 23:18:00 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:18:01.243] 23:18:00 NAS kernel: [<ffffffff88a731c5>] ret_from_fork+0x55/0x80
[ 23:18:01.251] 23:18:00 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:18:01.261] 23:18:00 NAS kernel: Code: 75 2b 9c 58 f6 c4 02 74 24 83 eb 01 f7 db 65 01 1d 00 ae f9 77 65 8b 05 f9 ad f9 77 a9 00 ff 1f 00 74 2d 5b 65 ff 0d ea ad f9 77 <5d> c3 80 3d 71 e4 ec 00 00 75 d3 be 96 00 00 00 48 c7 c7 44 f9
[ 23:18:04.453] 23:18:04 NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
[ 23:18:04.463] 23:18:04 NAS kernel: Unexpected ret: -32 send data 48
[ 23:18:04.470] 23:18:04 NAS kernel: tx_data returned -32, expecting 48.
[ 23:18:04.477] 23:18:04 NAS kernel: iSCSI Login negotiation failed.
[ 23:18:06.128] 23:18:05 NAS kernel: INFO: rcu_sched self-detected stall on CPU
[ 23:18:06.138] 23:18:06 NAS kernel: 6-...: (59985 ticks this GP) idle=64f/140000000000001/0 softirq=2302788/2302788 fqs=19987
[ 23:18:06.153] 23:18:06 NAS kernel: (t=60000 jiffies g=2192232 c=2192231 q=19597)
[ 23:18:06.160] 23:18:06 NAS kernel: Task dump for CPU 6:
[ 23:18:06.164] 23:18:06 NAS kernel: iscsi_trx R running task 0 10426 2 0x00000008
[ 23:18:06.173] 23:18:06 NAS kernel: ffffffff88eadb00 ffff88023fd83dc8 ffffffff8809263a 0000000000000006
[ 23:18:06.185] 23:18:06 NAS kernel: ffffffff88eadb00 ffff88023fd83de0 ffffffff88094774 0000000000000007
[ 23:18:06.194] 23:18:06 NAS kernel: ffff88023fd83e10 ffffffff880b3456 ffff88023fd95080 ffffffff88eadb00
[ 23:18:06.204] 23:18:06 NAS kernel: Call Trace:
[ 23:18:06.210] 23:18:06 NAS kernel: <IRQ> [<ffffffff8809263a>] sched_show_task+0xaa/0x110
[ 23:18:06.220] 23:18:06 NAS kernel: [<ffffffff88094774>] dump_cpu_task+0x34/0x40
[ 23:18:06.227] 23:18:06 NAS kernel: [<ffffffff880b3456>] rcu_dump_cpu_stacks+0x86/0xc0
[ 23:18:06.234] 23:18:06 NAS kernel: [<ffffffff880b6a26>] rcu_check_callbacks+0x3f6/0x6d0
[ 23:18:06.244] 23:18:06 NAS kernel: [<ffffffff880b95b4>] update_process_times+0x34/0x60
[ 23:18:06.253] 23:18:06 NAS kernel: [<ffffffff880c6d80>] tick_sched_handle.isra.18+0x20/0x50
[ 23:18:06.263] 23:18:06 NAS kernel: [<ffffffff880c6de8>] tick_sched_timer+0x38/0x70
[ 23:18:06.273] 23:18:06 NAS kernel: [<ffffffff880b9c6c>] __hrtimer_run_queues+0x9c/0x110
[ 23:18:06.280] 23:18:06 NAS kernel: [<ffffffff880ba1e3>] hrtimer_interrupt+0xa3/0x190
[ 23:18:06.289] 23:18:06 NAS kernel: [<ffffffff88030f43>] local_apic_timer_interrupt+0x33/0x60
[ 23:18:06.298] 23:18:06 NAS kernel: [<ffffffff88031688>] smp_apic_timer_interrupt+0x38/0x50
[ 23:18:06.307] 23:18:06 NAS kernel: [<ffffffff88a73b93>] apic_timer_interrupt+0x93/0xa0
[ 23:18:06.317] 23:18:06 NAS kernel: <EOI> [<ffffffff886751b3>] ? iscsit_free_r2ts_from_list+0x13/0x90
[ 23:18:06.326] 23:18:06 NAS kernel: [<ffffffff88675f3d>] __iscsit_free_cmd+0x1dd/0x240
[ 23:18:06.335] 23:18:06 NAS kernel: [<ffffffff8867600a>] iscsit_free_cmd+0x6a/0x120
[ 23:18:06.343] 23:18:06 NAS kernel: [<ffffffff88677a91>] iscsit_ack_from_expstatsn+0x151/0x180
[ 23:18:06.353] 23:18:06 NAS kernel: [<ffffffff88678737>] iscsit_process_scsi_cmd+0x27/0xc0
[ 23:18:06.362] 23:18:06 NAS kernel: [<ffffffff8867b89e>] iscsi_target_rx_thread+0x41e/0xe00
[ 23:18:06.372] 23:18:06 NAS kernel: [<ffffffff8809e152>] ? pick_next_task_fair+0xf2/0x470
[ 23:18:06.384] 23:18:06 NAS kernel: [<ffffffff8867b480>] ? iscsi_target_tx_thread+0x1e0/0x1e0
[ 23:18:06.391] 23:18:06 NAS kernel: [<ffffffff88089356>] kthread+0xe6/0x100
[ 23:18:06.398] 23:18:06 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:18:06.408] 23:18:06 NAS kernel: [<ffffffff88a731c5>] ret_from_fork+0x55/0x80
[ 23:18:06.418] 23:18:06 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: NMI watchdog BUG:soft lockup - CPU6 stuck for 22s! [iscsi_trx:212712]
[ 23:18:19.453] 23:18:19 NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
[ 23:18:19.463] 23:18:19 NAS kernel: Unexpected ret: -32 send data 48
[ 23:18:19.470] 23:18:19 NAS kernel: tx_data returned -32, expecting 48.
[ 23:18:19.477] 23:18:19 NAS kernel: iSCSI Login negotiation failed.
[ 23:18:29.454] 23:18:29 NAS rpc.mountd[15735]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
[ 23:18:30.454] 23:18:30 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:18:32.646] [116673.541859] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:18:33.646] 23:18:32 NAS kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:18:33.658] 23:18:32 NAS kernel: Modules linked in: vpd(PO)
[ 23:18:33.664] 23:18:33 NAS kernel: CPU: 6 PID: 10426 Comm: iscsi_trx Tainted: P O L 4.4.116.x86_64.1 #1
[ 23:18:33.676] 23:18:33 NAS kernel: Hardware name: Supermicro X8SIE/X8SIE, BIOS 1.1 01/27/11
[ 23:18:33.684] 23:18:33 NAS kernel: task: ffff880198e63f00 ti: ffff880100764000 task.ti: ffff880100764000
[ 23:18:33.695] 23:18:33 NAS kernel: RIP: 0010:[<ffffffff88a72a76>] [<ffffffff88a72a76>] _raw_spin_lock_bh+0x16/0x30
[ 23:18:33.707] 23:18:33 NAS kernel: RSP: 0018:ffff880100767ce8 EFLAGS: 00000246
[ 23:18:33.714] 23:18:33 NAS kernel: RAX: 0000000000000000 RBX: ffff880100897688 RCX: ffff880100897760
[ 23:18:33.725] 23:18:33 NAS kernel: RDX: 0000000000000001 RSI: 0000000000000200 RDI: ffff880100897670
[ 23:18:33.736] 23:18:33 NAS kernel: RBP: ffff880100767d08 R08: 0000000000000000 R09: ffff8800b91ec780
[ 23:18:33.745] 23:18:33 NAS kernel: R10: ffffffff88e880c0 R11: 0000000000000000 R12: ffff880100897670
[ 23:18:33.755] 23:18:33 NAS kernel: R13: 0000000000000000 R14: ffff8801005d6800 R15: 0000000000000001
[ 23:18:33.765] 23:18:33 NAS kernel: FS: 0000000000000000(0000) GS:ffff88023fd80000(0000) knlGS:0000000000000000
[ 23:18:33.776] 23:18:33 NAS kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 23:18:33.784] 23:18:33 NAS kernel: CR2: 00007f59b2b14011 CR3: 0000000008e8a000 CR4: 0000000000000670
[ 23:18:33.795] 23:18:33 NAS kernel: Stack:
[ 23:18:33.800] 23:18:33 NAS kernel: ffffffff886751c2 ffff880100897580 0000000000000000 0000000000000000
[ 23:18:33.810] 23:18:33 NAS kernel: ffff880100767d48 ffffffff88675f3d 0000000000767d28 ffff880100897580
[ 23:18:33.822] 23:18:33 NAS kernel: 0000000000000000 0000000000000000 ffff880100897770 0000000000000001
[ 23:18:33.830] 23:18:33 NAS kernel: Call Trace:
[ 23:18:33.835] 23:18:33 NAS kernel: [<ffffffff886751c2>] ? iscsit_free_r2ts_from_list+0x22/0x90
[ 23:18:33.845] 23:18:33 NAS kernel: [<ffffffff88675f3d>] __iscsit_free_cmd+0x1dd/0x240
[ 23:18:33.854] 23:18:33 NAS kernel: [<ffffffff8867600a>] iscsit_free_cmd+0x6a/0x120
[ 23:18:33.862] 23:18:33 NAS kernel: [<ffffffff88677a91>] iscsit_ack_from_expstatsn+0x151/0x180
[ 23:18:33.873] 23:18:33 NAS kernel: [<ffffffff88678737>] iscsit_process_scsi_cmd+0x27/0xc0
[ 23:18:33.882] 23:18:33 NAS kernel: [<ffffffff8867b89e>] iscsi_target_rx_thread+0x41e/0xe00
[ 23:18:33.891] 23:18:33 NAS kernel: [<ffffffff8809e152>] ? pick_next_task_fair+0xf2/0x470
[ 23:18:33.900] 23:18:33 NAS kernel: [<ffffffff8867b480>] ? iscsi_target_tx_thread+0x1e0/0x1e0
[ 23:18:33.909] 23:18:33 NAS kernel: [<ffffffff88089356>] kthread+0xe6/0x100
[ 23:18:33.918] 23:18:33 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:18:33.927] 23:18:33 NAS kernel: [<ffffffff88a731c5>] ret_from_fork+0x55/0x80
[ 23:18:33.935] 23:18:33 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:18:33.945] 23:18:33 NAS kernel: Code: 17 85 c0 75 01 c3 55 89 c6 48 89 e5 e8 a4 2d 63 ff 5d c3 66 90 65 81 05 ed aa 59 77 00 02 00 00 31 c0 ba 01 00 00 00 f0 0f b1 17 <85> c0 75 01 c3 55 89 c6 48 89 e5 e8 7a 2d 63 ff 5d c3 0f 1f 84
[ 23:18:34.703] 23:18:34 NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
[ 23:18:34.713] 23:18:34 NAS kernel: Unexpected ret: -32 send data 48
[ 23:18:34.719] 23:18:34 NAS kernel: tx_data returned -32, expecting 48.
[ 23:18:34.729] 23:18:34 NAS kernel: iSCSI Login negotiation failed.
[ 23:18:40.453] 23:18:40 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:18:42.954] 23:18:42 NAS clamd[389]: SelfCheck: Database status OK.
[ 23:18:42.961] 23:18:42 NAS clamd[389]: SelfCheck: Database status OK.
[ 23:18:49.703] 23:18:49 NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
[ 23:18:49.713] 23:18:49 NAS kernel: Unexpected ret: -32 send data 48
[ 23:18:49.719] 23:18:49 NAS kernel: tx_data returned -32, expecting 48.
[ 23:18:49.730] 23:18:49 NAS kernel: iSCSI Login negotiation failed.
[ 23:18:50.453] 23:18:50 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:18:59.454] 23:18:59 NAS rpc.mountd[15735]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
[ 23:19:00.453] 23:19:00 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:19:00.645] [116701.538920] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:19:00.953] 23:19:00 NAS kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:19:00.965] 23:19:00 NAS kernel: Modules linked in: vpd(PO)
[ 23:19:00.971] 23:19:00 NAS kernel: CPU: 6 PID: 10426 Comm: iscsi_trx Tainted: P O L 4.4.116.x86_64.1 #1
[ 23:19:00.983] 23:19:00 NAS kernel: Hardware name: Supermicro X8SIE/X8SIE, BIOS 1.1 01/27/11
[ 23:19:00.992] 23:19:00 NAS kernel: task: ffff880198e63f00 ti: ffff880100764000 task.ti: ffff880100764000
[ 23:19:01.002] 23:19:00 NAS kernel: RIP: 0010:[<ffffffff88a72a76>] [<ffffffff88a72a76>] _raw_spin_lock_bh+0x16/0x30
[ 23:19:01.014] 23:19:00 NAS kernel: RSP: 0018:ffff880100767ce8 EFLAGS: 00000246
[ 23:19:01.023] 23:19:00 NAS kernel: RAX: 0000000000000000 RBX: ffff880100897688 RCX: ffff880100897760
[ 23:19:01.033] 23:19:00 NAS kernel: RDX: 0000000000000001 RSI: 0000000000000200 RDI: ffff880100897670
[ 23:19:01.042] 23:19:00 NAS kernel: RBP: ffff880100767d08 R08: 0000000000300000 R09: 0000000000000040
[ 23:19:01.053] 23:19:00 NAS kernel: R10: ffffffff88e880c0 R11: 0000000000180000 R12: ffff880100897670
[ 23:19:01.062] 23:19:00 NAS kernel: R13: 0000000000000000 R14: ffff8801005d6800 R15: 0000000000000001
[ 23:19:01.073] 23:19:00 NAS kernel: FS: 0000000000000000(0000) GS:ffff88023fd80000(0000) knlGS:0000000000000000
[ 23:19:01.083] 23:19:00 NAS kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 23:19:01.093] 23:19:00 NAS kernel: CR2: 00007f59b2b14011 CR3: 0000000008e8a000 CR4: 0000000000000670
[ 23:19:01.102] 23:19:00 NAS kernel: Stack:
[ 23:19:01.107] 23:19:00 NAS kernel: ffffffff886751c2 ffff880100897580 0000000000000000 0000000000000000
[ 23:19:01.118] 23:19:00 NAS kernel: ffff880100767d48 ffffffff88675f3d 0000000000767d28 ffff880100897580
[ 23:19:01.127] 23:19:00 NAS kernel: 0000000000000000 0000000000000000 ffff880100897770 0000000000000001
[ 23:19:01.139] 23:19:00 NAS kernel: Call Trace:
[ 23:19:01.143] 23:19:00 NAS kernel: [<ffffffff886751c2>] ? iscsit_free_r2ts_from_list+0x22/0x90
[ 23:19:01.154] 23:19:00 NAS kernel: [<ffffffff88675f3d>] __iscsit_free_cmd+0x1dd/0x240
[ 23:19:01.162] 23:19:00 NAS kernel: [<ffffffff8867600a>] iscsit_free_cmd+0x6a/0x120
[ 23:19:01.170] 23:19:00 NAS kernel: [<ffffffff88677a91>] iscsit_ack_from_expstatsn+0x151/0x180
[ 23:19:01.180] 23:19:00 NAS kernel: [<ffffffff88678737>] iscsit_process_scsi_cmd+0x27/0xc0
[ 23:19:01.190] 23:19:00 NAS kernel: [<ffffffff8867b89e>] iscsi_target_rx_thread+0x41e/0xe00
[ 23:19:01.200] 23:19:00 NAS kernel: [<ffffffff8809e152>] ? pick_next_task_fair+0xf2/0x470
[ 23:19:01.209] 23:19:00 NAS kernel: [<ffffffff8867b480>] ? iscsi_target_tx_thread+0x1e0/0x1e0
[ 23:19:01.216] 23:19:00 NAS kernel: [<ffffffff88089356>] kthread+0xe6/0x100
[ 23:19:01.226] 23:19:00 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:19:01.234] 23:19:00 NAS kernel: [<ffffffff88a731c5>] ret_from_fork+0x55/0x80
[ 23:19:01.242] 23:19:00 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:19:01.255] 23:19:00 NAS kernel: Code: 17 85 c0 75 01 c3 55 89 c6 48 89 e5 e8 a4 2d 63 ff 5d c3 66 90 65 81 05 ed aa 59 77 00 02 00 00 31 c0 ba 01 00 00 00 f0 0f b1 17 <85> c0 75 01 c3 55 89 c6 48 89 e5 e8 7a 2d 63 ff 5d c3 0f 1f 84
[ 23:19:04.703] 23:19:04 NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
[ 23:19:04.714] 23:19:04 NAS kernel: Unexpected ret: -32 send data 48
[ 23:19:04.720] 23:19:04 NAS kernel: tx_data returned -32, expecting 48.
[ 23:19:04.727] 23:19:04 NAS kernel: iSCSI Login negotiation failed.
[ 23:19:04.734] 23:19:04 NAS apache_access[5225]: 172.26.12.213 "GET /stimg?type=temperature&name=&value=deg&period=1_hour&width=2260&height=275&back=ffffff&randParam=0.22279223838375106 HTTP/1.1" 200
[ 23:19:05.703] 23:19:05 NAS apache_access[5225]: 172.26.12.213 "GET /stimg?type=network&name=&value=pkts&period=1_hour&width=2240&height=275&back=ffffff&proto=&randParam=0.504218891249024 HTTP/1.1" 200
[ 23:19:05.721] 23:19:05 NAS apache_access[5225]: 172.26.12.213 "GET /stimg?type=volume&name=&value=oper&period=1_hour&width=2260&height=331&back=ffffff&randParam=0.10311969461024173 HTTP/1.1" 200
[ 23:19:06.703] 23:19:06 NAS apache_access[5225]: 172.26.12.213 "GET /stimg?type=volume&name=&value=utilizn&period=1_hour&width=2240&height=289&back=ffffff&randParam=0.53841887233619 HTTP/1.1" 200
[ 23:19:10.453] 23:19:10 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:19:19.703] 23:19:19 NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
[ 23:19:19.712] 23:19:19 NAS kernel: Unexpected ret: -32 send data 48
[ 23:19:19.720] 23:19:19 NAS kernel: tx_data returned -32, expecting 48.
[ 23:19:19.727] 23:19:19 NAS kernel: iSCSI Login negotiation failed.
[ 23:19:20.453] 23:19:20 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:19:28.646] [116729.535984] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:19:28.953] 23:19:28 NAS kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:19:28.965] 23:19:28 NAS kernel: Modules linked in: vpd(PO)
[ 23:19:28.971] 23:19:28 NAS kernel: CPU: 6 PID: 10426 Comm: iscsi_trx Tainted: P O L 4.4.116.x86_64.1 #1
[ 23:19:28.983] 23:19:28 NAS kernel: Hardware name: Supermicro X8SIE/X8SIE, BIOS 1.1 01/27/11
[ 23:19:28.993] 23:19:28 NAS kernel: task: ffff880198e63f00 ti: ffff880100764000 task.ti: ffff880100764000
[ 23:19:29.002] 23:19:28 NAS kernel: RIP: 0010:[<ffffffff88a72a76>] [<ffffffff88a72a76>] _raw_spin_lock_bh+0x16/0x30
[ 23:19:29.017] 23:19:28 NAS kernel: RSP: 0018:ffff880100767ce8 EFLAGS: 00000246
[ 23:19:29.022] 23:19:28 NAS kernel: RAX: 0000000000000000 RBX: ffff880100897688 RCX: ffff880100897760
[ 23:19:29.033] 23:19:28 NAS kernel: RDX: 0000000000000001 RSI: 0000000000000200 RDI: ffff880100897670
[ 23:19:29.043] 23:19:28 NAS kernel: RBP: ffff880100767d08 R08: 0000000000004e20 R09: 0000000000000040
[ 23:19:29.053] 23:19:28 NAS kernel: R10: ffffffff88e880c0 R11: ffffea000403bc00 R12: ffff880100897670
[ 23:19:29.062] 23:19:28 NAS kernel: R13: 0000000000000000 R14: ffff8801005d6800 R15: 0000000000000001
[ 23:19:29.072] 23:19:28 NAS kernel: FS: 0000000000000000(0000) GS:ffff88023fd80000(0000) knlGS:0000000000000000
[ 23:19:29.084] 23:19:28 NAS kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 23:19:29.093] 23:19:28 NAS kernel: CR2: 00007f59b2b14011 CR3: 0000000008e8a000 CR4: 0000000000000670
[ 23:19:29.102] 23:19:28 NAS kernel: Stack:
[ 23:19:29.108] 23:19:28 NAS kernel: ffffffff886751c2 ffff880100897580 0000000000000000 0000000000000000
[ 23:19:29.118] 23:19:28 NAS kernel: ffff880100767d48 ffffffff88675f3d 0000000000767d28 ffff880100897580
[ 23:19:29.128] 23:19:28 NAS kernel: 0000000000000000 0000000000000000 ffff880100897770 0000000000000001
[ 23:19:29.138] 23:19:28 NAS kernel: Call Trace:
[ 23:19:29.144] 23:19:28 NAS kernel: [<ffffffff886751c2>] ? iscsit_free_r2ts_from_list+0x22/0x90
[ 23:19:29.154] 23:19:28 NAS kernel: [<ffffffff88675f3d>] __iscsit_free_cmd+0x1dd/0x240
[ 23:19:29.163] 23:19:28 NAS kernel: [<ffffffff8867600a>] iscsit_free_cmd+0x6a/0x120
[ 23:19:29.170] 23:19:28 NAS kernel: [<ffffffff88677a91>] iscsit_ack_from_expstatsn+0x151/0x180
[ 23:19:29.180] 23:19:28 NAS kernel: [<ffffffff88678737>] iscsit_process_scsi_cmd+0x27/0xc0
[ 23:19:29.191] 23:19:28 NAS kernel: [<ffffffff8867b89e>] iscsi_target_rx_thread+0x41e/0xe00
[ 23:19:29.199] 23:19:28 NAS kernel: [<ffffffff8809e152>] ? pick_next_task_fair+0xf2/0x470
[ 23:19:29.208] 23:19:28 NAS kernel: [<ffffffff8867b480>] ? iscsi_target_tx_thread+0x1e0/0x1e0
[ 23:19:29.216] 23:19:28 NAS kernel: [<ffffffff88089356>] kthread+0xe6/0x100
[ 23:19:29.226] 23:19:28 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:19:29.233] 23:19:28 NAS kernel: [<ffffffff88a731c5>] ret_from_fork+0x55/0x80
[ 23:19:29.242] 23:19:28 NAS kernel: [<ffffffff88089270>] ? kthread_create_on_node+0x170/0x170
[ 23:19:29.253] 23:19:28 NAS kernel: Code: 17 85 c0 75 01 c3 55 89 c6 48 89 e5 e8 a4 2d 63 ff 5d c3 66 90 65 81 05 ed aa 59 77 00 02 00 00 31 c0 ba 01 00 00 00 f0 0f b1 17 <85> c0 75 01 c3 55 89 c6 48 89 e5 e8 7a 2d 63 ff 5d c3 0f 1f 84
[ 23:19:29.453] 23:19:29 NAS rpc.mountd[15735]: refused mount request from 192.168.97.18 for /c/ESXi (/): not exported
[ 23:19:30.453] 23:19:30 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:19:34.703] 23:19:34 NAS kernel: iSCSI Login timeout on Network Portal 192.168.94.8:3260
[ 23:19:34.712] 23:19:34 NAS kernel: Unexpected ret: -32 send data 48
[ 23:19:34.719] 23:19:34 NAS kernel: tx_data returned -32, expecting 48.
[ 23:19:34.727] 23:19:34 NAS kernel: iSCSI Login negotiation failed.
[ 23:19:40.453] 23:19:40 NAS readynasd[4525]: failed setting new fan speed target: Permission denied
[ 23:19:56.646] [116757.533053] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:20:24.646] [116785.530125] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:10426]
[ 23:20:52.645] [116813.527200] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:10426]
[ 23:21:32.645] [116853.523026] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:10426]
[ 23:22:00.646] [116881.520106] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:22:28.646] [116909.517189] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:22:56.646] [116937.514273] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:23:24.646] [116965.511360] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:23:52.646] [116993.508446] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:24:32.648] [117033.504287] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:25:00.648] [117061.501376] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:10426]
[ 23:25:28.649] [117089.498466] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:10426]
[ 23:25:56.648] [117117.495558] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:10426]
[ 23:26:24.648] [117145.492650] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:10426]
[ 23:26:52.647] [117173.489743] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [iscsi_trx:10426]
[ 23:27:32.647] [117213.485591] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:28:00.648] [117241.482686] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:28:28.648] [117269.479779] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:28:56.648] [117297.476874] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:29:03.103] ^C
[ 23:29:03.103] root@NAS:~# reboot -f
[ 23:29:18.371] kk
[ 23:29:24.648] [117325.474037] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:29:52.648] [117353.471227] NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [iscsi_trx:10426]
[ 23:29:54.466] q^C
[ 23:29:56.650] ^C