NV+ v2 Kernel bug reported when under heavy load via AFP
Hi folks,
This message may need to be moved to a different section of the forum, because it might be a general ARM kernel problem rather than an AFP-specific problem, but I have only experienced it using AFP.
I recently purchased a NV+ v2 and loaded it with a single 3TB drive (more 3TB disks to come when I need them and they're cheaper). This is my first NAS - up until now everything has been on separate computers, and I'm looking to centralise bulk storage - so the first thing I've had to do is dump a LOT of data onto the drive, from a few different machines (sometimes at once). A couple of times in the initial process of setting up TM backups, but more repeatedly today during a particular transfer task, the NAS has partially stopped responding: it's still online and the shares can be accessed, but in one case the admin interface became inaccessible, and in a couple of cases today it stopped processing data/connections from one particular computer. In all cases, to restore normal operation I've needed to reboot it, and when I've rebooted it with a disk scan, it's turned up a couple of repairable errors (presumably as a result of the crash itself). Today I found that when I tried to dump more than dozen GB or so of data on it (over gigabit ethernet all the way, so pretty quickly), it would stop responding to that computer after a while, and the following error showed up in the system log:
Oct 7 16:02:36 The_Library kernel: kernel BUG at mm/filemap.c:1939! Oct 7 16:02:36 The_Library kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000000 Oct 7 16:02:36 The_Library kernel: pgd = c9bac000 Oct 7 16:02:36 The_Library kernel: [00000000] *pgd=093f6031, *pte=00000000, *ppte=00000000 Oct 7 16:02:36 The_Library kernel: Internal error: Oops: 817 [#1] Oct 7 16:02:36 The_Library kernel: Modules linked in: tntfs(P) armvpd(P) Oct 7 16:02:36 The_Library kernel: CPU: 0 Tainted: P (2.6.31.8.nv+v2 #1) Oct 7 16:02:36 The_Library kernel: PC is at __bug+0x18/0x24 Oct 7 16:02:36 The_Library kernel: LR is at __bug+0x14/0x24 Oct 7 16:02:36 The_Library kernel: pc : [<c002c8a8>] lr : [<c002c8a4>] psr: 20000013 Oct 7 16:02:36 The_Library kernel: sp : cd307d60 ip : 0000397c fp : 00000000 Oct 7 16:02:36 The_Library kernel: r10: cd306000 r9 : 00000000 r8 : 00000fec Oct 7 16:02:36 The_Library kernel: r7 : 00000000 r6 : 0448f000 r5 : 00001014 r4 : 000012c0 Oct 7 16:02:36 The_Library kernel: r3 : 00000000 r2 : cd307d54 r1 : c05950b3 r0 : 00000027 Oct 7 16:02:36 The_Library kernel: Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user Oct 7 16:02:36 The_Library kernel: Control: 0005397f Table: 09bac000 DAC: 00000015 Oct 7 16:02:36 The_Library kernel: Process afpd (pid: 2765, stack limit = 0xcd306270) Oct 7 16:02:36 The_Library kernel: Stack: (0xcd307d60 to 0xcd308000) Oct 7 16:02:36 The_Library kernel: 7d60: 000012c0 c009a478 000012c0 c009bf4c 00000fec 000012c0 c08d0ae0 00000000 Oct 7 16:02:36 The_Library kernel: 7d80: 000001d4 cd307ec8 cafbc800 c5b2ba94 c0468c90 c5b2b9f8 00001000 00000000 Oct 7 16:02:36 The_Library kernel: 7da0: c0468c90 c5b2ba94 cd307f58 00000001 00001014 00000fec 00000000 c08d0ae0 Oct 7 16:02:36 The_Library kernel: 7dc0: c5b2b9f8 0448ffec 00000000 0448dfec 00000000 c5b2b9f8 00000000 00002000 Oct 7 16:02:36 The_Library kernel: 7de0: 00002000 c009c6a8 0448dfec 00000000 cd307f18 00002000 00000000 c03a1244 Oct 7 16:02:36 The_Library kernel: 7e00: c18e1540 cd307f18 cd307f58 cd307ec8 cafbc800 c5b2ba94 00000000 00000001 Oct 7 16:02:36 The_Library kernel: 7e20: 000dcd14 c03a0528 00000040 00000000 cd307e3c 00002000 c910b180 c5b2ba68 Oct 7 16:02:36 The_Library kernel: 7e40: cd307ec8 cd307f58 c5b2b9f8 00000001 00000000 cafbc800 c5b2ba94 c009d09c Oct 7 16:02:36 The_Library kernel: 7e60: 00000040 00002000 cedd3300 0448dfec 00000000 c5b2b9f8 00000001 0448dfec Oct 7 16:02:36 The_Library kernel: 7e80: 00000000 cd307f58 cafbc800 cd307ec8 000ded18 c012f5a0 0448dfec 00000000 Oct 7 16:02:36 The_Library kernel: 7ea0: cd307ec8 cafbc800 cd307fa8 000000b5 00002000 cd306000 00000000 c00c1718 Oct 7 16:02:36 The_Library kernel: 7ec0: 0448dfec 00000000 ffffffff c99b6f00 00000000 00000001 ffffffff cafbc800 Oct 7 16:02:36 The_Library kernel: 7ee0: 00000000 00000000 00000000 00000000 c89b6000 c89b6000 00000000 00000000 Oct 7 16:02:36 The_Library kernel: 7f00: cd307efc c89b6000 c008753c cd307f0c cd307f0c c00f1c74 0448dfec 00000000 Oct 7 16:02:36 The_Library kernel: 7f20: 00002000 bed96840 cd307f48 00000000 00002000 cedd3328 c8002d80 00000001 Oct 7 16:02:36 The_Library kernel: 7f40: 00000000 c88c3d00 cedd3328 00002000 00000001 cafbc800 000dcd14 00002000 Oct 7 16:02:36 The_Library kernel: 7f60: cafbc800 000dcd14 cd307fa8 c00c2174 cafbc800 000dcd14 00002000 cafbc800 Oct 7 16:02:36 The_Library kernel: 7f80: 000dcd14 000000b5 c0029128 c00c226c 00000003 00000000 0448dfec 00000000 Oct 7 16:02:36 The_Library kernel: 7fa0: 00000003 c0028f80 0448dfec 00000000 00000003 000dcd14 00002000 00000000 Oct 7 16:02:36 The_Library kernel: 7fc0: 0448dfec 00000000 00000003 000000b5 000dcd14 00000001 00002000 000ded18 Oct 7 16:02:36 The_Library kernel: 7fe0: 400f2000 bed967b8 00049cc0 400e51e0 60000010 00000003 e1a00004 ebfffaa2 Oct 7 16:02:36 The_Library kernel: [<c002c8a8>] (__bug+0x18/0x24) from [<c009a478>] (iov_iter_advance+0x74/0xcc) Oct 7 16:02:36 The_Library kernel: [<c009a478>] (iov_iter_advance+0x74/0xcc) from [<c009bf4c>] (generic_file_buffered_write+0x194/0x2c8) Oct 7 16:02:36 The_Library kernel: [<c009bf4c>] (generic_file_buffered_write+0x194/0x2c8) from [<c009c6a8>] (__generic_file_aio_write_nolock+0x430/0x480) Oct 7 16:02:36 The_Library kernel: [<c009c6a8>] (__generic_file_aio_write_nolock+0x430/0x480) from [<c009d09c>] (generic_file_aio_write+0x70/0xe8) Oct 7 16:02:36 The_Library kernel: [<c009d09c>] (generic_file_aio_write+0x70/0xe8) from [<c012f5a0>] (ext4_file_write+0xbc/0x140) Oct 7 16:02:36 The_Library kernel: [<c012f5a0>] (ext4_file_write+0xbc/0x140) from [<c00c1718>] (do_sync_write+0xac/0xfc) Oct 7 16:02:36 The_Library kernel: [<c00c1718>] (do_sync_write+0xac/0xfc) from [<c00c2174>] (vfs_write+0xac/0x154) Oct 7 16:02:36 The_Library kernel: [<c00c2174>] (vfs_write+0xac/0x154) from [<c00c226c>] (sys_pwrite64+0x50/0x70) Oct 7 16:02:36 The_Library kernel: [<c00c226c>] (sys_pwrite64+0x50/0x70) from [<c0028f80>] (ret_fast_syscall+0x0/0x2c) Oct 7 16:02:36 The_Library kernel: Code: e1a01000 e59f000c eb10ce4a e3a03000 (e5833000) Oct 7 16:02:36 The_Library kernel: ---[ end trace d1004457f4676628 ]---
... and here's another one from a bit later:
Oct 7 16:45:36 The_Library kernel: kernel BUG at mm/filemap.c:1939! Oct 7 16:45:36 The_Library kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000000 Oct 7 16:45:36 The_Library kernel: pgd = cdb18000 Oct 7 16:45:36 The_Library kernel: [00000000] *pgd=04a68031, *pte=00000000, *ppte=00000000 Oct 7 16:45:36 The_Library kernel: Internal error: Oops: 817 [#1] Oct 7 16:45:36 The_Library kernel: Modules linked in: tntfs(P) armvpd(P) Oct 7 16:45:36 The_Library kernel: CPU: 0 Tainted: P (2.6.31.8.nv+v2 #1) Oct 7 16:45:36 The_Library kernel: PC is at __bug+0x18/0x24 Oct 7 16:45:36 The_Library kernel: LR is at __bug+0x14/0x24 Oct 7 16:45:36 The_Library kernel: pc : [<c002c8a8>] lr : [<c002c8a4>] psr: 20000013 Oct 7 16:45:36 The_Library kernel: sp : c8881d60 ip : 00003a09 fp : 00000000 Oct 7 16:45:36 The_Library kernel: r10: c8880000 r9 : 00000000 r8 : 00001000 Oct 7 16:45:36 The_Library kernel: r7 : 00000000 r6 : 1d606000 r5 : 00000014 r4 : 000022c0 Oct 7 16:45:36 The_Library kernel: r3 : 00000000 r2 : c8881d54 r1 : c05950b3 r0 : 00000027 Oct 7 16:45:36 The_Library kernel: Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user Oct 7 16:45:36 The_Library kernel: Control: 0005397f Table: 0db18000 DAC: 00000015 Oct 7 16:45:36 The_Library kernel: Process afpd (pid: 2797, stack limit = 0xc8880270) Oct 7 16:45:36 The_Library kernel: Stack: (0xc8881d60 to 0xc8882000) Oct 7 16:45:36 The_Library kernel: 1d60: 000022c0 c009a478 000022c0 c009bf4c 00001000 000022c0 c07176e0 00000000 Oct 7 16:45:36 The_Library kernel: 1d80: ce7ef840 c8881ec8 c7864400 ce6bd844 c0468c90 ce6bd7a8 00001000 00000000 Oct 7 16:45:36 The_Library kernel: 1da0: c0468c90 ce6bd844 c8881f58 00000001 00000014 00001fec 00000000 c07176e0 Oct 7 16:45:36 The_Library kernel: 1dc0: ce6bd7a8 1d607fec 00000000 1d605fec 00000000 ce6bd7a8 00000000 00002000 Oct 7 16:45:36 The_Library kernel: 1de0: 00002000 c009c6a8 1d605fec 00000000 c8881f18 00002000 00000000 c03a1244 Oct 7 16:45:36 The_Library kernel: 1e00: c8448440 c8881f18 c8881f58 c8881ec8 c7864400 ce6bd844 00000000 00000001 Oct 7 16:45:36 The_Library kernel: 1e20: 000dcd14 c03a0528 00000040 00000000 c8881e3c 00002000 c9213600 ce6bd818 Oct 7 16:45:36 The_Library kernel: 1e40: c8881ec8 c8881f58 ce6bd7a8 00000001 00000000 c7864400 ce6bd844 c009d09c Oct 7 16:45:36 The_Library kernel: 1e60: 00000040 00002000 c7000600 1d605fec 00000000 ce6bd7a8 00000001 1d605fec Oct 7 16:45:36 The_Library kernel: 1e80: 00000000 c8881f58 c7864400 c8881ec8 000ded18 c012f5a0 1d605fec 00000000 Oct 7 16:45:36 The_Library kernel: 1ea0: c8881ec8 c7864400 c8881fa8 000000b5 00002000 c8880000 00000000 c00c1718 Oct 7 16:45:36 The_Library kernel: 1ec0: 1d605fec 00000000 ffffffff ccc94880 00000000 00000001 ffffffff c7864400 Oct 7 16:45:36 The_Library kernel: 1ee0: 00000000 00000000 00000000 00000000 c5648f00 c5648f00 00000000 00000000 Oct 7 16:45:36 The_Library kernel: 1f00: c8881efc c5648f00 c008753c c8881f0c c8881f0c c9242040 1d605fec 00000000 Oct 7 16:45:36 The_Library kernel: 1f20: 00002000 00000000 c20db450 00000000 00002000 c7000628 00000040 00000001 Oct 7 16:45:36 The_Library kernel: 1f40: 00000000 c3e8cc00 c7000628 00002000 00000001 c7864400 000dcd14 00002000 Oct 7 16:45:36 The_Library kernel: 1f60: c7864400 000dcd14 c8881fa8 c00c2174 c7864400 000dcd14 00002000 c7864400 Oct 7 16:45:36 The_Library kernel: 1f80: 000dcd14 000000b5 c0029128 c00c226c 00000003 00000000 1d605fec 00000000 Oct 7 16:45:36 The_Library kernel: 1fa0: 00000003 c0028f80 1d605fec 00000000 00000003 000dcd14 00002000 00000000 Oct 7 16:45:36 The_Library kernel: 1fc0: 1d605fec 00000000 00000003 000000b5 000dcd14 00000001 00002000 000ded18 Oct 7 16:45:36 The_Library kernel: 1fe0: 400f2000 bea3e7b8 00049cc0 400e51e0 60000010 00000003 00000000 00000000 Oct 7 16:45:36 The_Library kernel: [<c002c8a8>] (__bug+0x18/0x24) from [<c009a478>] (iov_iter_advance+0x74/0xcc) Oct 7 16:45:36 The_Library kernel: [<c009a478>] (iov_iter_advance+0x74/0xcc) from [<c009bf4c>] (generic_file_buffered_write+0x194/0x2c8) Oct 7 16:45:36 The_Library kernel: [<c009bf4c>] (generic_file_buffered_write+0x194/0x2c8) from [<c009c6a8>] (__generic_file_aio_write_nolock+0x430/0x480) Oct 7 16:45:36 The_Library kernel: [<c009c6a8>] (__generic_file_aio_write_nolock+0x430/0x480) from [<c009d09c>] (generic_file_aio_write+0x70/0xe8) Oct 7 16:45:36 The_Library kernel: [<c009d09c>] (generic_file_aio_write+0x70/0xe8) from [<c012f5a0>] (ext4_file_write+0xbc/0x140) Oct 7 16:45:36 The_Library kernel: [<c012f5a0>] (ext4_file_write+0xbc/0x140) from [<c00c1718>] (do_sync_write+0xac/0xfc) Oct 7 16:45:36 The_Library kernel: [<c00c1718>] (do_sync_write+0xac/0xfc) from [<c00c2174>] (vfs_write+0xac/0x154) Oct 7 16:45:36 The_Library kernel: [<c00c2174>] (vfs_write+0xac/0x154) from [<c00c226c>] (sys_pwrite64+0x50/0x70) Oct 7 16:45:36 The_Library kernel: [<c00c226c>] (sys_pwrite64+0x50/0x70) from [<c0028f80>] (ret_fast_syscall+0x0/0x2c) Oct 7 16:45:36 The_Library kernel: Code: e1a01000 e59f000c eb10ce4a e3a03000 (e5833000) Oct 7 16:45:36 The_Library kernel: ---[ end trace b5b8b72b1f26a506 ]---
... and here are the e-mails I received after the disk check:
***** File system check forced at Sun Oct 7 17:00:34 EST 2012 ***** fsck from util-linux-ng 2.17.2 e2fsck 1.41.14 (22-Dec-2010) /dev/mapper/c-c: recovering journal Clearing orphaned inode 15893392 (uid=65534, gid=65534, mode=042700, size=4096) Clearing orphaned inode 15893409 (uid=65534, gid=65534, mode=0100666, size=741) Pass 1: Checking inodes, blocks, and sizes Pass 2: Checking directory structure Pass 3: Checking directory connectivity Pass 4: Checking reference counts Pass 5: Checking group summary information
/dev/mapper/c-c: ***** FILE SYSTEM WAS MODIFIED ***** /dev/mapper/c-c: 202396/45547520 files (12.3% non-contiguous), 305451174/728760320 blocks
Any thoughts? Provided it doesn't happen except under extraordinary loads, it doesn't bother me too much... but on the other hand, it's a (somewhat) repeatable kernel crash, so should probably be worth fixing.
Re: NV+ v2 Kernel bug reported when under heavy load via AFP
Hi, did you resolve this problem? I have simmilar, but it happens when NAS have overloaded CPU (proftpd, smb, copying file over linux etc.) I'm using newest firmware BETA, but this problem still occure.
Re: NV+ v2 Kernel bug reported when under heavy load via AFP
I never resolved this bug, but it doesn't happen to me any more: only because I no longer have cause to do massive data dumps onto the NAS - my routine use only ever involves a couple of GB at a time via Time Machine from four computers, plus torrents and reading media from it. So for me I presume the bug is still there, but I don't trigger it.
Re: NV+ v2 Kernel bug reported when under heavy load via AFP
I did trigger this bug again the other day, but either I got lucky or it is now harder to trigger: I transferred 1Tb in total (over gigabit ethernet via AFP), and it only stopped twice - once after about 400Gb, then after another ~10Gb, then it completed the rest of the transfer without a problem.
