NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.

Forum Discussion

izy's avatar
izy
Aspirant
Oct 28, 2015
Solved

RN516 hangs after reboot / won't mount filesystem

Hi all,

 

My RN516 running ReadyNAS OS 6.2.4 with 6 x 3TB WD RED NAS Drives has decided to start hanging on boot, it still manages to get as far as letting me ssh in to discover this message in dmesg:

 

INFO: task btrfs-transacti:2339 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
btrfs-transacti D 0000000000000000 0 2339 2 0x00000000
ffff8801053c9d20 0000000000000046 0000000000000001 ffff88011643a3a8
00000027c8f5d0c8 ffff8801053c9fd8 ffff8801053c9fd8 0000000000004000
ffff88011a86b480 ffff88011643a0d0 00000001053c9c60 ffffffff880d1a3e
Call Trace:
[<ffffffff880d1a3e>] ? deactivate_slab+0x4e/0xf0
[<ffffffff882ba535>] ? btrfs_alloc_path+0x15/0x20
[<ffffffff880d225e>] ? kmem_cache_alloc+0xde/0xe0
[<ffffffff882ba535>] ? btrfs_alloc_path+0x15/0x20
[<ffffffff880d2445>] ? kmem_cache_free+0x15/0xa0
[<ffffffff8888959a>] schedule+0x3a/0x50
[<ffffffff88889aa9>] schedule_timeout+0x1a9/0x210
[<ffffffff88064649>] ? prepare_to_wait+0x59/0x90
[<ffffffff882e177b>] btrfs_commit_transaction+0x20b/0xa90
[<ffffffff88064850>] ? abort_exclusive_wait+0xb0/0xb0
[<ffffffff882e2675>] ? start_transaction+0x95/0x410
[<ffffffff882d98e5>] transaction_kthread+0x255/0x270
[<ffffffff882d9690>] ? btrfs_alloc_root+0x40/0x40
[<ffffffff88063f89>] kthread+0x89/0x90
[<ffffffff8888ccf4>] kernel_thread_helper+0x4/0x10
[<ffffffff88063f00>] ? kthread_worker_fn+0x140/0x140
[<ffffffff8888ccf0>] ? gs_change+0xb/0xb

 

I can see from cat /proc/mdstat that the raid looks ok?

 

root@nas:/var/log# cat /proc/mdstat
Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md127 : active raid5 sdc3[0] sda3[5] sdb3[4] sdf3[3] sde3[2] sdd3[1]
14627073280 blocks super 1.2 level 5, 64k chunk, algorithm 2 [6/6] [UUUUUU]

md1 : active raid6 sdc2[0] sda2[5] sdb2[4] sdf2[3] sde2[2] sdd2[1]
2095104 blocks super 1.2 level 6, 512k chunk, algorithm 2 [6/6] [UUUUUU]

md0 : active raid1 sdc1[0] sda1[5] sdb1[4] sdf1[3] sde1[2] sdd1[1]
4192192 blocks super 1.2 [6/6] [UUUUUU]

 

later in dmesg I see this fairly serious message?

 

kernel BUG at fs/btrfs/extent-tree.c:1566!
invalid opcode: 0000 [#1] SMP
CPU 3
Modules linked in: ir_rc6_decoder ir_rc5_decoder nuvoton_cir ir_nec_decoder rc_core sx8635 rn_gpio vpd(P)

Pid: 1485, comm: mount Tainted: P 3.0.101.RNx86_64.3 #1 NETGEAR ReadyNAS 516/ReadyNAS 516
RIP: 0010:[<ffffffff882c5760>] [<ffffffff882c5760>] lookup_inline_extent_backref+0x4c0/0x4f0
RSP: 0018:ffff880109833618 EFLAGS: 00010246
RAX: 0000000000ffff88 RBX: ffff8800a7546138 RCX: ffff8800a67dc000
RDX: 0000000000000000 RSI: 00000000000009c2 RDI: ffff8800a7546138
RBP: ffff8801098336b8 R08: 0000000000001000 R09: ffff8801098335c8
R10: 0000000000000000 R11: 0000000000000000 R12: 00000000000000b2
R13: 000000000000094d R14: 00000000000009ca R15: 00000000000009e7
FS: 00007f02eccb3800(0000) GS:ffff88011f380000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f245d62e080 CR3: 00000001158cf000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process mount (pid: 1485, threadinfo ffff880109832000, task ffff8801158520d0)
Stack:
ffffffff882ba535 ffff880115d13540 ffff880109833748 000004c1a73df000
ffff8800acf0a840 ffff88011f3978d0 0000000000000035 ffffffff00008050
ffff88011aaa6000 ffff8800acf0a900 000000000011d3f2 00ffffff882ba535
Call Trace:
[<ffffffff882ba535>] ? btrfs_alloc_path+0x15/0x20
[<ffffffff882c87d4>] __btrfs_free_extent+0xb4/0x8b0
[<ffffffff88326384>] ? btrfs_merge_delayed_refs+0x204/0x3c0
[<ffffffff8832656b>] ? btrfs_check_delayed_seq+0x2b/0xb0
[<ffffffff882cc5e0>] run_clustered_refs+0x3c0/0xe40
[<ffffffff882cc6c8>] ? run_clustered_refs+0x4a8/0xe40
[<ffffffff883266d8>] ? btrfs_find_ref_cluster+0xe8/0x170
[<ffffffff882d0a00>] btrfs_run_delayed_refs+0xe0/0x5a0
[<ffffffff882e15f5>] btrfs_commit_transaction+0x85/0xa90
[<ffffffff88064850>] ? abort_exclusive_wait+0xb0/0xb0
[<ffffffff880d24ca>] ? kmem_cache_free+0x9a/0xa0
[<ffffffff8831e27d>] btrfs_recover_log_trees+0x3bd/0x490
[<ffffffff8831c4e0>] ? replay_one_dir_item+0x100/0x100
[<ffffffff882de873>] open_ctree+0x1883/0x2250
[<ffffffff8813a1fa>] ? disk_name+0xaa/0xb0
[<ffffffff882b6c7b>] btrfs_mount+0x50b/0x710
[<ffffffff880d9710>] mount_fs+0x40/0x1b0
[<ffffffff880b7ecb>] ? __alloc_percpu+0xb/0x10
[<ffffffff880f3097>] vfs_kern_mount+0x67/0xd0
[<ffffffff880f34f1>] do_kern_mount+0x51/0x100
[<ffffffff880f4cc3>] do_mount+0x253/0x860
[<ffffffff880b36c4>] ? strndup_user+0x54/0x70
[<ffffffff880f56c5>] sys_mount+0x95/0xf0
[<ffffffff8888bf7b>] system_call_fastpath+0x16/0x1b
Code: 55 30 85 d2 4c 89 31 74 89 e9 2d ff ff ff 0f 1f 44 00 00 b8 0d 00 00 00 e9 32 fd ff ff 66 0f 1f 44 00 00 a8 01 0f 85 e3 fc ff ff <0f> 0b 66 0f 1f 44 00 00 c7 45 9c 0d 00 00 00 e9 a3 fb ff ff b8
RIP [<ffffffff882c5760>] lookup_inline_extent_backref+0x4c0/0x4f0
RSP <ffff880109833618>

 

Trying to mount /dev/md127 results in the command hanging.

 

Is there anything that can be done or should I setup a 2nd machine and attempt to mount the array there and copy the contents over?

 

Thanks izy

  • i ended up putting the 6 drives into a ubuntu machine, cleaning the filesystem and mounting and recovering the data that way.

     

    thanks for all the useful comments or and suggestions....

3 Replies

Replies have been turned off for this discussion
  • i ended up putting the 6 drives into a ubuntu machine, cleaning the filesystem and mounting and recovering the data that way.

     

    thanks for all the useful comments or and suggestions....

    • izy's avatar
      izy
      Aspirant

      yeah i have and L2 logged in, froze the command line about 3 times and then said it needs to go to L3 support

NETGEAR Academy

Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology! 

Join Us!

ProSupport for Business

Comprehensive support plans for maximum network uptime and business peace of mind.

 

Learn More