NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.

Forum Discussion

Bofc's avatar
Bofc
Aspirant
Jul 05, 2017

intermittent lockups readynas pro 4 on firmware 6.7.5

hello, i know there is no support with the lagacy readynas pro 4 running firmware 6+, but figured i would let you know of an issue i have been having. upgraded to firmware 6.7.5 from 4+ and have been able to access the admin pages and create shares. the volume is Encrypted and the share in encrypted/bit-rot enabled and i was able to copy about 2TB with no problem. i have several shares on this encrypted volume. i started another copy job to a share that has encrypted/bit-rot/compress enabled and about 100GB out of 800GB into the job the readynas just hung. rebooted, started the process again, and somewhere during the night it hung again. rebooted, started the job again and it finished.

 

so i started another copy job to another share that has encrypted/bit-rot/compress enabled and again the readynas hung about 83GB out of 1.2TB into the process. have to wait till i get home to reboot the system and start the copy process again.

 

has anyone else been having this issue and what i can look at or do to see what the issue is? i suspect a memory leak, but only guessing.

 

thank you for any help on this.

 

j

14 Replies

Replies have been turned off for this discussion
  • You could download the logs from the UI and look into dmesg.log.

    It could be that the data is heavily fragmented due to bit rot protection (which means Copy-on-Write) and trying to decrypt that.

    Also check the metadata allocation in btrfs.log.

    • Bofc's avatar
      Bofc
      Aspirant

      here are those two files, i see where there are "out of memory" notices, but it seems to kill the process and continues to run. where as when it hangs, nothing works except a hard power reset. well looks like i cant attach the files, so here is a part of the logs:

       

      dmesg.log

      [Thu Jul 6 04:10:40 2017] Mem-Info:
      [Thu Jul 6 04:10:40 2017] active_anon:80 inactive_anon:138 isolated_anon:0
      active_file:59749 inactive_file:106860 isolated_file:276
      unevictable:0 dirty:110409 writeback:3918 unstable:0
      slab_reclaimable:22507 slab_unreclaimable:15787
      mapped:5254 shmem:4 pagetables:2075 bounce:0
      free:6320 free_pcp:186 free_cma:0
      [Thu Jul 6 04:10:40 2017] DMA free:4012kB min:316kB low:392kB high:472kB active_anon:0kB inactive_anon:0kB active_file:68kB inactive_file:412kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15972kB managed:15888kB mlocked:0kB dirty:412kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:6380kB slab_unreclaimable:1632kB kernel_stack:16kB pagetables:132kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:2920 all_unreclaimable? yes
      [Thu Jul 6 04:10:40 2017] lowmem_reserve[]: 0 959 959 959
      [Thu Jul 6 04:10:40 2017] DMA32 free:21268kB min:19748kB low:24684kB high:29620kB active_anon:320kB inactive_anon:552kB active_file:238928kB inactive_file:426836kB unevictable:0kB isolated(anon):0kB isolated(file):1232kB present:1022656kB managed:987772kB mlocked:0kB dirty:441224kB writeback:15672kB mapped:21016kB shmem:16kB slab_reclaimable:83648kB slab_unreclaimable:61516kB kernel_stack:4208kB pagetables:8168kB unstable:0kB bounce:0kB free_pcp:744kB local_pcp:20kB free_cma:0kB writeback_tmp:0kB pages_scanned:4465512 all_unreclaimable? yes
      [Thu Jul 6 04:10:40 2017] lowmem_reserve[]: 0 0 0 0
      [Thu Jul 6 04:10:40 2017] DMA: 33*4kB (UE) 29*8kB (UE) 26*16kB (UME) 43*32kB (UME) 21*64kB (UME) 4*128kB (UE) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4012kB
      [Thu Jul 6 04:10:40 2017] DMA32: 3009*4kB (UME) 600*8kB (UMEH) 25*16kB (UMEH) 0*32kB 1*64kB (H) 1*128kB (H) 1*256kB (H) 1*512kB (H) 1*1024kB (H) 1*2048kB (H) 0*4096kB = 21268kB
      [Thu Jul 6 04:10:40 2017] 167062 total pagecache pages
      [Thu Jul 6 04:10:40 2017] 166 pages in swap cache
      [Thu Jul 6 04:10:40 2017] Swap cache stats: add 96986, delete 96820, find 127116/143802
      [Thu Jul 6 04:10:40 2017] Free swap = 953448kB
      [Thu Jul 6 04:10:40 2017] Total swap = 1046524kB
      [Thu Jul 6 04:10:40 2017] 259657 pages RAM
      [Thu Jul 6 04:10:40 2017] 0 pages HighMem/MovableOnly
      [Thu Jul 6 04:10:40 2017] 8742 pages reserved
      [Thu Jul 6 04:10:40 2017] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
      [Thu Jul 6 04:10:40 2017] [ 1453] 0 1453 29860 1517 28 3 132 0 systemd-journal
      [Thu Jul 6 04:10:40 2017] [ 1471] 0 1471 10013 458 23 3 211 -1000 systemd-udevd
      [Thu Jul 6 04:10:40 2017] [ 3026] 0 3026 8153 508 19 3 72 0 cron
      [Thu Jul 6 04:10:40 2017] [ 3027] 84 3027 8056 324 22 3 85 0 avahi-daemon
      [Thu Jul 6 04:10:40 2017] [ 3028] 83 3028 10173 593 24 3 150 -900 dbus-daemon
      [Thu Jul 6 04:10:40 2017] [ 3029] 84 3029 8027 0 21 3 63 0 avahi-daemon
      [Thu Jul 6 04:10:40 2017] [ 3031] 0 3031 5899 652 17 3 73 0 connmand
      [Thu Jul 6 04:10:40 2017] [ 3032] 0 3032 1602 362 9 3 62 0 raidard
      [Thu Jul 6 04:10:40 2017] [ 3033] 0 3033 3893 399 14 3 93 0 mdadm
      [Thu Jul 6 04:10:40 2017] [ 3035] 0 3035 1068 362 8 3 33 0 noflushd
      [Thu Jul 6 04:10:40 2017] [ 3036] 0 3036 6916 77 15 3 80 0 mdcsrepaird
      [Thu Jul 6 04:10:40 2017] [ 3038] 0 3038 1586 347 8 3 57 0 wsdd2
      [Thu Jul 6 04:10:40 2017] [ 3040] 0 3040 9399 364 22 3 148 0 systemd-logind
      [Thu Jul 6 04:10:40 2017] [ 3050] 0 3050 13798 451 30 3 169 -1000 sshd
      [Thu Jul 6 04:10:40 2017] [ 3089] 0 3089 9297 395 23 4 118 0 rpcbind
      [Thu Jul 6 04:10:40 2017] [ 3099] 0 3099 31962 362 33 3 170 0 netatalk
      [Thu Jul 6 04:10:40 2017] [ 3105] 0 3105 30578 744 62 3 353 0 afpd
      [Thu Jul 6 04:10:40 2017] [ 3106] 0 3106 11859 708 27 3 132 0 cnid_metad
      [Thu Jul 6 04:10:40 2017] [ 3128] 79 3128 9320 407 23 3 146 0 rpc.statd
      [Thu Jul 6 04:10:40 2017] [ 3143] 0 3143 4881 405 12 3 39 0 agetty
      [Thu Jul 6 04:10:40 2017] [ 3147] 0 3147 4836 463 14 3 38 0 agetty
      [Thu Jul 6 04:10:40 2017] [ 3223] 0 3223 56891 638 107 4 457 0 nmbd
      [Thu Jul 6 04:10:40 2017] [ 3229] 0 3229 34593 596 72 3 974 0 apache2
      [Thu Jul 6 04:10:40 2017] [ 3238] 0 3238 82363 1010 154 3 684 0 smbd
      [Thu Jul 6 04:10:40 2017] [ 3240] 0 3240 80216 532 144 3 686 0 smbd-notifyd
      [Thu Jul 6 04:10:40 2017] [ 3241] 0 3241 80221 467 142 3 673 0 cleanupd
      [Thu Jul 6 04:10:40 2017] [ 3242] 0 3242 385265 2273 165 5 12363 -1000 readynasd
      [Thu Jul 6 04:10:40 2017] [ 3594] 0 3594 32478 433 28 3 129 0 fvbackup-q
      [Thu Jul 6 04:10:40 2017] [ 3628] 0 3628 1589 270 8 3 31 0 minissdpd
      [Thu Jul 6 04:10:40 2017] [ 3629] 1 3629 8374 462 19 3 72 0 upnphttpd
      [Thu Jul 6 04:10:40 2017] [ 5746] 0 5746 12443 439 26 3 423 0 proftpd
      [Thu Jul 6 04:10:40 2017] [ 5755] 0 5755 4423 476 13 3 48 0 rsync
      [Thu Jul 6 04:10:40 2017] [ 5773] 0 5773 6379 0 16 3 59 0 rpc.idmapd
      [Thu Jul 6 04:10:40 2017] [ 5775] 0 5775 9454 269 22 3 193 0 rpc.mountd
      [Thu Jul 6 04:10:40 2017] [ 5776] 0 5776 33564 612 32 3 303 0 minidlnad
      [Thu Jul 6 04:10:40 2017] [ 5786] 0 5786 1021 135 7 3 20 0 apache_log
      [Thu Jul 6 04:10:40 2017] [ 5787] 0 5787 1021 133 7 3 20 0 apache_log
      [Thu Jul 6 04:10:40 2017] [ 5788] 0 5788 34593 0 66 3 945 0 apache2
      [Thu Jul 6 04:10:40 2017] [ 5789] 98 5789 34601 231 69 3 950 0 apache2
      [Thu Jul 6 04:10:40 2017] [ 5790] 98 5790 34601 231 69 3 950 0 apache2
      [Thu Jul 6 04:10:40 2017] [ 5791] 98 5791 34601 231 69 3 950 0 apache2
      [Thu Jul 6 04:10:40 2017] [ 5792] 98 5792 34645 367 69 3 992 0 apache2
      [Thu Jul 6 04:10:40 2017] [ 5793] 98 5793 34601 231 69 3 950 0 apache2
      [Thu Jul 6 04:10:40 2017] [ 6013] 99 6013 88777 1230 167 3 890 0 smbd
      [Thu Jul 6 04:10:40 2017] [18601] 0 18601 6768 806 18 3 130 -1000 bash
      [Thu Jul 6 04:10:40 2017] [18784] 0 18784 10213 847 24 3 113 -1000 msmtp
      [Thu Jul 6 04:10:40 2017] Out of memory: Kill process 6013 (smbd) score 4 or sacrifice child
      [Thu Jul 6 04:10:40 2017] Killed process 6013 (smbd) total-vm:355108kB, anon-rss:84kB, file-rss:4836kB
      [Thu Jul 6 06:15:08 2017] usb 2-2: reset high-speed USB device number 3 using ehci-pci
      [Thu Jul 6 06:15:08 2017] sd 7:0:0:0: [sdf] tag#0 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK
      [Thu Jul 6 06:15:08 2017] sd 7:0:0:0: [sdf] tag#0 CDB: Read(10) 28 00 00 00 00 3f 00 00 01 00
      [Thu Jul 6 06:15:08 2017] blk_update_request: I/O error, dev sdf, sector 504
      [Thu Jul 6 06:15:08 2017] usb 2-2: reset high-speed USB device number 3 using ehci-pci
      [Thu Jul 6 06:15:20 2017] nr_pdflush_threads exported in /proc is scheduled for removal

       

       

       

      --------------------------------------------------------------------------------------------------------------------------------------------------------------------------

       

      btrfs.log

      Label: '5e26ecb8:root'  uuid: 6a44d55d-1d4f-4ed6-98c8-4dc10fcb90e2
          Total devices 1 FS bytes used 536.44MiB
          devid    1 size 4.00GiB used 1.24GiB path /dev/md0

      Label: '5e26ecb8:DATA'  uuid: f52711ff-56a4-422e-829b-3ba0f774dd83
          Total devices 1 FS bytes used 3.11TiB
          devid    1 size 8.17TiB used 3.12TiB path /dev/mapper/DATA-0

      === filesystem /DATA ===
      Data, single: total=3.11TiB, used=3.10TiB
      System, DUP: total=32.00MiB, used=384.00KiB
      Metadata, DUP: total=6.50GiB, used=4.85GiB
      GlobalReserve, single: total=512.00MiB, used=0.00B
      === subvolume /DATA ===
      ID 257 gen 30 top level 5 path .purge
      ID 258 gen 7103 top level 5 path ._share
      ID 259 gen 7847 top level 5 path .apps
      ID 260 gen 13 top level 5 path home
      ID 261 gen 13 top level 5 path .vault
      ID 264 gen 5664 top level 5 path .timemachine
      ID 265 gen 7102 top level 5 path Videos
      ID 266 gen 7103 top level 265 path Videos/.snapshots
      ID 970 gen 809 top level 266 path Videos/.snapshots/1/snapshot
      ID 2236 gen 7096 top level 5 path Software
      ID 2237 gen 7097 top level 2236 path Software/.snapshots
      ID 2356 gen 7093 top level 5 path prepping
      ID 2357 gen 7094 top level 2356 path prepping/.snapshots
      ID 2358 gen 7087 top level 5 path Backup
      ID 2359 gen 7088 top level 2358 path Backup/.snapshots
      ID 2466 gen 2485 top level 2359 path Backup/.snapshots/1/snapshot
      ID 2467 gen 2487 top level 2357 path prepping/.snapshots/1/snapshot
      ID 2468 gen 2489 top level 2237 path Software/.snapshots/1/snapshot
      ID 2469 gen 2491 top level 266 path Videos/.snapshots/2/snapshot
      ID 2470 gen 7090 top level 5 path Music
      ID 2471 gen 7091 top level 2470 path Music/.snapshots
      ID 2817 gen 2992 top level 2359 path Backup/.snapshots/2/snapshot
      ID 2818 gen 2995 top level 2471 path Music/.snapshots/1/snapshot
      ID 2819 gen 2998 top level 2357 path prepping/.snapshots/2/snapshot
      ID 2820 gen 3001 top level 2237 path Software/.snapshots/2/snapshot
      ID 2821 gen 3004 top level 266 path Videos/.snapshots/3/snapshot
      ID 3368 gen 5247 top level 2359 path Backup/.snapshots/3/snapshot
      ID 3369 gen 5250 top level 2471 path Music/.snapshots/2/snapshot
      ID 3370 gen 5253 top level 2357 path prepping/.snapshots/3/snapshot
      ID 3371 gen 5256 top level 2237 path Software/.snapshots/3/snapshot
      ID 3372 gen 5259 top level 266 path Videos/.snapshots/4/snapshot
      ID 3373 gen 7848 top level 5 path Triimaging
      ID 3374 gen 7100 top level 3373 path Triimaging/.snapshots
      ID 3472 gen 7087 top level 2359 path Backup/.snapshots/4/snapshot
      ID 3473 gen 7090 top level 2471 path Music/.snapshots/3/snapshot
      ID 3474 gen 7093 top level 2357 path prepping/.snapshots/4/snapshot
      ID 3475 gen 7096 top level 2237 path Software/.snapshots/4/snapshot
      ID 3476 gen 7099 top level 3374 path Triimaging/.snapshots/1/snapshot
      ID 3477 gen 7102 top level 266 path Videos/.snapshots/5/snapshot
      === btrfs dump-super /dev/md0
      superblock: bytenr=65536, device=/dev/md0
      ---------------------------------------------------------
      csum_type        0 (crc32c)
      csum_size        4
      csum            0x504bfd7c [match]
      bytenr            65536
      flags            0x1
                  ( WRITTEN )
      magic            _BHRfS_M [match]
      fsid            6a44d55d-1d4f-4ed6-98c8-4dc10fcb90e2
      label            5e26ecb8:root
      generation        5732
      root            175390720
      sys_array_size        129
      chunk_root_generation    77
      root_level        0
      chunk_root        20987904
      chunk_root_level    0
      log_root        0
      log_root_transid    0
      log_root_level        0
      total_bytes        4290772992
      bytes_used        562499584
      sectorsize        4096
      nodesize        16384
      leafsize        16384
      stripesize        4096
      root_dir        6
      num_devices        1
      compat_flags        0x0
      compat_ro_flags        0x0
      incompat_flags        0x161
                  ( MIXED_BACKREF |
                    BIG_METADATA |
                    EXTENDED_IREF |
                    SKINNY_METADATA )
      cache_generation    18446744073709551615
      uuid_tree_generation    5732
      dev_item.uuid        496486b4-fef3-40ab-bf7b-25ca3e7a449b
      dev_item.fsid        6a44d55d-1d4f-4ed6-98c8-4dc10fcb90e2 [match]
      dev_item.type        0
      dev_item.total_bytes    4290772992
      dev_item.bytes_used    1326579712
      dev_item.io_align    4096
      dev_item.io_width    4096
      dev_item.sector_size    4096
      dev_item.devid        1
      dev_item.dev_group    0
      dev_item.seek_speed    0
      dev_item.bandwidth    0
      dev_item.generation    0
      sys_chunk_array[2048]:
          item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 20971520)
              length 8388608 owner 2 stripe_len 65536 type SYSTEM|DUP
              io_align 65536 io_width 65536 sector_size 4096
              num_stripes 2 sub_stripes 0
                  stripe 0 devid 1 offset 20971520
                  dev_uuid 496486b4-fef3-40ab-bf7b-25ca3e7a449b
                  stripe 1 devid 1 offset 29360128
                  dev_uuid 496486b4-fef3-40ab-bf7b-25ca3e7a449b
      backup_roots[4]:
          backup 0:
              backup_tree_root:    174800896    gen: 5730    level: 0
              backup_chunk_root:    20987904    gen: 77    level: 0
              backup_extent_root:    174768128    gen: 5730    level: 1
              backup_fs_root:        174702592    gen: 5730    level: 2
              backup_dev_root:    31178752    gen: 4980    level: 0
              backup_csum_root:    168624128    gen: 5693    level: 1
              backup_total_bytes:    4290772992
              backup_bytes_used:    562483200
              backup_num_devices:    1

          backup 1:
              backup_tree_root:    175226880    gen: 5731    level: 0
              backup_chunk_root:    20987904    gen: 77    level: 0
              backup_extent_root:    175063040    gen: 5731    level: 1
              backup_fs_root:        174833664    gen: 5731    level: 2
              backup_dev_root:    31178752    gen: 4980    level: 0
              backup_csum_root:    174948352    gen: 5731    level: 1
              backup_total_bytes:    4290772992
              backup_bytes_used:    562499584
              backup_num_devices:    1

          backup 2:
              backup_tree_root:    175390720    gen: 5732    level: 0
              backup_chunk_root:    20987904    gen: 77    level: 0
              backup_extent_root:    175357952    gen: 5732    level: 1
              backup_fs_root:        175243264    gen: 5732    level: 2
              backup_dev_root:    31178752    gen: 4980    level: 0
              backup_csum_root:    174948352    gen: 5731    level: 1
              backup_total_bytes:    4290772992
              backup_bytes_used:    562499584
              backup_num_devices:    1

          backup 3:
              backup_tree_root:    174669824    gen: 5729    level: 0
              backup_chunk_root:    20987904    gen: 77    level: 0
              backup_extent_root:    174637056    gen: 5729    level: 1
              backup_fs_root:        174538752    gen: 5729    level: 2
              backup_dev_root:    31178752    gen: 4980    level: 0
              backup_csum_root:    168624128    gen: 5693    level: 1
              backup_total_bytes:    4290772992
              backup_bytes_used:    562483200
              backup_num_devices:    1


      • dsm1212's avatar
        dsm1212
        Apprentice

        You had an io error on sdf. A USB drive? I had a bad USB disk and it caused hangs like this after errors (an earlier version of os6, but I don't think it matters this is a linux driver bug). I never reported it because frankly I tested the disk under windows and found many errors so I replaced it. You might be able to "correct" it with a disk scan utility or check your usb connections...

         

NETGEAR Academy

Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology! 

Join Us!

ProSupport for Business

Comprehensive support plans for maximum network uptime and business peace of mind.

 

Learn More