NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Replaced failing disk in NV+ v2 - both volume expansion and volume scan fail
Hi folks, I'm getting some slightly peculiar behaviour from my NV+ v2, and would really appreciate some help in troubleshooting. A week or so ago, I started getting errors on disk 1 of my NAS...
I couldn't include log output in the original message due to character limits.
I have downloaded the logs, and happy to look things up in specific places. In the mean time, the following seem to be the relevant part of expand_md.log:
[2015/09/14 14:39:47 23206] Added drive to md, grown=1/0xbebb6a6c [2015/09/14 14:39:47 23206] Repair caused array grow, will do expansion... [2015/09/14 14:39:56 23206] LINE 4440: exec command: vgdisplay -c c > /var/log/frontview/.V_E.vgdisplayout ; lvdisplay -c c > /var/log/frontview/.V_E.lvdisplayout File descriptor 3 (/etc/resolv.conf (deleted)) leaked on vgdisplay invocation. Parent PID 29226: sh File descriptor 3 (/etc/resolv.conf (deleted)) leaked on lvdisplay invocation. Parent PID 29226: sh [2015/09/14 14:39:56 23206] 0 vg= c lv= /dev/c/c [2015/09/14 14:39:56 23206] 1 vg=r/w lv=c [2015/09/14 14:39:56 23206] 2 vg=772 lv=3 [2015/09/14 14:39:56 23206] 3 vg=-1 lv=1 [2015/09/14 14:39:56 23206] 4 vg=0 lv=-1 [2015/09/14 14:39:56 23206] 5 vg=1 lv=1 [2015/09/14 14:39:56 23206] 6 vg=1 lv=19485687808 [2015/09/14 14:39:56 23206] 7 vg=-1 lv=148664 [2015/09/14 14:39:56 23206] 8 vg=0 lv=-1 [2015/09/14 14:39:56 23206] 9 vg=2 lv=0 [2015/09/14 14:39:56 23206] 10 vg=2 lv=-1 [2015/09/14 14:39:56 23206] 11 vg=9753329664 lv=253 [2015/09/14 14:39:56 23206] 12 vg=65536 lv=0 [2015/09/14 14:39:56 23206] 13 vg=148824 lv=13 [2015/09/14 14:39:56 23206] 14 vg=148664 lv=14 [2015/09/14 14:39:56 23206] 15 vg=160 lv=15 [2015/09/14 14:39:56 23206] 16 vg=rGs2iy-Av5h-nfXC-oAH1-bzUt-W3OP-Vfcp37 lv=16 [2015/09/14 14:39:56 23206] 17 vg=17 lv=17 [2015/09/14 14:39:56 23206] 18 vg=18 lv=18 [2015/09/14 14:39:56 23206] 19 vg=19 lv=19 [2015/09/14 14:39:56 23206] LINE 4879: exec command: pvresize /dev/md2 File descriptor 3 (/etc/resolv.conf (deleted)) leaked on pvresize invocation. Parent PID 23206: /usr/sbin/expand_md Physical volume "/dev/md2" changed 1 physical volume(s) resized / 0 physical volume(s) not resized [2015/09/14 14:39:57 23206] LINE 4879: exec command: pvresize /dev/md3 File descriptor 3 (/etc/resolv.conf (deleted)) leaked on pvresize invocation. Parent PID 23206: /usr/sbin/expand_md Physical volume "/dev/md3" changed 1 physical volume(s) resized / 0 physical volume(s) not resized [2015/09/14 14:39:59 23206] LINE 4440: exec command: vgdisplay -c c > /var/log/frontview/.V_E.vgdisplayout ; lvdisplay -c c > /var/log/frontview/.V_E.lvdisplayout File descriptor 3 (/etc/resolv.conf (deleted)) leaked on vgdisplay invocation. Parent PID 29236: sh File descriptor 3 (/etc/resolv.conf (deleted)) leaked on lvdisplay invocation. Parent PID 29236: sh [2015/09/14 14:40:00 23206] 0 vg= c lv= /dev/c/c [2015/09/14 14:40:00 23206] 1 vg=r/w lv=c [2015/09/14 14:40:00 23206] 2 vg=772 lv=3 [2015/09/14 14:40:00 23206] 3 vg=-1 lv=1 [2015/09/14 14:40:00 23206] 4 vg=0 lv=-1 [2015/09/14 14:40:00 23206] 5 vg=1 lv=1 [2015/09/14 14:40:00 23206] 6 vg=1 lv=19485687808 [2015/09/14 14:40:00 23206] 7 vg=-1 lv=148664 [2015/09/14 14:40:00 23206] 8 vg=0 lv=-1 [2015/09/14 14:40:00 23206] 9 vg=2 lv=0 [2015/09/14 14:40:00 23206] 10 vg=2 lv=-1 [2015/09/14 14:40:00 23206] 11 vg=10730078208 lv=253 [2015/09/14 14:40:00 23206] 12 vg=65536 lv=0 [2015/09/14 14:40:00 23206] 13 vg=163728 lv=13 [2015/09/14 14:40:00 23206] 14 vg=148664 lv=14 [2015/09/14 14:40:00 23206] 15 vg=15064 lv=15 [2015/09/14 14:40:00 23206] 16 vg=rGs2iy-Av5h-nfXC-oAH1-bzUt-W3OP-Vfcp37 lv=16 [2015/09/14 14:40:00 23206] 17 vg=17 lv=17 [2015/09/14 14:40:00 23206] 18 vg=18 lv=18 [2015/09/14 14:40:00 23206] 19 vg=19 lv=19 [2015/09/14 14:40:00 23206] Facts:vg_total=163728,vg_alloc=148664,vg_free=15064,lv_new=14904,lv_total=% [2015/09/14 14:40:00 23206] LINE 4694: exec command: lvextend /dev/c/c -l +14904 File descriptor 3 (/etc/resolv.conf (deleted)) leaked on lvextend invocation. Parent PID 23206: /usr/sbin/expand_md Extending logical volume c to 9.98 TiB Logical volume c successfully resized [2015/09/14 14:40:02 23206] LINE 4892: exec command: /frontview/bin/volumescan & [2015/09/14 14:40:03 23206] LINE 540: exec command: echo "DOING_F_RESIZE" > /.os_V_E_continue [2015/09/14 14:40:03 23206] LINE 4569: exec command: resize2fs -pf /dev/c/c resize2fs 1.41.14 (22-Dec-2010) File descriptor 3 (/etc/resolv.conf (deleted)) leaked on vgscan invocation. Parent PID 29287: sh File descriptor 3 (/etc/resolv.conf (deleted)) leaked on lvdisplay invocation. Parent PID 29244: sh File descriptor 3 (/etc/resolv.conf (deleted)) leaked on pvdisplay invocation. Parent PID 29244: sh File descriptor 3 (/etc/resolv.conf (deleted)) leaked on pvdisplay invocation. Parent PID 29244: sh resize2fs: Memory allocation failed while trying to resize /dev/c/c Please run 'e2fsck -fy /dev/c/c' to fix the filesystem after the aborted resize operation. Filesystem at /dev/c/c is mounted on /c; on-line resizing required old desc_blocks = 581, new_desc_blocks = 639 [2015/09/14 14:56:54 23206] Expand second phase error 10: resize2fs, err=0x100 [2015/09/14 14:57:04 23206] Volume expand failed, no drive added [2015/09/14 14:57:04 23206] launch expand_md again for vol expansion [2015/09/14 14:57:04 23206] LINE 6815: exec command: /usr/sbin/expand_md >> /var/log/frontview/expand_md.log 2>&1 & [2015/09/14 14:57:05 23206] xraid mode 1 disk count 4 flex level -1 [2015/09/14 14:57:05 23206] raid mode 1 data_degraded 1 disk count 4 [2015/09/14 14:57:05 23206] LINE 5210: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 & [2015/09/14 14:57:05 23206] LINE 5213: exec command: /frontview/bin/volumescan & [2015/09/14 14:57:06 23206] STAGE_WIPE: Clean my_pid 23206 [2015/09/14 14:57:06 29496] STAGE_CHECK: saved my_pid 29496 in check mode. [2015/09/14 14:57:06 29496] RAID MODE: 1, sn= File descriptor 3 (/etc/resolv.conf (deleted)) leaked on lvs invocation. Parent PID 29508: sh [2015/09/14 14:57:06 29496] LINE 4928: exec command: lvs > /var/log/frontview/.V_E.snapshotstat [2015/09/14 14:57:07 29496] Current file system status: ext4 [2015/09/14 14:57:07 29496] LINE 6523: exec command: rm -fr /var/log/frontview/.V_E.* [2015/09/14 14:57:07 29496] X_level: 5 [2015/09/14 14:57:07 29496] /usr/sbin/expand_md -a super [2015/09/14 14:57:07 29496] MD degraded 0, bg_job 0, boot 0 [2015/09/14 14:57:07 29496] ++++Write 2049488 byte to configuration++++ [2015/09/14 14:57:07 29496] /var/log/frontview/.known_cfgdir/W1F2NA5K [2015/09/14 14:57:07 29496] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 14:57:07 29496] get disk /dev/sdc format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 14:57:07 29496] LINE 9650: exec command: sgdisk -p /dev/sdc | grep '[0-9] ' > /var/log/frontview/.known_cfgdir/W1F2NA5K [2015/09/14 14:57:10 29496] /var/log/frontview/.known_cfgdir/S301BHFT - [2015/09/14 14:57:16 29496] used_disk_pt_count:4,start:4 xraid level is 5 [2015/09/14 14:57:16 29496] Not enough disk for a new array, drives with free space: 0, X_level:5 [2015/09/14 14:57:16 29496] STAGE_WIPE: Clean my_pid 29496 [2015/09/14 14:57:45 29078] STAGE_CHECK: saved my_pid 29078 in check mode. [2015/09/14 14:57:45 29078] RAID MODE: 1, sn= [2015/09/14 14:57:45 29078] LINE 4928: exec command: lvs > /var/log/frontview/.V_E.snapshotstat [2015/09/14 14:57:45 29078] Current file system status: ext4 [2015/09/14 14:57:45 29078] LINE 6523: exec command: rm -fr /var/log/frontview/.V_E.* [2015/09/14 14:57:46 29078] X_level: 5 [2015/09/14 14:57:46 29078] /usr/sbin/expand_md -a super [2015/09/14 14:57:46 29078] MD degraded 0, bg_job 0, boot 0 [2015/09/14 14:57:46 29078] ++++Write 2049488 byte to configuration++++ [2015/09/14 14:57:46 29078] /var/log/frontview/.known_cfgdir/W1F2NA5K [2015/09/14 14:57:46 29078] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 14:57:46 29078] get disk /dev/sdc format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 14:57:46 29078] LINE 9650: exec command: sgdisk -p /dev/sdc | grep '[0-9] ' > /var/log/frontview/.known_cfgdir/W1F2NA5K [2015/09/14 14:57:47 29078] Sgdisk /dev/sdc partition to file Error. rc = -1 [2015/09/14 14:57:47 29078] /var/log/frontview/.known_cfgdir/S301BHFT - repetitions snipped for character limits -
[2015/09/14 14:57:51 29078] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 14:57:51 29078] get disk /dev/sda format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 14:57:51 29078] /dev/sda used/total/partitioned = 3907016483/3907018584/3907016483, 60000000 [2015/09/14 14:57:51 29078] used_disk_pt_count:4,start:4 xraid level is 5 [2015/09/14 14:57:51 29078] Not enough disk for a new array, drives with free space: 0, X_level:5 [2015/09/14 14:57:51 29078] STAGE_WIPE: Clean my_pid 29078 [2015/09/14 14:58:07 29493] STAGE_CHECK: saved my_pid 29493 in check mode. [2015/09/14 14:58:07 29493] RAID MODE: 1, sn= File descriptor 3 (/etc/resolv.conf (deleted)) leaked on lvs invocation. Parent PID 29652: sh [2015/09/14 14:58:07 29493] LINE 4928: exec command: lvs > /var/log/frontview/.V_E.snapshotstat [2015/09/14 14:58:08 29493] Current file system status: ext4 [2015/09/14 14:58:08 29493] LINE 6523: exec command: rm -fr /var/log/frontview/.V_E.* [2015/09/14 14:58:08 29493] X_level: 5 [2015/09/14 14:58:08 29493] /usr/sbin/expand_md [2015/09/14 14:58:08 29493] MD degraded 0, bg_job 0, boot 0 [2015/09/14 14:58:08 29493] Read 2049488 byte from configuration [2015/09/14 14:58:08 29493] Disk configuration matching with online configuration. [2015/09/14 14:58:08 29493] Should do expand now... [2015/09/14 14:58:08 29493] ===== Partition Entry (MD not used) ===== [2015/09/14 14:58:08 29493] ===== Partition Entry (Used by MD) ===== [2015/09/14 14:58:08 29493] 000 /dev/sdc,W1F2NA5K,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0 [2015/09/14 14:58:08 29493] partitions: 3 property: 4K [2015/09/14 14:58:08 29493] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0 [2015/09/14 14:58:08 29493] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1 [2015/09/14 14:58:08 29493] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2 [2015/09/14 14:58:08 29493] 001 /dev/sdb,S301BHFT,8, 16, 3907018584 3907016483 3907016483 MD_FULL 0 [2015/09/14 14:58:08 29493] partitions: 4 property: 4K [2015/09/14 14:58:08 29493] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0 [2015/09/14 14:58:08 29493] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1 [2015/09/14 14:58:08 29493] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2 [2015/09/14 14:58:08 29493] 003 /dev/sdb4, 8, 20, 976751979 MD_FULL md=/dev/md3 [2015/09/14 14:58:08 29493] 002 /dev/sdd,S301BHV7,8, 48, 3907018584 3907016483 3907016483 MD_FULL 0 [2015/09/14 14:58:08 29493] partitions: 4 property: 4K [2015/09/14 14:58:08 29493] 000 /dev/sdd1, 8, 49, 4194304 MD_FULL md=/dev/md0 [2015/09/14 14:58:08 29493] 001 /dev/sdd2, 8, 50, 524288 MD_FULL md=/dev/md1 [2015/09/14 14:58:08 29493] 002 /dev/sdd3, 8, 51, 2925545912 MD_FULL md=/dev/md2 [2015/09/14 14:58:08 29493] 003 /dev/sdd4, 8, 52, 976751979 MD_FULL md=/dev/md3 [2015/09/14 14:58:08 29493] 003 /dev/sda,Z3039RT9,8, 0, 3907018584 3907016483 3907016483 MD_FULL 0 [2015/09/14 14:58:08 29493] partitions: 4 property: 4K [2015/09/14 14:58:08 29493] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0 [2015/09/14 14:58:08 29493] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1 [2015/09/14 14:58:08 29493] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2 [2015/09/14 14:58:08 29493] 003 /dev/sda4, 8, 4, 976751979 MD_FULL md=/dev/md3 [2015/09/14 14:58:08 29493] Found leftover expansion actions DOING_F_RESIZE , continue... [2015/09/14 14:58:17 29493] LINE 540: exec command: echo "DOING_F_RESIZE" > /.os_V_E_continue [2015/09/14 14:58:18 29493] LINE 4569: exec command: resize2fs -pf /dev/c/c resize2fs 1.41.14 (22-Dec-2010) resize2fs: Memory allocation failed while trying to resize /dev/c/c Please run 'e2fsck -fy /dev/c/c' to fix the filesystem after the aborted resize operation. Filesystem at /dev/c/c is mounted on /c; on-line resizing required old desc_blocks = 581, new_desc_blocks = 639 [2015/09/14 15:11:40 29493] Expand second phase error 10: resize2fs, err=0x100 [2015/09/14 15:11:51 29493] File system expand failed [2015/09/14 15:11:51 29493] LINE 5210: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 & [2015/09/14 15:11:51 29493] LINE 5213: exec command: /frontview/bin/volumescan & [2015/09/14 15:11:52 29493] STAGE_WIPE: Clean my_pid 29493 [2015/09/14 15:11:52 29810] STAGE_CHECK: saved my_pid 29810 in check mode. [2015/09/14 15:11:52 29810] RAID MODE: 1, sn= File descriptor 3 (/etc/resolv.conf (deleted)) leaked on lvs invocation. Parent PID 29822: sh [2015/09/14 15:11:53 29810] LINE 4928: exec command: lvs > /var/log/frontview/.V_E.snapshotstat [2015/09/14 15:11:53 29810] Current file system status: ext4 [2015/09/14 15:11:53 29810] LINE 6523: exec command: rm -fr /var/log/frontview/.V_E.* [2015/09/14 15:11:53 29810] X_level: 5 [2015/09/14 15:11:53 29810] /usr/sbin/expand_md -a super [2015/09/14 15:11:53 29810] MD degraded 0, bg_job 0, boot 0 [2015/09/14 15:11:53 29810] ++++Write 2049488 byte to configuration++++ [2015/09/14 15:11:53 29810] /var/log/frontview/.known_cfgdir/W1F2NA5K [2015/09/14 15:11:53 29810] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 15:11:53 29810] get disk /dev/sdc format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 15:11:53 29810] LINE 9650: exec command: sgdisk -p /dev/sdc | grep '[0-9] ' > /var/log/frontview/.known_cfgdir/W1F2NA5K [2015/09/14 15:11:56 29810] /var/log/frontview/.known_cfgdir/S301BHFT [2015/09/14 15:11:56 29810] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 15:11:56 29810] get disk /dev/sdb format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 15:11:56 29810] LINE 9650: exec command: sgdisk -p /dev/sdb | grep '[0-9] ' > /var/log/frontview/.known_cfgdir/S301BHFT [2015/09/14 15:11:59 29810] /var/log/frontview/.known_cfgdir/S301BHV7 [2015/09/14 15:11:59 29810] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 15:11:59 29810] get disk /dev/sdd format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 15:11:59 29810] LINE 9650: exec command: sgdisk -p /dev/sdd | grep '[0-9] ' > /var/log/frontview/.known_cfgdir/S301BHV7 File descriptor 3 (/etc/resolv.conf (deleted)) leaked on vgscan invocation. Parent PID 29860: sh File descriptor 3 (/etc/resolv.conf (deleted)) leaked on lvdisplay invocation. Parent PID 29812: sh File descriptor 3 (/etc/resolv.conf (deleted)) leaked on pvdisplay invocation. Parent PID 29812: sh File descriptor 3 (/etc/resolv.conf (deleted)) leaked on pvdisplay invocation. Parent PID 29812: sh [2015/09/14 15:12:00 29810] /var/log/frontview/.known_cfgdir/Z3039RT9 [2015/09/14 15:12:00 29810] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 15:12:00 29810] get disk /dev/sda format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 15:12:00 29810] LINE 9650: exec command: sgdisk -p /dev/sda | grep '[0-9] ' > /var/log/frontview/.known_cfgdir/Z3039RT9 [2015/09/14 15:12:02 29810] LINE 5297: exec command: ps -ef | grep -v expand_md > /var/log/frontview/.V_E.snapshotstat [2015/09/14 15:12:02 29810] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 15:12:02 29810] get disk /dev/sdc format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 15:12:02 29810] /dev/sdc used/total/partitioned = 2930264504/2930266584/2930264504, 60000000 [2015/09/14 15:12:02 29810] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 15:12:02 29810] get disk /dev/sdb format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 15:12:02 29810] /dev/sdb used/total/partitioned = 3907016483/3907018584/3907016483, 60000000 [2015/09/14 15:12:02 29810] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 15:12:02 29810] get disk /dev/sdd format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 15:12:02 29810] /dev/sdd used/total/partitioned = 3907016483/3907018584/3907016483, 60000000 [2015/09/14 15:12:02 29810] gpt sig:0,mbr sig:0,fake type:0 [2015/09/14 15:12:02 29810] get disk /dev/sda format is (GPT=2,MBR=1,MX=3,MISC=-1): 2 [2015/09/14 15:12:02 29810] /dev/sda used/total/partitioned = 3907016483/3907018584/3907016483, 60000000 [2015/09/14 15:12:02 29810] used_disk_pt_count:4,start:4 xraid level is 5 [2015/09/14 15:12:02 29810] Not enough disk for a new array, drives with free space: 0, X_level:5 [2015/09/14 15:12:03 29810] STAGE_WIPE: Clean my_pid 29810
Expansion is also failing due to memory allocation
resize2fs: Memory allocation failed while trying to resize /dev/c/c
I don't own a v2 - but if you know of a place where the amount of memory is displayed, you should check to make sure that it is seeing 256MB.
I also suggest a memory test from the boot menu (http://www.readynas.com/download/documentation/HM/ReadyNAS_Duov2_NV+v2_HW_en_19-Sept-11.pdf ). Unfortunately Netgear doesn't disclose how to tell if the test passed/failed. But you could take a short video, and post the link here, they should be able to interpret the results here.
Are you the original purchaser? If so, when did you purchase? The warrany is 3 years. If you are still covered I think you have have enough evidence of a hardware fault that they should diagnose it w/o charge
This is the entirety of mem_info.log:
MemTotal: 246820 kB MemFree: 24704 kB Buffers: 5540 kB Cached: 60848 kB SwapCached: 18348 kB Active: 66812 kB Inactive: 96552 kB Active(anon): 41012 kB Inactive(anon): 56412 kB Active(file): 25800 kB Inactive(file): 40140 kB Unevictable: 376 kB Mlocked: 0 kB SwapTotal: 524268 kB SwapFree: 495600 kB Dirty: 296 kB Writeback: 0 kB AnonPages: 80176 kB Mapped: 13952 kB Slab: 20804 kB SReclaimable: 4624 kB SUnreclaim: 16180 kB PageTables: 2172 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 647676 kB Committed_AS: 726704 kB VmallocTotal: 385024 kB VmallocUsed: 940 kB VmallocChunk: 382812 kB
And this is memory.log:
SZ: 256 AT: SDRAM
Looks to me like it can definitely see 256MB. But now I'm going to have a go at that memory test, so at least I have the results when talking to support.
I just looked up my receipt for purchasing the unit: looks like the timing is good! 30 Sep 2012. So I'd better get on with diagnosing any hardware failure.
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
