× NETGEAR will be terminating ReadyCLOUD service by July 1st, 2023. For more details click here.
Orbi WiFi 7 RBE973
Reply

Re: Ultra 6 - Dead drive, Replaced but won't Rebuild #249990

Quinny1
Aspirant

Ultra 6 - Dead drive, Replaced but won't Rebuild #24999085

I have a ReadyNAS Ultra 6 in Raid 6 which was 98% full. RAIDiator 4.2.25

Wed Jan 7 12:56:48 NZDT 2015 Disk failure detected.
Wed Jan 7 12:57:01 NZDT 2015 ..... If this disk is a part of a RAID 6 volume, your volume is still protected if this is your first failure. A 2nd disk failure will make your volume unprotected. If this disk is a part of a RAID 10 volume,your volume is still protected if more than half of the disks alive. But another failure of disks been marked may render that volume dead. It is recommended that you replace the failed disk as soon as possible to maintain optimal protection of your volume.


Powered down system and left off as could not deal with it all due to unrelated pc issues at the same time 😞

Finally brought new drive. Being umm "blonde" I turned the unit off to replace the drive. Spend Feb turning everything on and off to see if noticed drive. Nada.

Sun Mar 8 19:51:59 NZDT 2015 Data volume will be rebuilt with disk 4.
Sun Mar 8 19:50:20 NZDT 2015 System is up.


Waited 2 weeks nothing.
Tried again, waited again, nothing.
Researched found out should do as hotswap.

Sat Apr 4 19:38:11 NZDT 2015 New disk detected. If multiple disks have been added, they will be processed one at a time. Please do not remove any added disk(s) during this time. [Disk 4]
Sat Apr 4 19:37:14 NZDT 2015 A disk was removed from the ReadyNAS. For full protection of your data volume, please add a replacement disk as soon as possible.
Sat Apr 4 19:37:14 NZDT 2015 Disk removal detected. [Disk 4]


Saw new disk 4 was checked AND PASSED. Yay this time will work.
Nope nada.
Read every forum post on topic, read everything could find on web, tried options all over.
Found "could be" was too full. Moved 1tb off machine.

Wed Apr 8 20:45:57 NZST 2015 Data volume will be rebuilt with disk 4.
Wed Apr 8 20:43:46 NZST 2015 New disk detected. If multiple disks have been added, they will be processed one at a time. Please do not remove any added disk(s) during this time. [Disk 4]
Wed Apr 8 20:43:07 NZST 2015 A disk was removed from the ReadyNAS. For full protection of your data volume, please add a replacement disk as soon as possible.
Wed Apr 8 20:43:07 NZST 2015 Disk removal detected. [Disk 4]


And still nothing. I check in Volume, Volume as people with this rebuild not happening suggest and nope nothing happens. 3 months now and so over it. Anyone any ideas of what can try?
Message 1 of 13
de_niro
Guide

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

Can you please paste expand_md log here? btw,you can also contact NETGEAR support center to verify the issue directly.
Message 2 of 13
Quinny1
Aspirant

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

Is this it? expansion.log? Nothing called expand_md but mentioned it.

[2014/09/09 20:46:26 2097] Boot, handle mutiple expand_md
[2014/09/09 20:46:27 2098] STAGE_CHECK: saved my_pid 2098 in check mode.
[2014/09/09 20:46:27 2098] RAID MODE: 1, sn=
[2014/09/09 20:46:28 2098] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2014/09/09 20:46:28 2098] Current file system status: ext4
[2014/09/09 20:46:28 2098] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2014/09/09 20:46:28 2098] X_level: 6
[2014/09/09 20:46:28 2098] /usr/sbin/expand_md
[2014/09/09 20:46:28 2098] MD degraded 0, bg_job 0, boot 1
[2014/09/09 20:46:29 2098] Read 1957072 byte from configuration
[2014/09/09 20:46:29 2098] Disk configuration matching with online configuration.
[2014/09/09 20:46:29 2098] gpt sig:0,mbr sig:0,fake type:0
[2014/09/09 20:46:29 2098] get disk /dev/sda format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/09 20:46:29 2098] /dev/sda used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/09 20:46:29 2098] gpt sig:0,mbr sig:0,fake type:0
[2014/09/09 20:46:29 2098] get disk /dev/sdb format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/09 20:46:29 2098] /dev/sdb used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/09 20:46:29 2098] gpt sig:0,mbr sig:0,fake type:0
[2014/09/09 20:46:29 2098] get disk /dev/sdc format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/09 20:46:29 2098] /dev/sdc used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/09 20:46:29 2098] gpt sig:0,mbr sig:0,fake type:0
[2014/09/09 20:46:29 2098] get disk /dev/sdd format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/09 20:46:29 2098] /dev/sdd used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/09 20:46:29 2098] gpt sig:0,mbr sig:0,fake type:0
[2014/09/09 20:46:29 2098] get disk /dev/sde format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/09 20:46:29 2098] /dev/sde used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/09 20:46:29 2098] gpt sig:0,mbr sig:0,fake type:0
[2014/09/09 20:46:29 2098] get disk /dev/sdf format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/09 20:46:29 2098] /dev/sdf used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/09 20:46:29 2098] Not enough disk for a new array, drives with free space: 0, X_level:6
[2014/09/09 20:46:29 2098] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2014/09/09 20:46:29 2098] STAGE_WIPE: Clean my_pid 2098
[2014/09/22 06:34:25 2104] Boot, handle mutiple expand_md
[2014/09/22 06:34:26 2105] STAGE_CHECK: saved my_pid 2105 in check mode.
[2014/09/22 06:34:26 2105] RAID MODE: 1, sn=
[2014/09/22 06:34:26 2105] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2014/09/22 06:34:27 2105] Current file system status: ext4
[2014/09/22 06:34:27 2105] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2014/09/22 06:34:27 2105] X_level: 6
[2014/09/22 06:34:27 2105] /usr/sbin/expand_md
[2014/09/22 06:34:27 2105] MD degraded 0, bg_job 0, boot 1
[2014/09/22 06:34:27 2105] Read 1957072 byte from configuration
[2014/09/22 06:34:27 2105] Disk configuration matching with online configuration.
[2014/09/22 06:34:27 2105] gpt sig:0,mbr sig:0,fake type:0
[2014/09/22 06:34:27 2105] get disk /dev/sda format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/22 06:34:27 2105] /dev/sda used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/22 06:34:27 2105] gpt sig:0,mbr sig:0,fake type:0
[2014/09/22 06:34:27 2105] get disk /dev/sdb format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/22 06:34:27 2105] /dev/sdb used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/22 06:34:27 2105] gpt sig:0,mbr sig:0,fake type:0
[2014/09/22 06:34:27 2105] get disk /dev/sdc format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/22 06:34:27 2105] /dev/sdc used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/22 06:34:27 2105] gpt sig:0,mbr sig:0,fake type:0
[2014/09/22 06:34:27 2105] get disk /dev/sdd format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/22 06:34:27 2105] /dev/sdd used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/22 06:34:27 2105] gpt sig:0,mbr sig:0,fake type:0
[2014/09/22 06:34:27 2105] get disk /dev/sde format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/22 06:34:27 2105] /dev/sde used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/22 06:34:27 2105] gpt sig:0,mbr sig:0,fake type:0
[2014/09/22 06:34:27 2105] get disk /dev/sdf format is (GPT=2,MBR=1,MX=3,MISC=-1): 2
[2014/09/22 06:34:27 2105] /dev/sdf used/total/partitioned = 2930264504/2930266584/2930264504, 60000000
[2014/09/22 06:34:27 2105] Not enough disk for a new array, drives with free space: 0, X_level:6
[2014/09/22 06:34:27 2105] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2014/09/22 06:34:29 2105] STAGE_WIPE: Clean my_pid 2105
[2015/02/07 14:06:52 2098] Boot, handle mutiple expand_md
[2015/02/07 14:06:53 2099] STAGE_CHECK: saved my_pid 2099 in check mode.
[2015/02/07 14:06:53 2099] RAID MODE: 1, sn=
[2015/02/07 14:06:58 2099] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/02/07 14:08:00 2099] Current file system status: offline
[2015/02/07 14:08:00 2099] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/02/07 14:08:59 2099] Adjust used size on /dev/sdd Used/total/partitioned=2930266584/2930264504/2930264504, -(not used)2925545912
[2015/02/07 14:08:59 2099] X_level: 6
[2015/02/07 14:08:59 2099] /usr/sbin/expand_md
[2015/02/07 14:08:59 2099] MD degraded 1, bg_job 0, boot 1
[2015/02/07 14:09:00 2099] Read 1957072 byte from configuration
[2015/02/07 14:09:00 2099] Disk configuration matching with online configuration.
[2015/02/07 14:09:00 2099] May need to fix array.
[2015/02/07 14:09:00 2099] ===== Partition Entry (Used by MD) =====
[2015/02/07 14:09:00 2099] 000 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/02/07 14:09:00 2099] partitions: 3 property: 4K
[2015/02/07 14:09:00 2099] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/02/07 14:09:00 2099] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/02/07 14:09:00 2099] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/02/07 14:09:00 2099] 001 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/02/07 14:09:00 2099] partitions: 3 property: 4K
[2015/02/07 14:09:00 2099] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/02/07 14:09:00 2099] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/02/07 14:09:00 2099] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/02/07 14:09:00 2099] 002 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/02/07 14:09:00 2099] partitions: 3 property: 4K
[2015/02/07 14:09:00 2099] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/02/07 14:09:00 2099] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/02/07 14:09:00 2099] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/02/07 14:09:00 2099] 003 /dev/sdd,WD-WCAWZ1978251,8, 48, 2930266584 4718592 2930264504 MD_PART 0
[2015/02/07 14:09:00 2099] partitions: 3 property: 4K
[2015/02/07 14:09:00 2099] 000 /dev/sdd1, 8, 49, 4194304 MD_FULL md=/dev/md0
[2015/02/07 14:09:00 2099] 001 /dev/sdd2, 8, 50, 524288 MD_FULL md=/dev/md1
[2015/02/07 14:09:00 2099] 002 /dev/sdd3, 8, 51, 2925545912 NO_MD md=
[2015/02/07 14:09:00 2099] 004 /dev/sde,WD-WCAWZ2059507,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/02/07 14:09:00 2099] partitions: 3 property: 4K
[2015/02/07 14:09:00 2099] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/02/07 14:09:00 2099] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/02/07 14:09:00 2099] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/02/07 14:09:00 2099] 005 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/02/07 14:09:00 2099] partitions: 3 property: 4K
[2015/02/07 14:09:00 2099] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/02/07 14:09:00 2099] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/02/07 14:09:00 2099] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/02/07 14:09:00 2099] disk and pt index: /dev/sda 0 2 size=2925545912 cfg=MD_FULL
[2015/02/07 14:09:00 2099] disk and pt index: 0 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sda1
[2015/02/07 14:09:00 2099] disk and pt index: 0 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sda2
[2015/02/07 14:09:00 2099] disk and pt index: 0 2 size=2925545912 s_name1 = MD_FULL, s_name = /dev/sda3
[2015/02/07 14:09:00 2099] disk and pt index: 1 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sdb1
[2015/02/07 14:09:00 2099] disk and pt index: 1 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sdb2
[2015/02/07 14:09:00 2099] disk and pt index: 1 2 size=2925545912 s_name1 = MD_FULL, s_name = /dev/sdb3
[2015/02/07 14:09:00 2099] disk and pt index: 2 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sdc1
[2015/02/07 14:09:00 2099] disk and pt index: 2 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sdc2
[2015/02/07 14:09:00 2099] disk and pt index: 2 2 size=2925545912 s_name1 = MD_FULL, s_name = /dev/sdc3
[2015/02/07 14:09:00 2099] disk and pt index: 3 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sdd1
[2015/02/07 14:09:00 2099] disk and pt index: 3 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sdd2
[2015/02/07 14:09:00 2099] disk and pt index: 3 2 size=2925545912 s_name1 = NO_MD, s_name = /dev/sdd3
[2015/02/07 14:09:00 2099] NEED TO ADD DRIVE /dev/sdd3 INTO MD /dev/md2, this is a problem,may be caused by reboot system before added disk sync all arrays,blindly add this drive back to the array.
mdadm: re-added /dev/sdd3
[2015/02/07 14:09:00 2099] LINE 5018: exec command: mdadm -a /dev/md2 /dev/sdd3

[2015/02/07 14:09:01 2099] LINE 3152: exec command: echo 100000 > /sys/block/md2/md/sync_speed_min
[2015/02/07 14:10:38 2099] LINE 3155: exec command: mdadm --misc -W /dev/md2

[2015/02/07 14:14:52 2099] Array /dev/md2 still not ok after wait_md, err:1
[2015/02/07 14:14:52 2099] Wait md add failed on 136601472, This array will de degraded.
[2015/02/07 14:14:52 2099] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/02/07 14:15:12 2099] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/02/07 14:15:16 2099] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2015/02/07 14:15:20 2099] STAGE_WIPE: Clean my_pid 2099
[2015/02/07 14:15:54 12705] STAGE_CHECK: saved my_pid 12705 in check mode.
[2015/02/07 14:15:55 12705] RAID MODE: 1, sn=
[2015/02/07 14:15:55 12705] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/02/07 14:16:04 12705] Current file system status: ext4
[2015/02/07 14:16:04 12705] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/02/07 14:16:12 12705] X_level: 6
[2015/02/07 14:16:12 12705] /usr/sbin/expand_md -a super
[2015/02/07 14:16:12 12705] MD degraded 1, bg_job 0, boot 0
[2015/02/07 14:16:12 12705] STAGE_WIPE: Clean my_pid 12705
[2015/03/08 19:49:50 2112] Boot, handle mutiple expand_md
[2015/03/08 19:49:51 2113] STAGE_CHECK: saved my_pid 2113 in check mode.
[2015/03/08 19:49:51 2113] RAID MODE: 1, sn=
[2015/03/08 19:49:52 2113] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/03/08 19:49:52 2113] Current file system status: offline
[2015/03/08 19:49:52 2113] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/03/08 19:49:52 2113] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/03/08 19:51:57 2113] PASSED
[2015/03/08 19:51:58 2113] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/03/08 19:51:58 2113] X_level: 6
[2015/03/08 19:51:58 2113] /usr/sbin/expand_md
[2015/03/08 19:51:58 2113] MD degraded 1, bg_job 0, boot 1
[2015/03/08 19:51:58 2113] Read 1957072 byte from configuration
[2015/03/08 19:51:58 2113] Disk configuration matching with online configuration.
[2015/03/08 19:51:58 2113] May need to fix array.
[2015/03/08 19:51:58 2113] new_disk_pt_count: 1
[2015/03/08 19:51:58 2113] * new disk: /dev/sdd
[2015/03/08 19:51:58 2113] ===== Partition Entry (MD not used) =====
[2015/03/08 19:51:58 2113] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 0 0 NO_MD 0
[2015/03/08 19:51:58 2113] partitions: 0 property: UNKNOWN
[2015/03/08 19:51:58 2113] ===== Partition Entry (Used by MD) =====
[2015/03/08 19:51:58 2113] 000 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/08 19:51:58 2113] partitions: 3 property: 4K
[2015/03/08 19:51:58 2113] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/03/08 19:51:58 2113] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/03/08 19:51:58 2113] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/03/08 19:51:58 2113] 001 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/08 19:51:58 2113] partitions: 3 property: 4K
[2015/03/08 19:51:58 2113] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/03/08 19:51:58 2113] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/03/08 19:51:58 2113] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/03/08 19:51:58 2113] 002 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/08 19:51:58 2113] partitions: 3 property: 4K
[2015/03/08 19:51:58 2113] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/03/08 19:51:58 2113] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/03/08 19:51:58 2113] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/03/08 19:51:58 2113] 003 /dev/sde,WD-WCAWZ2059507,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/08 19:51:58 2113] partitions: 3 property: 4K
[2015/03/08 19:51:58 2113] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/03/08 19:51:58 2113] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/03/08 19:51:58 2113] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/03/08 19:51:58 2113] 004 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/08 19:51:58 2113] partitions: 3 property: 4K
[2015/03/08 19:51:58 2113] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/03/08 19:51:58 2113] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/03/08 19:51:58 2113] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/03/08 19:51:58 2113] in find_drive_... looking at /dev/md2
[2015/03/08 19:51:58 2113] found drive has the needed size for /dev/md2: /dev/sdf, 2930266584, 2930264504
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ1982796
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ1982796 WD-WCAWZ1982796
[2015/03/08 19:51:58 2113] Take /dev/sda WD-WCAWZ1982796 away
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ2042830
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ2042830 WD-WCAWZ2042830
[2015/03/08 19:51:58 2113] Take /dev/sdb WD-WCAWZ2042830 away
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ2059262
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ2059262 WD-WCAWZ2059262
[2015/03/08 19:51:58 2113] Take /dev/sdc WD-WCAWZ2059262 away
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ1978251
[2015/03/08 19:51:58 2113] Drive WD-WCAWZ1978251 missing.
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ2059507
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ2059507 WD-WCAWZ2059507
[2015/03/08 19:51:58 2113] Take /dev/sde WD-WCAWZ2059507 away
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ2042889
[2015/03/08 19:51:58 2113] Drive sn WD-WCAWZ2042889 WD-WCAWZ2042889
[2015/03/08 19:51:58 2113] Take /dev/sdf WD-WCAWZ2042889 away
[2015/03/08 19:51:58 2113] Total missing: 1, index=3
[2015/03/08 19:51:58 2113] found missing drive: /dev/sdd WD-WCAWZ1978251 MD_NULL blocks=2930266584 2930264504 2930264504
[2015/03/08 19:51:58 2113] XRAID cfg_pt = WD-WCAWZ2042889, these two drives size close: 0 /dev/sdd 2930266584, 0 /dev/sda 2930266584
[2015/03/08 19:51:58 2113] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/08 19:51:58 2113] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/08 19:51:59 2113] Repair md: use disk /dev/sdd, size 2930266584
[2015/03/08 19:52:02 2113] LINE 1505: exec command: sgdisk -Z /dev/sdd
Creating new GPT entries.
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
[2015/03/08 19:52:06 2113] Update new added disk information: from /dev/sdf to /dev/sdd
[2015/03/08 19:52:06 2113] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 0 0 NO_MD 0
[2015/03/08 19:52:06 2113] partitions: 0 property: UNKNOWN
[2015/03/08 19:52:06 2113] 000 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/08 19:52:06 2113] partitions: 3 property: 4K
[2015/03/08 19:52:06 2113] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/03/08 19:52:06 2113] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/03/08 19:52:06 2113] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/03/08 19:52:06 2113] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 2930264504 2930264504 NO_MD 0
[2015/03/08 19:52:06 2113] partitions: 3 property: UNKNOWN
[2015/03/08 19:52:06 2113] 000 /dev/sdd1, 0, 0, 4194304 NO_MD md=
[2015/03/08 19:52:06 2113] 001 /dev/sdd2, 0, 0, 524288 NO_MD md=
[2015/03/08 19:52:06 2113] 002 /dev/sdd3, 0, 0, 2925545912 NO_MD md=
[2015/03/08 19:52:06 2113] Get format of pt /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/08 19:52:06 2113] Error unkonwn partition table /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889 !!!!
[2015/03/08 19:52:06 2113] Need to increase ext size from 0 to 0
[2015/03/08 19:52:06 2113] LINE 3717: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.V_E.source_pt1.sav

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/03/08 19:52:07 2113] Input target disk 4K align partition problem: 256, use old partition.
[2015/03/08 19:52:07 2113] LINE 3723: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/03/08 19:52:07 2113] LINE 3730: exec command: sgdisk -g -a 8 /dev/sdd
Creating new GPT entries.
The operation has completed successfully.
[2015/03/08 19:52:10 2113] Succeed to convert mbr to gpt /dev/sda.
[2015/03/08 19:52:10 2113] Input target disk partition problem: 256
[2015/03/08 19:52:10 2113] Failed to add disk to md
[2015/03/08 19:52:10 2113] Added drive to md, grown=0/0xffaeb6c8
[2015/03/08 19:52:10 2113] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/03/08 19:52:10 2113] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/03/08 19:52:10 2113] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2015/03/08 19:52:11 2113] STAGE_WIPE: Clean my_pid 2113
[2015/03/08 19:52:11 5911] STAGE_CHECK: saved my_pid 5911 in check mode.
[2015/03/08 19:52:11 5911] RAID MODE: 1, sn=
[2015/03/08 19:52:11 5911] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/03/08 19:52:11 5911] Current file system status: ext4
[2015/03/08 19:52:11 5911] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/03/08 19:52:12 5911] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/03/08 19:54:12 5911] PASSED
[2015/03/08 19:54:12 5911] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/03/08 19:54:13 5911] X_level: 6
[2015/03/08 19:54:13 5911] /usr/sbin/expand_md -a super
[2015/03/08 19:54:13 5911] MD degraded 1, bg_job 0, boot 0
[2015/03/08 19:54:13 5911] STAGE_WIPE: Clean my_pid 5911
[2015/03/27 18:34:37 2109] Boot, handle mutiple expand_md
[2015/03/27 18:34:38 2110] STAGE_CHECK: saved my_pid 2110 in check mode.
[2015/03/27 18:34:38 2110] RAID MODE: 1, sn=
[2015/03/27 18:34:38 2110] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/03/27 18:34:38 2110] Current file system status: offline
[2015/03/27 18:34:38 2110] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/03/27 18:34:38 2110] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/03/27 18:36:49 2110] PASSED
[2015/03/27 18:36:49 2110] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/03/27 18:36:50 2110] X_level: 6
[2015/03/27 18:36:50 2110] /usr/sbin/expand_md
[2015/03/27 18:36:50 2110] MD degraded 1, bg_job 0, boot 1
[2015/03/27 18:36:50 2110] Read 1957072 byte from configuration
[2015/03/27 18:36:50 2110] Disk configuration matching with online configuration.
[2015/03/27 18:36:50 2110] May need to fix array.
[2015/03/27 18:36:50 2110] new_disk_pt_count: 1
[2015/03/27 18:36:50 2110] * new disk: /dev/sdd
[2015/03/27 18:36:50 2110] ===== Partition Entry (MD not used) =====
[2015/03/27 18:36:50 2110] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 0 0 NO_MD 0
[2015/03/27 18:36:50 2110] partitions: 0 property: UNKNOWN
[2015/03/27 18:36:50 2110] ===== Partition Entry (Used by MD) =====
[2015/03/27 18:36:50 2110] 000 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:36:50 2110] partitions: 3 property: 4K
[2015/03/27 18:36:50 2110] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:36:50 2110] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:36:50 2110] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:36:50 2110] 001 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:36:50 2110] partitions: 3 property: 4K
[2015/03/27 18:36:50 2110] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:36:50 2110] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:36:50 2110] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:36:50 2110] 002 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:36:50 2110] partitions: 3 property: 4K
[2015/03/27 18:36:50 2110] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:36:50 2110] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:36:50 2110] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:36:50 2110] 003 /dev/sde,WD-WCAWZ2059507,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:36:50 2110] partitions: 3 property: 4K
[2015/03/27 18:36:50 2110] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:36:50 2110] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:36:50 2110] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:36:50 2110] 004 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:36:50 2110] partitions: 3 property: 4K
[2015/03/27 18:36:50 2110] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:36:50 2110] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:36:50 2110] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:36:50 2110] in find_drive_... looking at /dev/md2
[2015/03/27 18:36:50 2110] found drive has the needed size for /dev/md2: /dev/sdf, 2930266584, 2930264504
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ1982796
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ1982796 WD-WCAWZ1982796
[2015/03/27 18:36:50 2110] Take /dev/sda WD-WCAWZ1982796 away
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ2042830
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ2042830 WD-WCAWZ2042830
[2015/03/27 18:36:50 2110] Take /dev/sdb WD-WCAWZ2042830 away
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ2059262
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ2059262 WD-WCAWZ2059262
[2015/03/27 18:36:50 2110] Take /dev/sdc WD-WCAWZ2059262 away
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ1978251
[2015/03/27 18:36:50 2110] Drive WD-WCAWZ1978251 missing.
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ2059507
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ2059507 WD-WCAWZ2059507
[2015/03/27 18:36:50 2110] Take /dev/sde WD-WCAWZ2059507 away
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ2042889
[2015/03/27 18:36:50 2110] Drive sn WD-WCAWZ2042889 WD-WCAWZ2042889
[2015/03/27 18:36:50 2110] Take /dev/sdf WD-WCAWZ2042889 away
[2015/03/27 18:36:50 2110] Total missing: 1, index=3
[2015/03/27 18:36:50 2110] found missing drive: /dev/sdd WD-WCAWZ1978251 MD_NULL blocks=2930266584 2930264504 2930264504
[2015/03/27 18:36:50 2110] XRAID cfg_pt = WD-WCAWZ2042889, these two drives size close: 0 /dev/sdd 2930266584, 0 /dev/sda 2930266584
[2015/03/27 18:36:50 2110] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/27 18:36:50 2110] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/27 18:36:51 2110] Repair md: use disk /dev/sdd, size 2930266584
[2015/03/27 18:36:54 2110] LINE 1505: exec command: sgdisk -Z /dev/sdd
Found valid GPT with corrupt MBR; using GPT and will write new
protective MBR on save.
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
[2015/03/27 18:36:57 2110] Update new added disk information: from /dev/sdf to /dev/sdd
[2015/03/27 18:36:57 2110] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 0 0 NO_MD 0
[2015/03/27 18:36:57 2110] partitions: 0 property: UNKNOWN
[2015/03/27 18:36:57 2110] 000 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:36:57 2110] partitions: 3 property: 4K
[2015/03/27 18:36:57 2110] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:36:57 2110] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:36:57 2110] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:36:57 2110] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 2930264504 2930264504 NO_MD 0
[2015/03/27 18:36:57 2110] partitions: 3 property: UNKNOWN
[2015/03/27 18:36:57 2110] 000 /dev/sdd1, 0, 0, 4194304 NO_MD md=
[2015/03/27 18:36:57 2110] 001 /dev/sdd2, 0, 0, 524288 NO_MD md=
[2015/03/27 18:36:57 2110] 002 /dev/sdd3, 0, 0, 2925545912 NO_MD md=
[2015/03/27 18:36:57 2110] Get format of pt /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/27 18:36:57 2110] Error unkonwn partition table /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889 !!!!
[2015/03/27 18:36:57 2110] Need to increase ext size from 0 to 0
[2015/03/27 18:36:57 2110] LINE 3717: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.V_E.source_pt1.sav

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/03/27 18:36:58 2110] Input target disk 4K align partition problem: 256, use old partition.
[2015/03/27 18:36:58 2110] LINE 3723: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/03/27 18:36:58 2110] LINE 3730: exec command: sgdisk -g -a 8 /dev/sdd
Creating new GPT entries.
The operation has completed successfully.
[2015/03/27 18:37:02 2110] Succeed to convert mbr to gpt /dev/sda.
[2015/03/27 18:37:02 2110] Input target disk partition problem: 256
[2015/03/27 18:37:02 2110] Failed to add disk to md
[2015/03/27 18:37:02 2110] Added drive to md, grown=0/0xffa72fb8
[2015/03/27 18:37:02 2110] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/03/27 18:37:02 2110] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/03/27 18:37:03 2110] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2015/03/27 18:37:03 2110] STAGE_WIPE: Clean my_pid 2110
[2015/03/27 18:38:04 6023] STAGE_CHECK: saved my_pid 6023 in check mode.
[2015/03/27 18:38:04 6023] RAID MODE: 1, sn=
[2015/03/27 18:38:04 6023] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/03/27 18:38:04 6023] Current file system status: ext4
[2015/03/27 18:38:04 6023] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/03/27 18:38:04 6023] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/03/27 18:40:11 6023] PASSED
[2015/03/27 18:40:11 6023] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/03/27 18:40:11 6023] X_level: 6
[2015/03/27 18:40:11 6023] /usr/sbin/expand_md -a super
[2015/03/27 18:40:11 6023] MD degraded 1, bg_job 0, boot 0
[2015/03/27 18:40:11 6023] STAGE_WIPE: Clean my_pid 6023
[2015/03/27 18:44:21 2100] Boot, handle mutiple expand_md
[2015/03/27 18:44:22 2101] STAGE_CHECK: saved my_pid 2101 in check mode.
[2015/03/27 18:44:22 2101] RAID MODE: 1, sn=
[2015/03/27 18:44:23 2101] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/03/27 18:44:23 2101] Current file system status: offline
[2015/03/27 18:44:23 2101] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/03/27 18:44:23 2101] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/03/27 18:46:34 2101] PASSED
[2015/03/27 18:46:34 2101] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/03/27 18:46:35 2101] /usr/sbin/expand_md
[2015/03/27 18:46:35 2101] Background job on, degraded on, find new disks, wait...
[2015/03/27 18:50:35 2101] X_level: 6
[2015/03/27 18:50:35 2101] MD degraded 1, bg_job 0, boot 1
[2015/03/27 18:50:35 2101] Read 1957072 byte from configuration
[2015/03/27 18:50:35 2101] Disk configuration matching with online configuration.
[2015/03/27 18:50:35 2101] May need to fix array.
[2015/03/27 18:50:35 2101] new_disk_pt_count: 1
[2015/03/27 18:50:35 2101] * new disk: /dev/sdd
[2015/03/27 18:50:35 2101] ===== Partition Entry (MD not used) =====
[2015/03/27 18:50:35 2101] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 0 0 NO_MD 0
[2015/03/27 18:50:35 2101] partitions: 0 property: UNKNOWN
[2015/03/27 18:50:35 2101] ===== Partition Entry (Used by MD) =====
[2015/03/27 18:50:35 2101] 000 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:50:35 2101] partitions: 3 property: 4K
[2015/03/27 18:50:35 2101] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:50:35 2101] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:50:35 2101] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:50:35 2101] 001 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:50:35 2101] partitions: 3 property: 4K
[2015/03/27 18:50:35 2101] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:50:35 2101] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:50:35 2101] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:50:35 2101] 002 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:50:35 2101] partitions: 3 property: 4K
[2015/03/27 18:50:35 2101] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:50:35 2101] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:50:35 2101] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:50:35 2101] 003 /dev/sde,WD-WCAWZ2059507,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:50:35 2101] partitions: 3 property: 4K
[2015/03/27 18:50:35 2101] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:50:35 2101] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:50:35 2101] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:50:35 2101] 004 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:50:35 2101] partitions: 3 property: 4K
[2015/03/27 18:50:35 2101] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:50:35 2101] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:50:35 2101] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:50:35 2101] in find_drive_... looking at /dev/md2
[2015/03/27 18:50:35 2101] found drive has the needed size for /dev/md2: /dev/sdf, 2930266584, 2930264504
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ1982796
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ1982796 WD-WCAWZ1982796
[2015/03/27 18:50:35 2101] Take /dev/sda WD-WCAWZ1982796 away
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ2042830
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ2042830 WD-WCAWZ2042830
[2015/03/27 18:50:35 2101] Take /dev/sdb WD-WCAWZ2042830 away
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ2059262
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ2059262 WD-WCAWZ2059262
[2015/03/27 18:50:35 2101] Take /dev/sdc WD-WCAWZ2059262 away
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ1978251
[2015/03/27 18:50:35 2101] Drive WD-WCAWZ1978251 missing.
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ2059507
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ2059507 WD-WCAWZ2059507
[2015/03/27 18:50:35 2101] Take /dev/sde WD-WCAWZ2059507 away
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ2042889
[2015/03/27 18:50:35 2101] Drive sn WD-WCAWZ2042889 WD-WCAWZ2042889
[2015/03/27 18:50:35 2101] Take /dev/sdf WD-WCAWZ2042889 away
[2015/03/27 18:50:35 2101] Total missing: 1, index=3
[2015/03/27 18:50:35 2101] found missing drive: /dev/sdd WD-WCAWZ1978251 MD_NULL blocks=2930266584 2930264504 2930264504
[2015/03/27 18:50:35 2101] XRAID cfg_pt = WD-WCAWZ2042889, these two drives size close: 0 /dev/sdd 2930266584, 0 /dev/sda 2930266584
[2015/03/27 18:50:35 2101] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/27 18:50:35 2101] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/27 18:50:35 2101] Repair md: use disk /dev/sdd, size 2930266584
[2015/03/27 18:50:39 2101] LINE 1505: exec command: sgdisk -Z /dev/sdd
Found valid GPT with corrupt MBR; using GPT and will write new
protective MBR on save.
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
[2015/03/27 18:50:42 2101] Update new added disk information: from /dev/sdf to /dev/sdd
[2015/03/27 18:50:42 2101] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 0 0 NO_MD 0
[2015/03/27 18:50:42 2101] partitions: 0 property: UNKNOWN
[2015/03/27 18:50:42 2101] 000 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/03/27 18:50:42 2101] partitions: 3 property: 4K
[2015/03/27 18:50:42 2101] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/03/27 18:50:42 2101] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/03/27 18:50:42 2101] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/03/27 18:50:42 2101] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 2930264504 2930264504 NO_MD 0
[2015/03/27 18:50:42 2101] partitions: 3 property: UNKNOWN
[2015/03/27 18:50:42 2101] 000 /dev/sdd1, 0, 0, 4194304 NO_MD md=
[2015/03/27 18:50:42 2101] 001 /dev/sdd2, 0, 0, 524288 NO_MD md=
[2015/03/27 18:50:42 2101] 002 /dev/sdd3, 0, 0, 2925545912 NO_MD md=
[2015/03/27 18:50:42 2101] Get format of pt /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/03/27 18:50:42 2101] Error unkonwn partition table /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889 !!!!
[2015/03/27 18:50:42 2101] Need to increase ext size from 0 to 0
[2015/03/27 18:50:42 2101] LINE 3717: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.V_E.source_pt1.sav

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/03/27 18:50:43 2101] Input target disk 4K align partition problem: 256, use old partition.
[2015/03/27 18:50:43 2101] LINE 3723: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/03/27 18:50:43 2101] LINE 3730: exec command: sgdisk -g -a 8 /dev/sdd
Creating new GPT entries.
The operation has completed successfully.
[2015/03/27 18:50:45 2101] Succeed to convert mbr to gpt /dev/sda.
[2015/03/27 18:50:45 2101] Input target disk partition problem: 256
[2015/03/27 18:50:45 2101] Failed to add disk to md
[2015/03/27 18:50:45 2101] Added drive to md, grown=0/0xfffbe808
[2015/03/27 18:50:45 2101] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/03/27 18:50:46 2101] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/03/27 18:50:46 2101] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2015/03/27 18:50:46 2101] STAGE_WIPE: Clean my_pid 2101
[2015/03/27 18:50:46 13976] STAGE_CHECK: saved my_pid 13976 in check mode.
[2015/03/27 18:50:46 13976] RAID MODE: 1, sn=
[2015/03/27 18:50:47 13976] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/03/27 18:50:47 13976] Current file system status: ext4
[2015/03/27 18:50:47 13976] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/03/27 18:50:47 13976] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/03/27 18:52:47 13976] PASSED
[2015/03/27 18:52:48 13976] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/03/27 18:52:49 13976] X_level: 6
[2015/03/27 18:52:49 13976] /usr/sbin/expand_md -a super
[2015/03/27 18:52:49 13976] MD degraded 1, bg_job 0, boot 0
[2015/03/27 18:52:49 13976] STAGE_WIPE: Clean my_pid 13976
[2015/04/04 17:35:43 2113] Boot, handle mutiple expand_md
[2015/04/04 17:35:44 2114] STAGE_CHECK: saved my_pid 2114 in check mode.
[2015/04/04 17:35:44 2114] RAID MODE: 1, sn=
[2015/04/04 17:35:44 2114] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/04 17:35:44 2114] Current file system status: offline
[2015/04/04 17:35:44 2114] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/04 17:35:45 2114] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/04/04 17:37:45 2114] PASSED
[2015/04/04 17:37:45 2114] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/04/04 17:37:46 2114] X_level: 6
[2015/04/04 17:37:46 2114] /usr/sbin/expand_md
[2015/04/04 17:37:46 2114] MD degraded 1, bg_job 0, boot 1
[2015/04/04 17:37:46 2114] Read 1957072 byte from configuration
[2015/04/04 17:37:46 2114] Disk configuration matching with online configuration.
[2015/04/04 17:37:46 2114] May need to fix array.
[2015/04/04 17:37:46 2114] new_disk_pt_count: 1
[2015/04/04 17:37:46 2114] * new disk: /dev/sdd
[2015/04/04 17:37:46 2114] ===== Partition Entry (MD not used) =====
[2015/04/04 17:37:46 2114] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 0 0 NO_MD 0
[2015/04/04 17:37:46 2114] partitions: 0 property: UNKNOWN
[2015/04/04 17:37:46 2114] ===== Partition Entry (Used by MD) =====
[2015/04/04 17:37:46 2114] 000 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 17:37:46 2114] partitions: 3 property: 4K
[2015/04/04 17:37:46 2114] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/04/04 17:37:46 2114] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/04/04 17:37:46 2114] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 17:37:46 2114] 001 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 17:37:46 2114] partitions: 3 property: 4K
[2015/04/04 17:37:46 2114] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/04/04 17:37:46 2114] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/04/04 17:37:46 2114] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 17:37:46 2114] 002 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 17:37:46 2114] partitions: 3 property: 4K
[2015/04/04 17:37:46 2114] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/04/04 17:37:46 2114] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/04/04 17:37:46 2114] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 17:37:46 2114] 003 /dev/sde,WD-WCAWZ2059507,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 17:37:46 2114] partitions: 3 property: 4K
[2015/04/04 17:37:46 2114] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/04/04 17:37:46 2114] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/04/04 17:37:46 2114] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 17:37:46 2114] 004 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 17:37:46 2114] partitions: 3 property: 4K
[2015/04/04 17:37:46 2114] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/04/04 17:37:46 2114] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/04/04 17:37:46 2114] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 17:37:46 2114] in find_drive_... looking at /dev/md2
[2015/04/04 17:37:46 2114] found drive has the needed size for /dev/md2: /dev/sdf, 2930266584, 2930264504
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ1982796
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ1982796 WD-WCAWZ1982796
[2015/04/04 17:37:46 2114] Take /dev/sda WD-WCAWZ1982796 away
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ2042830
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ2042830 WD-WCAWZ2042830
[2015/04/04 17:37:46 2114] Take /dev/sdb WD-WCAWZ2042830 away
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ2059262
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ2059262 WD-WCAWZ2059262
[2015/04/04 17:37:46 2114] Take /dev/sdc WD-WCAWZ2059262 away
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ1978251
[2015/04/04 17:37:46 2114] Drive WD-WCAWZ1978251 missing.
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ2059507
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ2059507 WD-WCAWZ2059507
[2015/04/04 17:37:46 2114] Take /dev/sde WD-WCAWZ2059507 away
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ2042889
[2015/04/04 17:37:46 2114] Drive sn WD-WCAWZ2042889 WD-WCAWZ2042889
[2015/04/04 17:37:46 2114] Take /dev/sdf WD-WCAWZ2042889 away
[2015/04/04 17:37:46 2114] Total missing: 1, index=3
[2015/04/04 17:37:46 2114] found missing drive: /dev/sdd WD-WCAWZ1978251 MD_NULL blocks=2930266584 2930264504 2930264504
[2015/04/04 17:37:46 2114] XRAID cfg_pt = WD-WCAWZ2042889, these two drives size close: 0 /dev/sdd 2930266584, 0 /dev/sda 2930266584
[2015/04/04 17:37:46 2114] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/04 17:37:46 2114] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/04 17:37:47 2114] Repair md: use disk /dev/sdd, size 2930266584
[2015/04/04 17:37:50 2114] LINE 1505: exec command: sgdisk -Z /dev/sdd
Found valid GPT with corrupt MBR; using GPT and will write new
protective MBR on save.
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
[2015/04/04 17:37:54 2114] Update new added disk information: from /dev/sdf to /dev/sdd
[2015/04/04 17:37:54 2114] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 0 0 NO_MD 0
[2015/04/04 17:37:54 2114] partitions: 0 property: UNKNOWN
[2015/04/04 17:37:54 2114] 000 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 17:37:54 2114] partitions: 3 property: 4K
[2015/04/04 17:37:54 2114] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/04/04 17:37:54 2114] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/04/04 17:37:54 2114] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 17:37:54 2114] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 2930264504 2930264504 NO_MD 0
[2015/04/04 17:37:54 2114] partitions: 3 property: UNKNOWN
[2015/04/04 17:37:54 2114] 000 /dev/sdd1, 0, 0, 4194304 NO_MD md=
[2015/04/04 17:37:54 2114] 001 /dev/sdd2, 0, 0, 524288 NO_MD md=
[2015/04/04 17:37:54 2114] 002 /dev/sdd3, 0, 0, 2925545912 NO_MD md=
[2015/04/04 17:37:54 2114] Get format of pt /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/04 17:37:54 2114] Error unkonwn partition table /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889 !!!!
[2015/04/04 17:37:54 2114] Need to increase ext size from 0 to 0
[2015/04/04 17:37:54 2114] LINE 3717: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.V_E.source_pt1.sav

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/04/04 17:37:54 2114] Input target disk 4K align partition problem: 256, use old partition.
[2015/04/04 17:37:54 2114] LINE 3723: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/04/04 17:37:54 2114] LINE 3730: exec command: sgdisk -g -a 8 /dev/sdd
Creating new GPT entries.
The operation has completed successfully.
[2015/04/04 17:37:58 2114] Succeed to convert mbr to gpt /dev/sda.
[2015/04/04 17:37:58 2114] Input target disk partition problem: 256
[2015/04/04 17:37:58 2114] Failed to add disk to md
[2015/04/04 17:37:58 2114] Added drive to md, grown=0/0xff803358
[2015/04/04 17:37:58 2114] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/04/04 17:37:58 2114] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/04/04 17:37:58 2114] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2015/04/04 17:37:59 2114] STAGE_WIPE: Clean my_pid 2114
[2015/04/04 17:37:59 5957] STAGE_CHECK: saved my_pid 5957 in check mode.
[2015/04/04 17:37:59 5957] RAID MODE: 1, sn=
[2015/04/04 17:37:59 5957] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/04 17:37:59 5957] Current file system status: ext4
[2015/04/04 17:37:59 5957] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/04 17:37:59 5957] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/04/04 17:40:00 5957] PASSED
[2015/04/04 17:40:00 5957] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/04/04 17:40:00 5957] X_level: 6
[2015/04/04 17:40:00 5957] /usr/sbin/expand_md -a super
[2015/04/04 17:40:00 5957] MD degraded 1, bg_job 0, boot 0
[2015/04/04 17:40:00 5957] STAGE_WIPE: Clean my_pid 5957



Sat Apr 4 19:38:16 NZDT 2015
[2015/04/04 19:38:17 1192] STAGE_CHECK: saved my_pid 1192 in check mode.
[2015/04/04 19:38:17 1192] RAID MODE: 1, sn=
[2015/04/04 19:38:18 1192] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/04 19:38:18 1192] Current file system status: ext4
[2015/04/04 19:38:18 1192] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/04 19:38:18 1192] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/04/04 19:40:18 1192] PASSED
[2015/04/04 19:40:19 1192] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/04/04 19:40:20 1192] X_level: 6
[2015/04/04 19:40:20 1192] /usr/sbin/expand_md
[2015/04/04 19:40:20 1192] MD degraded 1, bg_job 0, boot 0
[2015/04/04 19:40:20 1192] Read 1957072 byte from configuration
[2015/04/04 19:40:20 1192] Disk configuration matching with online configuration.
[2015/04/04 19:40:20 1192] May need to fix array.
[2015/04/04 19:40:20 1192] new_disk_pt_count: 1
[2015/04/04 19:40:20 1192] * new disk: /dev/sdd
[2015/04/04 19:40:20 1192] ===== Partition Entry (MD not used) =====
[2015/04/04 19:40:20 1192] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 4718592 4718592 NO_MD 0
[2015/04/04 19:40:20 1192] partitions: 2 property: 4K
[2015/04/04 19:40:20 1192] 000 /dev/sdd1, 8, 49, 4194304 NO_MD md=
[2015/04/04 19:40:20 1192] 001 /dev/sdd2, 8, 50, 524288 NO_MD md=
[2015/04/04 19:40:20 1192] ===== Partition Entry (Used by MD) =====
[2015/04/04 19:40:20 1192] 000 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 19:40:20 1192] partitions: 3 property: 4K
[2015/04/04 19:40:20 1192] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/04/04 19:40:20 1192] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/04/04 19:40:20 1192] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 19:40:20 1192] 001 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 19:40:20 1192] partitions: 3 property: 4K
[2015/04/04 19:40:20 1192] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/04/04 19:40:20 1192] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/04/04 19:40:20 1192] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 19:40:20 1192] 002 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 19:40:20 1192] partitions: 3 property: 4K
[2015/04/04 19:40:20 1192] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/04/04 19:40:20 1192] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/04/04 19:40:20 1192] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 19:40:20 1192] 003 /dev/sde,WD-WCAWZ2059507,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 19:40:20 1192] partitions: 3 property: 4K
[2015/04/04 19:40:20 1192] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/04/04 19:40:20 1192] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/04/04 19:40:20 1192] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 19:40:20 1192] 004 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 19:40:20 1192] partitions: 3 property: 4K
[2015/04/04 19:40:20 1192] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/04/04 19:40:20 1192] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/04/04 19:40:20 1192] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 19:40:20 1192] in find_drive_... looking at /dev/md2
[2015/04/04 19:40:20 1192] found drive has the needed size for /dev/md2: /dev/sdf, 2930266584, 2930264504
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ1982796
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ1982796 WD-WCAWZ1982796
[2015/04/04 19:40:20 1192] Take /dev/sda WD-WCAWZ1982796 away
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ2042830
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ2042830 WD-WCAWZ2042830
[2015/04/04 19:40:20 1192] Take /dev/sdb WD-WCAWZ2042830 away
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ2059262
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ2059262 WD-WCAWZ2059262
[2015/04/04 19:40:20 1192] Take /dev/sdc WD-WCAWZ2059262 away
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ1978251
[2015/04/04 19:40:20 1192] Drive WD-WCAWZ1978251 missing.
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ2059507
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ2059507 WD-WCAWZ2059507
[2015/04/04 19:40:20 1192] Take /dev/sde WD-WCAWZ2059507 away
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ2042889
[2015/04/04 19:40:20 1192] Drive sn WD-WCAWZ2042889 WD-WCAWZ2042889
[2015/04/04 19:40:20 1192] Take /dev/sdf WD-WCAWZ2042889 away
[2015/04/04 19:40:20 1192] Total missing: 1, index=3
[2015/04/04 19:40:20 1192] found missing drive: /dev/sdd WD-WCAWZ1978251 MD_NULL blocks=2930266584 2930264504 2930264504
[2015/04/04 19:40:20 1192] XRAID cfg_pt = WD-WCAWZ2042889, these two drives size close: 0 /dev/sdd 2930266584, 0 /dev/sda 2930266584
[2015/04/04 19:40:20 1192] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/04 19:40:20 1192] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/04 19:40:20 1192] Repair md: use disk /dev/sdd, size 2930266584
[2015/04/04 19:40:23 1192] LINE 1505: exec command: sgdisk -Z /dev/sdd
Found valid GPT with corrupt MBR; using GPT and will write new
protective MBR on save.
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
[2015/04/04 19:40:26 1192] Update new added disk information: from /dev/sdf to /dev/sdd
[2015/04/04 19:40:26 1192] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 4718592 4718592 NO_MD 0
[2015/04/04 19:40:26 1192] partitions: 2 property: 4K
[2015/04/04 19:40:26 1192] 000 /dev/sdd1, 8, 49, 4194304 NO_MD md=
[2015/04/04 19:40:26 1192] 001 /dev/sdd2, 8, 50, 524288 NO_MD md=
[2015/04/04 19:40:26 1192] 000 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/04 19:40:26 1192] partitions: 3 property: 4K
[2015/04/04 19:40:26 1192] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/04/04 19:40:26 1192] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/04/04 19:40:26 1192] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/04/04 19:40:26 1192] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 2930264504 2930264504 NO_MD 0
[2015/04/04 19:40:26 1192] partitions: 3 property: 4K
[2015/04/04 19:40:26 1192] 000 /dev/sdd1, 8, 49, 4194304 NO_MD md=
[2015/04/04 19:40:26 1192] 001 /dev/sdd2, 8, 50, 524288 NO_MD md=
[2015/04/04 19:40:26 1192] 002 /dev/sdd3, 0, 0, 2925545912 NO_MD md=
[2015/04/04 19:40:26 1192] Get format of pt /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/04 19:40:26 1192] Error unkonwn partition table /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889 !!!!
[2015/04/04 19:40:26 1192] Need to increase ext size from 0 to 0
[2015/04/04 19:40:26 1192] LINE 3717: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.V_E.source_pt1.sav

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/04/04 19:40:26 1192] Input target disk 4K align partition problem: 256, use old partition.
[2015/04/04 19:40:26 1192] LINE 3723: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/04/04 19:40:26 1192] LINE 3730: exec command: sgdisk -g -a 8 /dev/sdd
Creating new GPT entries.
The operation has completed successfully.
[2015/04/04 19:40:29 1192] Succeed to convert mbr to gpt /dev/sda.
[2015/04/04 19:40:29 1192] Input target disk partition problem: 256
[2015/04/04 19:40:29 1192] Failed to add disk to md
[2015/04/04 19:40:29 1192] Added drive to md, grown=0/0xffd0de38
[2015/04/04 19:40:29 1192] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/04/04 19:40:29 1192] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/04/04 19:40:30 1192] STAGE_WIPE: Clean my_pid 1192
[2015/04/04 19:40:30 1688] STAGE_CHECK: saved my_pid 1688 in check mode.
[2015/04/04 19:40:30 1688] RAID MODE: 1, sn=
[2015/04/04 19:40:30 1688] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/04 19:40:30 1688] Current file system status: ext4
[2015/04/04 19:40:30 1688] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/04 19:40:31 1688] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/04/04 19:42:31 1688] PASSED
[2015/04/04 19:42:31 1688] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/04/04 19:42:32 1688] X_level: 6
[2015/04/04 19:42:32 1688] /usr/sbin/expand_md -a super
[2015/04/04 19:42:32 1688] MD degraded 1, bg_job 0, boot 0
[2015/04/04 19:42:32 1688] STAGE_WIPE: Clean my_pid 1688



Wed Apr 8 20:43:52 NZST 2015
[2015/04/08 20:43:53 31048] STAGE_CHECK: saved my_pid 31048 in check mode.
[2015/04/08 20:43:53 31048] RAID MODE: 1, sn=
[2015/04/08 20:43:53 31048] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/08 20:43:54 31048] Current file system status: ext4
[2015/04/08 20:43:54 31048] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/08 20:43:54 31048] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/04/08 20:45:54 31048] PASSED
[2015/04/08 20:45:55 31048] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/04/08 20:45:56 31048] X_level: 6
[2015/04/08 20:45:56 31048] /usr/sbin/expand_md
[2015/04/08 20:45:56 31048] MD degraded 1, bg_job 0, boot 0
[2015/04/08 20:45:56 31048] Read 1957072 byte from configuration
[2015/04/08 20:45:56 31048] configuration not same: 6 : 7
[2015/04/08 20:45:56 31048] Read 1957072 byte from configuration
[2015/04/08 20:45:56 31048] configuration not same: 6 : 7
[2015/04/08 20:45:56 31048] access 2, new_disk 1, fs 4
[2015/04/08 20:45:56 31048] Read 1957072 byte from configuration
[2015/04/08 20:45:56 31048] configuration not same: 6 : 7
[2015/04/08 20:45:56 31048] Disk configuration mis-matching with online configuration, can not update now...
[2015/04/08 20:45:56 31048] May need to fix array.
[2015/04/08 20:45:56 31048] new_disk_pt_count: 1
[2015/04/08 20:45:56 31048] * new disk: /dev/sdd
[2015/04/08 20:45:56 31048] ===== Partition Entry (MD not used) =====
[2015/04/08 20:45:56 31048] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 4718592 4718592 NO_MD 0
[2015/04/08 20:45:56 31048] partitions: 2 property: 4K
[2015/04/08 20:45:56 31048] 000 /dev/sdd1, 8, 49, 4194304 NO_MD md=
[2015/04/08 20:45:56 31048] 001 /dev/sdd2, 8, 50, 524288 NO_MD md=
[2015/04/08 20:45:56 31048] ===== Partition Entry (Used by MD) =====
[2015/04/08 20:45:56 31048] 000 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/08 20:45:56 31048] partitions: 3 property: 4K
[2015/04/08 20:45:56 31048] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/04/08 20:45:56 31048] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/04/08 20:45:56 31048] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/04/08 20:45:56 31048] 001 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/08 20:45:56 31048] partitions: 3 property: 4K
[2015/04/08 20:45:56 31048] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/04/08 20:45:56 31048] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/04/08 20:45:56 31048] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/04/08 20:45:56 31048] 002 /dev/sde,WD-WCAWZ2059507,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/08 20:45:56 31048] partitions: 3 property: 4K
[2015/04/08 20:45:56 31048] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/04/08 20:45:56 31048] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/04/08 20:45:56 31048] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/04/08 20:45:56 31048] 003 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/08 20:45:56 31048] partitions: 3 property: 4K
[2015/04/08 20:45:56 31048] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/04/08 20:45:56 31048] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/04/08 20:45:56 31048] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/04/08 20:45:56 31048] 004 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/08 20:45:56 31048] partitions: 3 property: 4K
[2015/04/08 20:45:56 31048] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/04/08 20:45:56 31048] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/04/08 20:45:56 31048] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/04/08 20:45:56 31048] in find_drive_... looking at /dev/md2
[2015/04/08 20:45:56 31048] found drive has the needed size for /dev/md2: /dev/sda, 2930266584, 2930264504
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ1982796
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ1982796 WD-WCAWZ1982796
[2015/04/08 20:45:56 31048] Take /dev/sda WD-WCAWZ1982796 away
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ2042830
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ2042830 WD-WCAWZ2042830
[2015/04/08 20:45:56 31048] Take /dev/sdb WD-WCAWZ2042830 away
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ2059262
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ2059262 WD-WCAWZ2059262
[2015/04/08 20:45:56 31048] Take /dev/sdc WD-WCAWZ2059262 away
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ1978251
[2015/04/08 20:45:56 31048] Drive WD-WCAWZ1978251 missing.
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ2059507
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ2059507 WD-WCAWZ2059507
[2015/04/08 20:45:56 31048] Take /dev/sde WD-WCAWZ2059507 away
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ2042889
[2015/04/08 20:45:56 31048] Drive sn WD-WCAWZ2042889 WD-WCAWZ2042889
[2015/04/08 20:45:56 31048] Take /dev/sdf WD-WCAWZ2042889 away
[2015/04/08 20:45:56 31048] Total missing: 1, index=3
[2015/04/08 20:45:56 31048] found missing drive: /dev/sdd WD-WCAWZ1978251 MD_NULL blocks=2930266584 2930264504 2930264504
[2015/04/08 20:45:56 31048] XRAID cfg_pt = WD-WCAWZ2042889, these two drives size close: 0 /dev/sdd 2930266584, 1 /dev/sdb 2930266584
[2015/04/08 20:45:56 31048] Changed drive selction: s=4/1, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/08 20:45:56 31048] Changed drive selction: s=4/1, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/08 20:45:57 31048] Repair md: use disk /dev/sdd, size 2930266584
[2015/04/08 20:46:00 31048] LINE 1505: exec command: sgdisk -Z /dev/sdd
Found valid GPT with corrupt MBR; using GPT and will write new
protective MBR on save.
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
[2015/04/08 20:46:11 31048] Update new added disk information: from /dev/sdf to /dev/sdd
[2015/04/08 20:46:11 31048] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 4718592 4718592 NO_MD 0
[2015/04/08 20:46:11 31048] partitions: 2 property: 4K
[2015/04/08 20:46:11 31048] 000 /dev/sdd1, 8, 49, 4194304 NO_MD md=
[2015/04/08 20:46:11 31048] 001 /dev/sdd2, 8, 50, 524288 NO_MD md=
[2015/04/08 20:46:11 31048] 000 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/08 20:46:11 31048] partitions: 3 property: 4K
[2015/04/08 20:46:11 31048] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/04/08 20:46:11 31048] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/04/08 20:46:11 31048] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/04/08 20:46:11 31048] 000 /dev/sdd,WD-WCC4E1ESZ1LX,8, 48, 2930266584 2930264504 2930264504 NO_MD 0
[2015/04/08 20:46:11 31048] partitions: 3 property: 4K
[2015/04/08 20:46:11 31048] 000 /dev/sdd1, 8, 49, 4194304 NO_MD md=
[2015/04/08 20:46:11 31048] 001 /dev/sdd2, 8, 50, 524288 NO_MD md=
[2015/04/08 20:46:11 31048] 002 /dev/sdd3, 0, 0, 2925545912 NO_MD md=
[2015/04/08 20:46:11 31048] Get format of pt /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/08 20:46:11 31048] Error unkonwn partition table /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889 !!!!
[2015/04/08 20:46:11 31048] Need to increase ext size from 0 to 0
[2015/04/08 20:46:11 31048] LINE 3717: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.V_E.source_pt1.sav

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/04/08 20:46:15 31048] Input target disk 4K align partition problem: 256, use old partition.
[2015/04/08 20:46:15 31048] LINE 3723: exec command: sfdisk --force -L /dev/sdd < /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdd: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/04/08 20:46:20 31048] LINE 3730: exec command: sgdisk -g -a 8 /dev/sdd
Creating new GPT entries.
The operation has completed successfully.
[2015/04/08 20:46:30 31048] Succeed to convert mbr to gpt /dev/sdb.
[2015/04/08 20:46:30 31048] Input target disk partition problem: 256
[2015/04/08 20:46:30 31048] Failed to add disk to md
[2015/04/08 20:46:30 31048] Added drive to md, grown=0/0xffc6e768
[2015/04/08 20:46:30 31048] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/04/08 20:46:36 31048] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/04/08 20:46:46 31048] STAGE_WIPE: Clean my_pid 31048
[2015/04/08 20:47:32 31651] STAGE_CHECK: saved my_pid 31651 in check mode.
[2015/04/08 20:47:32 31651] RAID MODE: 1, sn=
[2015/04/08 20:47:32 31651] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/08 20:47:33 31651] Current file system status: ext4
[2015/04/08 20:47:33 31651] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/08 20:47:33 31651] Running disk SMART quick self-test on new disk 4 [/dev/sdd]...
[2015/04/08 20:49:34 31651] PASSED
[2015/04/08 20:49:34 31651] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/04/08 20:49:35 31651] X_level: 6
[2015/04/08 20:49:35 31651] /usr/sbin/expand_md -a super
[2015/04/08 20:49:35 31651] MD degraded 1, bg_job 0, boot 0
[2015/04/08 20:49:35 31651] STAGE_WIPE: Clean my_pid 31651
Message 3 of 13
de_niro
Guide

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

thanks for the logs,please contact NETGEAR support engineer to check paritions of each disk,it looks the issue is come from inconsistant partition tables of the disks,need the engineer to investigate further.
Message 4 of 13
mdgm-ntgr
NETGEAR Employee Retired

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

The full logs zip file would be helpful. See the Sending Logs link in my sig.
Message 5 of 13
Quinny1
Aspirant

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

Sent, thank you so much for looking at this for me. Hugely appreciated.
Message 6 of 13
mdgm-ntgr
NETGEAR Employee Retired

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

The partitions look fine except for the new disk, I think.

Have you tested the new disk using the extended test in the WD Data Lifeguard Diagnostic tool?
Message 7 of 13
Quinny1
Aspirant

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

Took drive out today and tested on another pc in a caddy with WD Lifeguard Diagnostic - passed
Rebooted NAS and updated firmware - just in case makes a difference.
Re-added drive with NAS up
Same result ie when mouseover in volume, volume nothing is happening.
Will leave again but just like every other time does not like rebuild is happening.

Sat Apr 11 13:43:17 NZST 2015	Data volume will be rebuilt with disk 4.
Sat Apr 11 13:41:07 NZST 2015 New disk detected. If multiple disks have been added, they will be processed one at a time. Please do not remove any added disk(s) during this time. [Disk 4]
Sat Apr 11 13:14:33 NZST 2015 System is up.
Sat Apr 11 13:14:21 NZST 2015 System Update Status (QuinnyNAS) : Your ReadyNAS device has been updated with a new firmware image. (RAIDiator-x86 4.2.27)
Sat Apr 11 13:11:47 NZST 2015 Rebooting device...
Sat Apr 11 13:11:46 NZST 2015 Please close this browser session and use RAIDar to reconnect to the device. System rebooting...
Sat Apr 11 12:55:04 NZST 2015 A disk was removed from the ReadyNAS. For full protection of your data volume, please add a replacement disk as soon as possible.
Sat Apr 11 12:55:04 NZST 2015 Disk removal detected. [Disk 4]


Do I go buy another drive and try that? Looking at the expansion log for what it tried today in the above times seems the same errors/issues.

[2015/04/11 13:14:12  2078] Boot, handle mutiple expand_md
[2015/04/11 13:14:13 2079] STAGE_CHECK: saved my_pid 2079 in check mode.
[2015/04/11 13:14:13 2079] RAID MODE: 1, sn=
[2015/04/11 13:14:13 2079] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/11 13:14:14 2079] Current file system status: ext4
[2015/04/11 13:14:14 2079] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/11 13:14:15 2079] X_level: 6
[2015/04/11 13:14:15 2079] /usr/sbin/expand_md
[2015/04/11 13:14:15 2079] MD degraded 1, bg_job 0, boot 1
[2015/04/11 13:14:15 2079] Read 1957072 byte from configuration
[2015/04/11 13:14:15 2079] Disk configuration matching with online configuration.
[2015/04/11 13:14:15 2079] May need to fix array.
[2015/04/11 13:14:15 2079] ===== Partition Entry (Used by MD) =====
[2015/04/11 13:14:15 2079] 000 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:14:15 2079] partitions: 3 property: 4K
[2015/04/11 13:14:15 2079] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:14:15 2079] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:14:15 2079] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:14:15 2079] 001 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:14:15 2079] partitions: 3 property: 4K
[2015/04/11 13:14:15 2079] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:14:15 2079] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:14:15 2079] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:14:15 2079] 002 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:14:15 2079] partitions: 3 property: 4K
[2015/04/11 13:14:15 2079] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:14:15 2079] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:14:15 2079] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:14:15 2079] 003 /dev/sdd,WD-WCAWZ2059507,8, 48, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:14:15 2079] partitions: 3 property: 4K
[2015/04/11 13:14:15 2079] 000 /dev/sdd1, 8, 49, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:14:15 2079] 001 /dev/sdd2, 8, 50, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:14:15 2079] 002 /dev/sdd3, 8, 51, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:14:15 2079] 004 /dev/sde,WD-WCAWZ2042889,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:14:15 2079] partitions: 3 property: 4K
[2015/04/11 13:14:15 2079] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:14:15 2079] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:14:15 2079] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:14:15 2079] disk and pt index: /dev/sda 0 1 size=524288 cfg=MD_FULL
[2015/04/11 13:14:15 2079] disk and pt index: 0 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sda1
[2015/04/11 13:14:15 2079] disk and pt index: 0 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sda2
[2015/04/11 13:14:15 2079] disk and pt index: 0 2 size=2925545912 s_name1 = MD_FULL, s_name = /dev/sda3
[2015/04/11 13:14:15 2079] disk and pt index: 1 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sdb1
[2015/04/11 13:14:15 2079] disk and pt index: 1 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sdb2
[2015/04/11 13:14:15 2079] disk and pt index: 1 2 size=2925545912 s_name1 = MD_FULL, s_name = /dev/sdb3
[2015/04/11 13:14:15 2079] disk and pt index: 2 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sdc1
[2015/04/11 13:14:15 2079] disk and pt index: 2 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sdc2
[2015/04/11 13:14:15 2079] disk and pt index: 2 2 size=2925545912 s_name1 = MD_FULL, s_name = /dev/sdc3
[2015/04/11 13:14:15 2079] disk and pt index: 3 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sdd1
[2015/04/11 13:14:15 2079] disk and pt index: 3 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sdd2
[2015/04/11 13:14:15 2079] disk and pt index: 3 2 size=2925545912 s_name1 = MD_FULL, s_name = /dev/sdd3
[2015/04/11 13:14:15 2079] disk and pt index: 4 0 size=4194304 s_name1 = MD_FULL, s_name = /dev/sde1
[2015/04/11 13:14:15 2079] disk and pt index: 4 1 size=524288 s_name1 = MD_FULL, s_name = /dev/sde2
[2015/04/11 13:14:15 2079] disk and pt index: 4 2 size=2925545912 s_name1 = MD_FULL, s_name = /dev/sde3
[2015/04/11 13:14:15 2079] Degraded array, some disk has missing partitions.
[2015/04/11 13:14:15 2079] Read 1957072 byte from configuration
[2015/04/11 13:14:15 2079] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/04/11 13:14:15 2295] Boot, handle mutiple expand_md
[2015/04/11 13:14:18 2079] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/04/11 13:14:19 2079] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2015/04/11 13:14:20 2079] STAGE_WIPE: Clean my_pid 2079
[2015/04/11 13:15:17 2319] STAGE_CHECK: saved my_pid 2319 in check mode.
[2015/04/11 13:15:17 2319] RAID MODE: 1, sn=
[2015/04/11 13:15:17 2319] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/11 13:15:17 2319] Current file system status: ext4
[2015/04/11 13:15:17 2319] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/11 13:15:18 2319] X_level: 6
[2015/04/11 13:15:18 2319] /usr/sbin/expand_md -a super
[2015/04/11 13:15:18 2319] MD degraded 1, bg_job 0, boot 1
[2015/04/11 13:15:18 2319] LINE 4939: exec command: ps -ef | grep expand_md | grep -v grep > /var/log/frontview/.V_E.snapshotstat
[2015/04/11 13:15:18 2319] STAGE_WIPE: Clean my_pid 2319



Sat Apr 11 13:41:13 NZST 2015
[2015/04/11 13:41:14 5812] STAGE_CHECK: saved my_pid 5812 in check mode.
[2015/04/11 13:41:14 5812] RAID MODE: 1, sn=
[2015/04/11 13:41:14 5812] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/11 13:41:14 5812] Current file system status: ext4
[2015/04/11 13:41:14 5812] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/11 13:41:14 5812] Running disk SMART quick self-test on new disk 4 [/dev/sdf]...
[2015/04/11 13:43:15 5812] PASSED
[2015/04/11 13:43:15 5812] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/04/11 13:43:16 5812] X_level: 6
[2015/04/11 13:43:16 5812] /usr/sbin/expand_md
[2015/04/11 13:43:16 5812] MD degraded 1, bg_job 0, boot 0
[2015/04/11 13:43:16 5812] Read 1957072 byte from configuration
[2015/04/11 13:43:16 5812] Disk configuration matching with online configuration.
[2015/04/11 13:43:16 5812] May need to fix array.
[2015/04/11 13:43:16 5812] new_disk_pt_count: 1
[2015/04/11 13:43:16 5812] * new disk: /dev/sdf
[2015/04/11 13:43:16 5812] ===== Partition Entry (MD not used) =====
[2015/04/11 13:43:16 5812] 000 /dev/sdf,WD-WCC4E1ESZ1LX,8, 80, 2930266584 4718592 4718592 NO_MD 0
[2015/04/11 13:43:16 5812] partitions: 2 property: 4K
[2015/04/11 13:43:16 5812] 000 /dev/sdf1, 8, 81, 4194304 NO_MD md=
[2015/04/11 13:43:16 5812] 001 /dev/sdf2, 8, 82, 524288 NO_MD md=
[2015/04/11 13:43:16 5812] ===== Partition Entry (Used by MD) =====
[2015/04/11 13:43:16 5812] 000 /dev/sda,WD-WCAWZ1982796,8, 0, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:43:16 5812] partitions: 3 property: 4K
[2015/04/11 13:43:16 5812] 000 /dev/sda1, 8, 1, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:43:16 5812] 001 /dev/sda2, 8, 2, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:43:16 5812] 002 /dev/sda3, 8, 3, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:43:16 5812] 001 /dev/sdb,WD-WCAWZ2042830,8, 16, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:43:16 5812] partitions: 3 property: 4K
[2015/04/11 13:43:16 5812] 000 /dev/sdb1, 8, 17, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:43:16 5812] 001 /dev/sdb2, 8, 18, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:43:16 5812] 002 /dev/sdb3, 8, 19, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:43:16 5812] 002 /dev/sdc,WD-WCAWZ2059262,8, 32, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:43:16 5812] partitions: 3 property: 4K
[2015/04/11 13:43:16 5812] 000 /dev/sdc1, 8, 33, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:43:16 5812] 001 /dev/sdc2, 8, 34, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:43:16 5812] 002 /dev/sdc3, 8, 35, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:43:16 5812] 003 /dev/sdd,WD-WCAWZ2059507,8, 48, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:43:16 5812] partitions: 3 property: 4K
[2015/04/11 13:43:16 5812] 000 /dev/sdd1, 8, 49, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:43:16 5812] 001 /dev/sdd2, 8, 50, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:43:16 5812] 002 /dev/sdd3, 8, 51, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:43:16 5812] 004 /dev/sde,WD-WCAWZ2042889,8, 64, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:43:16 5812] partitions: 3 property: 4K
[2015/04/11 13:43:16 5812] 000 /dev/sde1, 8, 65, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:43:16 5812] 001 /dev/sde2, 8, 66, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:43:16 5812] 002 /dev/sde3, 8, 67, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:43:16 5812] in find_drive_... looking at /dev/md2
[2015/04/11 13:43:16 5812] found drive has the needed size for /dev/md2: /dev/sde, 2930266584, 2930264504
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ1982796
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ1982796 WD-WCAWZ1982796
[2015/04/11 13:43:16 5812] Take /dev/sda WD-WCAWZ1982796 away
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ2042830
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ2042830 WD-WCAWZ2042830
[2015/04/11 13:43:16 5812] Take /dev/sdb WD-WCAWZ2042830 away
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ2059262
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ2059262 WD-WCAWZ2059262
[2015/04/11 13:43:16 5812] Take /dev/sdc WD-WCAWZ2059262 away
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ1978251
[2015/04/11 13:43:16 5812] Drive WD-WCAWZ1978251 missing.
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ2059507
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ2059507 WD-WCAWZ2059507
[2015/04/11 13:43:16 5812] Take /dev/sdd WD-WCAWZ2059507 away
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ2042889
[2015/04/11 13:43:16 5812] Drive sn WD-WCAWZ2042889 WD-WCAWZ2042889
[2015/04/11 13:43:16 5812] Take /dev/sde WD-WCAWZ2042889 away
[2015/04/11 13:43:16 5812] Total missing: 1, index=3
[2015/04/11 13:43:16 5812] found missing drive: /dev/sdd WD-WCAWZ1978251 MD_NULL blocks=2930266584 2930264504 2930264504
[2015/04/11 13:43:16 5812] XRAID cfg_pt = WD-WCAWZ2042889, these two drives size close: 0 /dev/sdf 2930266584, 0 /dev/sda 2930266584
[2015/04/11 13:43:16 5812] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/11 13:43:16 5812] Changed drive selction: s=4/0, t=0/0, file=/var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/11 13:43:17 5812] Repair md: use disk /dev/sdf, size 2930266584
[2015/04/11 13:43:20 5812] LINE 1505: exec command: sgdisk -Z /dev/sdf
Found valid GPT with corrupt MBR; using GPT and will write new
protective MBR on save.
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
[2015/04/11 13:43:23 5812] Update new added disk information: from /dev/sdf to /dev/sdf
[2015/04/11 13:43:23 5812] 000 /dev/sdf,WD-WCC4E1ESZ1LX,8, 80, 2930266584 4718592 4718592 NO_MD 0
[2015/04/11 13:43:23 5812] partitions: 2 property: 4K
[2015/04/11 13:43:23 5812] 000 /dev/sdf1, 8, 81, 4194304 NO_MD md=
[2015/04/11 13:43:23 5812] 001 /dev/sdf2, 8, 82, 524288 NO_MD md=
[2015/04/11 13:43:23 5812] 000 /dev/sdf,WD-WCAWZ2042889,8, 80, 2930266584 2930264504 2930264504 MD_FULL 0
[2015/04/11 13:43:23 5812] partitions: 3 property: 4K
[2015/04/11 13:43:23 5812] 000 /dev/sdf1, 8, 81, 4194304 MD_FULL md=/dev/md0
[2015/04/11 13:43:23 5812] 001 /dev/sdf2, 8, 82, 524288 MD_FULL md=/dev/md1
[2015/04/11 13:43:23 5812] 002 /dev/sdf3, 8, 83, 2925545912 MD_FULL md=/dev/md2
[2015/04/11 13:43:23 5812] 000 /dev/sdf,WD-WCC4E1ESZ1LX,8, 80, 2930266584 2930264504 2930264504 NO_MD 0
[2015/04/11 13:43:23 5812] partitions: 3 property: 4K
[2015/04/11 13:43:23 5812] 000 /dev/sdf1, 8, 81, 4194304 NO_MD md=
[2015/04/11 13:43:23 5812] 001 /dev/sdf2, 8, 82, 524288 NO_MD md=
[2015/04/11 13:43:23 5812] 002 /dev/sdf3, 0, 0, 2925545912 NO_MD md=
[2015/04/11 13:43:23 5812] Get format of pt /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889
[2015/04/11 13:43:23 5812] Error unkonwn partition table /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889 !!!!
[2015/04/11 13:43:23 5812] Need to increase ext size from 0 to 0
[2015/04/11 13:43:23 5812] LINE 3717: exec command: sfdisk --force -L /dev/sdf < /var/log/frontview/.V_E.source_pt1.sav

Disk /dev/sdf: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdf: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/04/11 13:43:23 5812] Input target disk 4K align partition problem: 256, use old partition.
[2015/04/11 13:43:23 5812] LINE 3723: exec command: sfdisk --force -L /dev/sdf < /var/log/frontview/.known_cfgdir/WD-WCAWZ2042889

Disk /dev/sdf: 364801 cylinders, 255 heads, 63 sectors/track

sfdisk: ERROR: sector 0 does not have an msdos signature
/dev/sdf: unrecognized partition table type
Old situation:
No partitions found
New situation:
No partitions found

sfdisk: no partition table present.
[2015/04/11 13:43:23 5812] LINE 3730: exec command: sgdisk -g -a 8 /dev/sdf
Creating new GPT entries.
The operation has completed successfully.
[2015/04/11 13:43:27 5812] Succeed to convert mbr to gpt /dev/sda.
[2015/04/11 13:43:27 5812] Input target disk partition problem: 256
[2015/04/11 13:43:27 5812] Failed to add disk to md
[2015/04/11 13:43:27 5812] Added drive to md, grown=0/0xff963d78
[2015/04/11 13:43:27 5812] LINE 4852: exec command: /usr/sbin/expand_md -a super >> /var/log/frontview/expand_md.log 2>&1 &
[2015/04/11 13:43:27 5812] LINE 4855: exec command: /frontview/bin/volumescan &

[2015/04/11 13:43:27 5812] STAGE_WIPE: Clean my_pid 5812
[2015/04/11 13:43:28 8403] STAGE_CHECK: saved my_pid 8403 in check mode.
[2015/04/11 13:43:28 8403] RAID MODE: 1, sn=
[2015/04/11 13:43:28 8403] LINE 4591: exec command: lvs > /var/log/frontview/.V_E.snapshotstat
[2015/04/11 13:43:28 8403] Current file system status: ext4
[2015/04/11 13:43:28 8403] LINE 5305: exec command: rm -fr /var/log/frontview/.V_E.*
[2015/04/11 13:43:28 8403] Running disk SMART quick self-test on new disk 4 [/dev/sdf]...
[2015/04/11 13:45:29 8403] PASSED
[2015/04/11 13:45:29 8403] LINE 1144: exec command: killall -HUP monitor_enclosure
[2015/04/11 13:45:29 8403] X_level: 6
[2015/04/11 13:45:29 8403] /usr/sbin/expand_md -a super
[2015/04/11 13:45:29 8403] MD degraded 1, bg_job 0, boot 0
[2015/04/11 13:45:29 8403] STAGE_WIPE: Clean my_pid 8403
Message 8 of 13
mdgm-ntgr
NETGEAR Employee Retired

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

Perhaps you should contact support as de niro suggested.

Have you tried a different disk?
Message 9 of 13
Quinny1
Aspirant

Re: ReadyNAs Ultra 6 - Dead drive, Replaced but wont Rebuild

Sadly support were not interested (out of warranty) and would not even look at this thread 😞
Will wait on new drive but really looking like buy a new box, move 16tb of data, reformat. Cant say at this time I am a happy Netgear customer.
Message 10 of 13
Quinny1
Aspirant

Re: Ultra 6 - Dead drive, Replaced but won't Rebuild #249990

Just for anyone else that gets stuck a very skilled sys admin friend (tired of my moaning I think :D) remoted into the box from where he lives in another city (I opened port in router my end and gave admin access - I have known him ages so I was ok with this. He had actually remoted to my pc a few weeks ago to try from there with no luck).

Anyway some twiddling later he has it fixed.

    cg OOoo
    cg Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track
    cg Units = cylinders of 8225280 bytes, blocks of 1024 bytes, counting from 0
    cg Device Boot Start End #cyls #blocks Id System
    cg /dev/sdd1 0+ - 0- 2147483647+ ee EFI GPT
    cg /dev/sdd2 0 - 0 0 0 Empty
    cg /dev/sdd3 0 - 0 0 0 Empty
    cg /dev/sdd4 0 - 0 0 0 Empty
    cg we finally have a partition table on your new disk
    cg QuinnyNAS:~# sgdisk -R /dev/sdd /dev/sdf
    cg sdf is one of your existing drives, i just cloned that over


time goes by then

    cg guess what
    cg QuinnyNAS:~# cat /proc/mdstat
    cg Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
    cg md2 : active raid6 sdd3[6] sda3[0] sdf3[5] sde3[4] sdc3[2] sdb3[1]
    cg 11702178816 blocks super 1.2 level 6, 64k chunk, algorithm 2 [6/5] [UUU_UU]
    cg [>....................] recovery = 0.0% (174720/2925544704) finish=8649.8min speed=5636K/sec
    cg resyncing
    cg i'll email you an extract of what I did so you can update the thread. it might help someone in future


Special thanks to MDGM for keeping on trying to help via PM. I did buy the second disk and had the same fail after trying with that and was waiting to hear back from MDGM when his timezone caught up with mine when out of the blue my friend offered to help. It was looking rather bleek so I am really happy it is now fixing. I will post up his notes for others when I get them.
Message 11 of 13
Quinny1
Aspirant

Re: Ultra 6 - Dead drive, Replaced but won't Rebuild #249990

Email with details of what my friend Cg did

Bit of a spam below, but these are the steps i took to fix it. MIght help someone on the forums.

Parts with ### are my comments to explain what I did, the rest are console copy/pastes


Enjoy 😉
cg



### GPT Partition table missing for new disk /dev/sdd;


Disk /dev/sdd: 4294967295 sectors, 2047G
Logical sector size: 512
Disk identifier (GUID): 470beb69-b974-4199-a9e0-0027bdd134a7
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 5860533134


Number  Start (sector)   End (sector)  Size    Code  Name
QuinnyNAS:~#


### Clone the partition table from another OK drive, ie. /dev/sdf;
### sgdisk -R /dev/TARGET /dev/SOURCE;
### sgdisk -G /dev/sdd   to re GUID it




QuinnyNAS:~# sgdisk -R /dev/sdd /dev/sdf
The operation has completed successfully.
QuinnyNAS:~# sgdisk -p /dev/sdd
Disk /dev/sdd: 5860533168 sectors, 2.7 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 3CCDEB15-2940-4482-9BD1-B84603AA8910
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 5860533134
Partitions will be aligned on 64-sector boundaries
Total free space is 4092 sectors (2.0 MiB)
QuinnyNAS:~# sgdisk -G /dev/sdd
The operation has completed successfully.

QuinnyNAS:~# sgdisk -p /dev/sdd
Disk /dev/sdd: 5860533168 sectors, 2.7 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): E3936097-C73B-400B-A176-4C00C24D0927
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 5860533134
Partitions will be aligned on 64-sector boundaries
Total free space is 4092 sectors (2.0 MiB)


Number  Start (sector)   End (sector)  Size    Code  Name

  1        64     8388671  4.0 GiB   FD00
  2     8388672     9437247  512.0 MiB  FD00
  3     9437248    5860529072  2.7 TiB   FD00


### Confirm clone is matching other drive;


QuinnyNAS:~# sgdisk -p /dev/sdf
Disk /dev/sdf: 5860533168 sectors, 2.7 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 3CCDEB15-2940-4482-9BD1-B84603AA8910
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 5860533134
Partitions will be aligned on 64-sector boundaries
Total free space is 4092 sectors (2.0 MiB)


Number  Start (sector)   End (sector)  Size    Code  Name
  1        64     8388671  4.0 GiB   FD00
  2     8388672     9437247  512.0 MiB  FD00
  3     9437248    5860529072  2.7 TiB   FD00


### Looks good - verify block devices are present now (sdd1,sdd2 previously missing);


QuinnyNAS:~# ls -l /dev/sdd*
brw-rw---- 1 root disk 8, 48 2015-04-17 20:21 /dev/sdd
brw-rw---- 1 root disk 8, 49 2015-04-17 20:21 /dev/sdd1
brw-rw---- 1 root disk 8, 58 2015-04-15 20:05 /dev/sdd10
brw-rw---- 1 root disk 8, 59 2015-04-15 20:05 /dev/sdd11
brw-rw---- 1 root disk 8, 60 2015-04-15 20:05 /dev/sdd12
brw-rw---- 1 root disk 8, 61 2015-04-15 20:05 /dev/sdd13
brw-rw---- 1 root disk 8, 62 2015-04-15 20:05 /dev/sdd14
brw-rw---- 1 root disk 8, 63 2015-04-15 20:05 /dev/sdd15
brw-rw---- 1 root disk 8, 50 2015-04-17 20:21 /dev/sdd2
brw-rw---- 1 root disk 8, 51 2015-04-15 20:05 /dev/sdd3
brw-rw---- 1 root disk 8, 52 2015-04-15 20:05 /dev/sdd4
brw-rw---- 1 root disk 8, 53 2015-04-15 20:05 /dev/sdd5
brw-rw---- 1 root disk 8, 54 2015-04-15 20:05 /dev/sdd6
brw-rw---- 1 root disk 8, 55 2015-04-15 20:05 /dev/sdd7
brw-rw---- 1 root disk 8, 56 2015-04-15 20:05 /dev/sdd8
brw-rw---- 1 root disk 8, 57 2015-04-15 20:05 /dev/sdd9


### Check mdadm metadevices - /dev/md1 and /dev/md2 were missing a drive;


QuinnyNAS:~# mdadm -D /dev/md1
/dev/md1:
    Version : 1.2
 Creation Time : Wed May 23 08:19:46 2012
   Raid Level : raid6
   Array Size : 2096896 (2048.09 MiB 2147.22 MB)
 Used Dev Size : 524224 (512.02 MiB 536.81 MB)
  Raid Devices : 6
 Total Devices : 5
  Persistence : Superblock is persistent


  Update Time : Fri Apr 17 20:06:54 2015
     State : clean, degraded
 Active Devices : 5
Working Devices : 5
 Failed Devices : 0
 Spare Devices : 0


     Layout : left-symmetric
   Chunk Size : 64K


      Name : 001F33EAD668:1
      UUID : 9ead4bd0:3fb129ca:61b328c4:17239b42
     Events : 6607


  Number  Major  Minor  RaidDevice State
    0    8     2     0    active sync  /dev/sda2
    1    8    18     1    active sync  /dev/sdb2
    2    8    34     2    active sync  /dev/sdc2
    3    0     0     3    removed
    4    8    66     4    active sync  /dev/sde2
    5    8    82     5    active sync  /dev/sdf2


### Add in new /dev/sdd2 into /dev/md1;


QuinnyNAS:~# mdadm --manage /dev/md1 --add /dev/sdd2
mdadm: added /dev/sdd2


### Check resync process;


QuinnyNAS:~# cat /proc/mdstat
Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md2 : active raid6 sda3[0] sdf3[5] sde3[4] sdc3[2] sdb3[1]
   11702178816 blocks super 1.2 level 6, 64k chunk, algorithm 2 [6/5] [UUU_UU]


md1 : active raid6 sdd2[6] sda2[0] sdf2[5] sde2[4] sdc2[2] sdb2[1]
   2096896 blocks super 1.2 level 6, 64k chunk, algorithm 2 [6/5] [UUU_UU]
   [====>................]  recovery = 21.0% (110592/524224) finish=0.1min speed=36864K/sec


md0 : active raid1 sda1[0] sdf1[5] sde1[4] sdc1[2] sdb1[1]
   4193268 blocks super 1.2 [5/5] [UUUUU]


unused devices: <none>


### Once mdstat is 100% above, check sync and State = Clean;


QuinnyNAS:~# mdadm -D /dev/md1
/dev/md1:
    Version : 1.2
 Creation Time : Wed May 23 08:19:46 2012
   Raid Level : raid6
   Array Size : 2096896 (2048.09 MiB 2147.22 MB)
 Used Dev Size : 524224 (512.02 MiB 536.81 MB)
  Raid Devices : 6
 Total Devices : 6
  Persistence : Superblock is persistent


  Update Time : Fri Apr 17 20:22:05 2015
     State : clean
 Active Devices : 6
Working Devices : 6
 Failed Devices : 0
 Spare Devices : 0


     Layout : left-symmetric
   Chunk Size : 64K


      Name : 001F33EAD668:1
      UUID : 9ead4bd0:3fb129ca:61b328c4:17239b42
     Events : 6628


  Number  Major  Minor  RaidDevice State
    0    8     2     0    active sync  /dev/sda2
    1    8    18     1    active sync  /dev/sdb2
    2    8    34     2    active sync  /dev/sdc2
    6    8    50     3    active sync  /dev/sdd2
    4    8    66     4    active sync  /dev/sde2
    5    8    82     5    active sync  /dev/sdf2


### Check /dev/md2, missing drive too;


QuinnyNAS:~# mdadm -D /dev/md2
/dev/md2:
    Version : 1.2
 Creation Time : Wed May 23 08:19:46 2012
   Raid Level : raid6
   Array Size : 11702178816 (11160.07 GiB 11983.03 GB)
 Used Dev Size : 2925544704 (2790.02 GiB 2995.76 GB)
  Raid Devices : 6
 Total Devices : 5
  Persistence : Superblock is persistent


  Update Time : Fri Apr 17 20:22:53 2015
     State : clean, degraded
 Active Devices : 5
Working Devices : 5
 Failed Devices : 0
 Spare Devices : 0


     Layout : left-symmetric
   Chunk Size : 64K


      Name : 001F33EAD668:2
      UUID : a51aa3c9:16e9bdd2:d928eae3:5d025c06
     Events : 317712


  Number  Major  Minor  RaidDevice State
    0    8     3     0    active sync  /dev/sda3
    1    8    19     1    active sync  /dev/sdb3
    2    8    35     2    active sync  /dev/sdc3
    3    0     0     3    removed
    4    8    67     4    active sync  /dev/sde3
    5    8    83     5    active sync  /dev/sdf3


### Add /dev/sdd3 to /dev/md2;


QuinnyNAS:~# mdadm --manage /dev/md2 --add /dev/sdd3
mdadm: added /dev/sdd3


### Again, check mdstat;


QuinnyNAS:~# cat /proc/mdstat
Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md2 : active raid6 sdd3[6] sda3[0] sdf3[5] sde3[4] sdc3[2] sdb3[1]
   11702178816 blocks super 1.2 level 6, 64k chunk, algorithm 2 [6/5] [UUU_UU]
   [>....................]  recovery =  0.0% (105728/2925544704) finish=8760.6min speed=5564K/sec


### Yay syncing!;


QuinnyNAS:~# mdadm -D /dev/md2
/dev/md2:
    Version : 1.2
 Creation Time : Wed May 23 08:19:46 2012
   Raid Level : raid6
   Array Size : 11702178816 (11160.07 GiB 11983.03 GB)
 Used Dev Size : 2925544704 (2790.02 GiB 2995.76 GB)
  Raid Devices : 6
 Total Devices : 6
  Persistence : Superblock is persistent


  Update Time : Fri Apr 17 20:31:24 2015
     State : clean, degraded, recovering
 Active Devices : 5
Working Devices : 6
 Failed Devices : 0
 Spare Devices : 1


     Layout : left-symmetric
   Chunk Size : 64K


 Rebuild Status : 0% complete


      Name : 001F33EAD668:2
      UUID : a51aa3c9:16e9bdd2:d928eae3:5d025c06
     Events : 317800


  Number  Major  Minor  RaidDevice State
    0    8     3     0    active sync  /dev/sda3
    1    8    19     1    active sync  /dev/sdb3
    2    8    35     2    active sync  /dev/sdc3
    6    8    51     3    spare rebuilding  /dev/sdd3
    4    8    67     4    active sync  /dev/sde3
    5    8    83     5    active sync  /dev/sdf3


### Wait for resync to finish. You CAN turn the NAS off/on, but ideally you're best to leave it going.

Message 12 of 13
PERECil
Initiate

Re: Ultra 6 - Dead drive, Replaced but won't Rebuild #249990

Thanks Quinny, after browsing the forum for hours, I finally found this thread. Your friend's script has proven to be very useful for me, as I had exactly the same problem as you. Is there any way to thank you more?
Message 13 of 13
Top Contributors
Discussion stats
  • 12 replies
  • 3513 views
  • 1 kudo
  • 4 in conversation
Announcements