NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Sandshark
Sep 08, 2021Sensei
Scrub slowed to a crawl, then locked up system.
My RN4200V2 backup system running OS6.9.6 used to complete a scrub in a bit over a day. It contained 12x3TB HGST enterprise drives in XRAID/RAID5 at that time. A couple months ago, I replaced 4 of ...
Sandshark
Sep 09, 2021Sensei
Well, it did the same thing again at the same point, as I was afraid it would, so I aborted and will have to start running some tests on the drives.
Sandshark
Sep 14, 2021Sensei
OK, so initiating a drive self-test via the GUI found no errors (as also verified via smatrctl -x output).
I did do some "poking around" in the BTRFS structure and noticed this:
root@RN4200B# btrfs filesystem df /data Data, single: total=27.45TiB, used=26.11TiB System, RAID1: total=32.00MiB, used=3.84MiB Metadata, RAID1: total=17.00GiB, used=14.18GiB Metadata, DUP: total=1.00GiB, used=549.25MiB GlobalReserve, single: total=512.00MiB, used=0.00B
The metadata for the added MDADM layer is separate in DUP format, not RAID1 with the rest. I'm not sure if that has anything to do with it, but I don't think it's good. The BTRFS wiki gives this warning: If the metadata is not converted from the single-device default, it remains as DUP, which does not guarantee that copies of block are on separate devices. If data is not converted it does not have any redundant copies at all.
Now, since the "device" is an MDADM RAID, not a single drive, that's probably not quite so dire. But it also doesn't seem, right. It's been a long time since I had a volume with unequal drive sizes, and I may not have even noticed this then, so I don't know if it's normal for a vertically expanded ReadyNAS. I do have a RAID5 of 12 drives, done by creating it in FlexRAID (with all drives 3TB at that time) and then switching to XRAID, so maybe it would be different in another case. XRAID likes a 12-drive unit to have RAID6.
I also looked back, and I did do a balance and scrub right after I added the last of the larger drives, and that scrub only took 26 hours. I don't know for sure if both metadata sections contained data at that point, though the balance should have caused that to be the case.
Any thoughts on whether a btrfs balance start -mconvert=raid1 would help, or how it might affect future expandability? I did do that on my main NAS when I manually vertically expanded a volume that's in FlexRAID, but I don't have to worry there about maintaining XRAID expandability. At the time I did that on the manual expansion, I didn't realize that the newly added layer's metadata being in DUP format was "normal".
The next step would be to start pulling drives and testing them in a PC, a long time for my backup system to be down with 8x3TB and 4x6TB drives to test or to destroy the volume and re-create, hoping whatever is causing the prbolem either goes away or shows up with a vengeance.
- StephenBSep 14, 2021Guru - Experienced User
Sandshark wrote:
Metadata, RAID1: total=17.00GiB, used=14.18GiB Metadata, DUP: total=1.00GiB, used=549.25MiB
I do have two RAID groups on my primary NAS, and I see
root@NAS:~# btrfs fi df /data Data, single: total=14.47TiB, used=13.99TiB System, RAID1: total=32.00MiB, used=1.62MiB Metadata, RAID1: total=15.00GiB, used=13.16GiB GlobalReserve, single: total=512.00MiB, used=0.00B
So only one metadata line for the volume, even though there are two RAID groups.
- SandsharkSep 14, 2021Sensei
OK, thanks -- food for thought. Seems, then, that it's not "normal" and maybe is related to my issue. Has me wondering if it's the fact that I created the original volume in FlexRAID and then changed to XRAID, that it's a RAID5 with more than 6 drives, or something else that had this result.
Was your multi-layer drive created all at once, or expanded from a single layer one drive at a time? Maybe that makes a difference.
I have two nearly identical backup systems with volumes created and expanded in the same way, and both have that structure. So whatever caused it is consistent.
- StephenBSep 14, 2021Guru - Experienced User
Sandshark wrote:
Was your multi-layer drive created all at once, or expanded from a single layer one drive at a time? Maybe that makes a difference.
It was expanded from 4x6TB to 4x10TB (XRAID) over a year or so.
My Pro-6 is 2x8TB+4x3TB, and it looks a bit more like yours:
Data, single: total=13.05TiB, used=12.68TiB System, RAID1: total=32.00MiB, used=1.47MiB Metadata, RAID1: total=4.00GiB, used=1.62GiB Metadata, DUP: total=7.50GiB, used=6.29GiB GlobalReserve, single: total=512.00MiB, used=0.00B
Related Content
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!