NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
ReadyNAS crash on Balance task
Hi guys,
A couple of times now my ReadyNAS Pro 6 has completely locked up during a BTRFS Balance task. It's only recently been set up, so I've never actually had a balance go to full completion due to this issue. I haven't tested from the CLI yet, just wanted to post here and see if anyone has experienced this or knows what logs I might be able to poke around in to get some answers (I can't seem to find the "usual" logs like /var/log/messages or similar).
I've done the RN4to6 Upgrade, currently running ReadyNAS OS 6.9.4. The NAS is purely for iSCSI, running only a couple of disks from some really large VMs. The other disks for these VMs are on 15K vSAN disks that aren't affiliated with the NAS but obviously the VMs crash every time the NAS does which probably isn't doing them a lot of good.
At first, I thought it was memory exhaustion so I upgraded it to what seems to be the maximum (4GB), and the performance improved pretty dramatically but still stuck on this balance crash issue.
A balance was scheduled for late last night and I got up this morning to find it had crashed, I ran another balance task manually when I got home to see if it would crash again and it did immediately.
The I/O load on this NAS is pretty low; it's largely for big media and linux packages so doesn't really get a lot of storage hits.
The Web UI log really says nothing useful that I can see, the sequence is usually the task starting then the NAS booting back up after I perform a hard reset:
Volume: Balance started for volume array0.
System: ReadyNASOS service or process was restarted.
Some other things worth mentioning:
-The volume is Encrypted
-Total size is 4.69TB (RAID-10), currently 767.45GB free
-Every time the NAS crashes after a balance fail, it will do a resync of the RAID
Any advice is appreciated!
11 Replies
Replies have been turned off for this discussion
There probably isn't much need to balance a volume with only a few iSCSI volumes, but of course it shouldn't fail.
I am suspecting a disk issue of some kind.
Have you looked at the disk SMART stats? If not, try downloading logs before you try a balance, and then download again after it fails/restarts. Look in disk_info.log for the stats.
You might also try doing a scrub, and see if that completes ok.
Ah, good to know. I only do them once a month as a "good measure" because I know how BTRFS can be when it doesn't get the necessary TLC.
Great point about the disks, I'm aware of one that had ATA errors but the number hasn't changed (sitting on 10 currently). Is that a cause for concern? I've now found 2 more with ATA errors though, sitting on a count of 1 and 2. All the other counters are sitting on 0 for all disks:
Reallocated Sectors: 0
Reallocation Events: 0
Spin Retry Count: 0
Current Pending Sector Count: 0
Uncorrectable Sector Count: 0Once the resync completes I'll disconnect the LUNs and try a scrub, will report back here on how it goes.
Thanks!
I've seen the readysasd task jump to 100% during a scrub on my 516, effectively locking up the UI. Maybe a balance could do it as well, especially if it was the first (and probably longer). If you have SSH and itr should happen again, try going in that way and use TOP to see if something's taking all the CPU power.
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
