× NETGEAR will be terminating ReadyCLOUD service by July 1st, 2023. For more details click here.
Orbi WiFi 7 RBE973
Reply

ReadyNAS hung/frozen during resync (reshape)

nsne
Virtuoso

ReadyNAS hung/frozen during resync (reshape)

Title pretty much says it all. I have a 314 running 6.9.1 with 6TB+ disks in all four bays. Three days ago, I removed an HGST 6TB drive in bay 4 and inserted a brand new Seagate 10TB in its place.

 

The resync/expansion proceeded without incident, but the subsequent reshape process has been frozen at 78.41% for over 12 hours. The NAS is completely inaccessible over the network, even via ping.

 

I received no notifications about failing disks or disk errors prior to the system freeze.

 

My question now is: What can I do from here? Can I safely power down the NAS in order to test the disks? Can I simply reboot?

Model: RN31400|ReadyNAS 300 Series 4-Bay
Message 1 of 6

Accepted Solutions
nsne
Virtuoso

Re: ReadyNAS hung/frozen during resync (reshape)

@Retired_Member, I've e-mailed those logs. Thanks.

 

An update to this issue for future reference: I chatted with level 1 tech support and was advised to simply power off and reboot. I did so, and the NAS seemed to boot normally, then it restarted the reshaping process from 0.0%. It was also fully accessible again from the LAN, which is how I was able to download the logs.

 

No data appears to have been lost.

 

I've since disabled AV and switched off all apps (ddClient, Plex, LMS) to reduce load.

 

Right now the reshaping is about 2% and the disks appear to be healthy. So far neither I nor tech support have been able to isolate what caused the severe system freeze/hang.

View solution in original post

Message 4 of 6

All Replies
nsne
Virtuoso

Re: ReadyNAS hung/frozen during resync (reshape)

Okay, now it's over 24 hours.

Message 2 of 6
Retired_Member
Not applicable

Re: ReadyNAS hung/frozen during resync (reshape)

Hello nsne

can you please reboot the device to see if it can restart resync job ?or send me the system log to NSBU_logs@netgear.com if the issue persists after reboot.  

Message 3 of 6
nsne
Virtuoso

Re: ReadyNAS hung/frozen during resync (reshape)

@Retired_Member, I've e-mailed those logs. Thanks.

 

An update to this issue for future reference: I chatted with level 1 tech support and was advised to simply power off and reboot. I did so, and the NAS seemed to boot normally, then it restarted the reshaping process from 0.0%. It was also fully accessible again from the LAN, which is how I was able to download the logs.

 

No data appears to have been lost.

 

I've since disabled AV and switched off all apps (ddClient, Plex, LMS) to reduce load.

 

Right now the reshaping is about 2% and the disks appear to be healthy. So far neither I nor tech support have been able to isolate what caused the severe system freeze/hang.

Message 4 of 6
Retired_Member
Not applicable

Re: ReadyNAS hung/frozen during resync (reshape)

Hello nsne

Thanks for providing logs!unfortunately,I don't see any errors of raid resync in the logs,it shows your previous raid repairing is successful.

the volume is now doing resync,let's wait to see if the issue will happen again.

 

mdadm logs

Nov 29 16:03:14 ReadyNAS mdadm[2792]: /dev/sdb4 also saved as /var/backups/md/tmp/ata-ST8000VN0002-1Z8112_ZA12F8JX-part4.
Nov 29 16:03:14 ReadyNAS mdadm[2792]: /dev/sdc4 also saved as /var/backups/md/tmp/ata-ST8000VN0002-1Z8112_ZA12EHX8-part4.
Nov 29 16:03:14 ReadyNAS mdadm[2792]: /dev/sde4 also saved as /var/backups/md/tmp/ata-ST10000VN0004-1ZD101_ZA21S95J-part4.
Nov 29 16:03:18 ReadyNAS readynasd[4356]: Volume data health changed from Degraded to Redundant.
Nov 29 16:03:20 ReadyNAS msmtpq[15039]: mail for [ -C /etc/msmtprc ericj_i@yahoo.com --timeout=60 ] : send was successful
Nov 29 16:03:20 ReadyNAS mdadm[2792]: 15009 (process ID) old priority 0, new priority 19
Nov 29 16:03:20 ReadyNAS mdadm[2792]: Backing up RAID configs...
Nov 29 16:03:20 ReadyNAS mdadm[2792]: RebuildStarted event detected on md device /dev/md127, component device reshape
Nov 29 16:03:20 ReadyNAS mdadm[2792]: /dev/sdb4 also saved as /var/backups/md/tmp/ata-ST8000VN0002-1Z8112_ZA12F8JX-part4.
Nov 29 16:03:20 ReadyNAS mdadm[2792]: /dev/sdc4 also saved as /var/backups/md/tmp/ata-ST8000VN0002-1Z8112_ZA12EHX8-part4.
Nov 29 16:03:20 ReadyNAS mdadm[2792]: /dev/sde4 also saved as /var/backups/md/tmp/ata-ST10000VN0004-1ZD101_ZA21S95J-part4.
Nov 29 16:03:21 ReadyNAS readynasd[4356]: Disk in channel 4 (Internal) changed state from RESYNC to ONLINE.
Nov 29 16:03:22 ReadyNAS mdadm[2792]: Backing up RAID configs...

Message 5 of 6
nsne
Virtuoso

Re: ReadyNAS hung/frozen during resync (reshape)

The reshape completed successfully about two days ago and everything appears to be functioning normally. The NAS has since completed a defrag, a scrub and a backup.

 

The new ST10000V0004 drive is also running a good 10°F cooler than the other 8TB and 6TB drives, which is nice to see.

Message 6 of 6
Top Contributors
Discussion stats
  • 5 replies
  • 1613 views
  • 0 kudos
  • 2 in conversation
Announcements