NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.

Forum Discussion

dbrami's avatar
dbrami
Aspirant
Apr 27, 2023
Solved

Can't go back to RW mode after system "protected" itself

Hi all, I've been struggling with this for a few weeks and can't use my NAS since this started. I was transferring some files to the NAS as a mounted "network drive" from my Macbook. I cancelled th...
  • StephenB's avatar
    StephenB
    Apr 28, 2023

    I am seeing two things.

     

    One is that sde and sdf (disks 5 and 6) are showing some errors in disk_info.log

     

    Device:             sde
Health Data:
  Current Pending Sector Count:   3
  Uncorrectable Sector Count:     3


Device:             sdf
Health Data:
  Current Pending Sector Count:   5
  Uncorrectable Sector Count:     4

     

     

    Raid-5 can't handle two disk failures, so that might be part of the puzzle here.  Though these counts are small, it might be good to power down, and connect these disks to a PC (sata or USB dock).  Test them with WD's dashboard software - running the long (full) non-destructive test.  Label the disks as you remove them, so you can put them back in the right slot.  Keep the NAS powered down until you replace the disks.

     

    The other error (which is what is driving the read-only status is here:

     

    Apr 08 10:50:54 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 1, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:54 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 2, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 3, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 4, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 5, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 6, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 7, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 8, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 9, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS error (device md127): bdev /dev/md127 errs: wr 10, rd 0, flush 0, corrupt 0, gen 0
Apr 08 10:50:58 BananaS kernel: BTRFS: error (device md127) in btrfs_commit_transaction:2249: errno=-5 IO failure (Error while writing out transaction)
Apr 08 10:50:58 BananaS kernel: BTRFS info (device md127): forced readonly

     

    One thing that is odd is that I am not seeing any corresponding mdadm or raw disk errors in kernel.log - which normally we would see.

     

    Not sure yet on what you might do with ssh, but I strongly recommend making a backup of any data you care about before attempting a repair.  If it were my system, I'd start over with a fresh volume (factory default), because the repair might not fix everything.

dbrami's avatar
dbrami
Aspirant
May 05, 2023

Things have gotten worse - perhaps as a result of my meddling prior to reading your solutions.

And my logs have just blown up with the following pair of warnings:

When i run `mnt` command in CLI, i don't see any of my subvolumes that I *used* to have:

/dev/md127 on /data type btrfs (ro,noatime,nodiratime,nospace_cache,subvolid=5,subvol=/)
/dev/md127 on /home type btrfs (ro,noatime,nodiratime,nospace_cache,subvolid=257,subvol=/home)
/dev/md127 on /apps type btrfs (ro,noatime,nodiratime,nospace_cache,subvolid=258,subvol=/.apps)
/dev/md127 on /run/nfs4/data/CloudSync type btrfs (ro,noatime,nodiratime,nospace_cache,subvolid=2166,subvol=/CloudSync)
/dev/md127 on /run/nfs4/data/Data_backup type btrfs (ro,noatime,nodiratime,nospace_cache,subvolid=6290,subvol=/Data_backup)
/dev/md127 on /run/nfs4/data/Photos_Videos type btrfs (ro,noatime,nodiratime,nospace_cache,subvolid=3353,subvol=/Photos_Videos)
/dev/md127 on /run/nfs4/home type btrfs (ro,noatime,nodiratime,nospace_cache,subvolid=257,subvol=/home)
/dev/md127 on /run/nfs4/data/BananaMovies type btrfs (ro,noatime,nodiratime,nospace_cache,subvolid=271,subvol=/BananaMovies)

 

I now have a big enough external disk but can't access the data AND the NAS was not able to recognize the 5TB drive when plugged into the USB 3.0 port in the back...

 

SO much headaches...

 

Any ideas on proper command for remounting my subvolumes as btrfs so i can backup my data then factory reset?

 

Thanks in advance.

Daniel

 

  • StephenB's avatar
    StephenB
    Guru - Experienced User
    May 06, 2023

    You might have lost the volume as a result of the reboot.

     

    Maybe try this command first from ssh - not sure if it will help, but it should clear out the write transactions.

     

    btrfs rescue zero-log /dev/md127​

     

    Make sure you log into ssh as root (using the NAS admin password).

     

    Then try rebooting the NAS as read-only from the boot menu.

    • dbrami's avatar
      dbrami
      Aspirant
      May 10, 2023

      I thought i had posted a response but seems I was wrong...

      I rebooted into read only mode and then performed the "btrfs rescue zero-log" command but nothing seems to have happened.

      I did run a complete disk check and the report stated that my drives #5 AND 6 had errors.

      Do you think if i replace them one a time, i might be able to access my data and backup to portable drive?

       

      I did get this from the logs:

      May 07, 2023 03:40:30 AM	Volume: Disk test failed on disk in channel 6, model WDC_WD2000FYYZ-01UL1B1, serial WD-WCC1P0707252.
May 07, 2023 03:40:29 AM	Volume: Disk test failed on disk in channel 5, model WDC_WD2000FYYZ-01UL1B1, serial WD-WCC1P0708843.
May 06, 2023 10:37:53 PM	System: Alert message failed to send.
May 06, 2023 10:37:53 PM	Volume: Disk test started for volume data.
May 06, 2023 09:56:55 PM	System: ReadyNASOS background service started.
May 06, 2023 02:04:09 PM	System: Alert message failed to send.
May 06, 2023 02:04:09 PM	System: The system is shutting down.

       

      • StephenB's avatar
        StephenB
        Guru - Experienced User
        May 10, 2023
        dbrami wrote:

        I did run a complete disk check and the report stated that my drives #5 AND 6 had errors.

        Do you think if i replace them one a time, i might be able to access my data and backup to portable drive?

         

        No.  XRAID has single-disk redundancy, so you can replace one disk w/o data loss.  But it can't handle two disk failures.

         

        You could try cloning the disks - if you can get the bulk of the data copied, then you could use RAID recovery software. Several folks here have used ReclaiMe with success.  But if you can't get data off at least one of the failed disks you are out of luck.

         

        You could also look into using a data recovery service. 

         

        Either way, it would be expensive.

         

         

         

         

         

NETGEAR Academy

Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology! 

Join Us!

ProSupport for Business

Comprehensive support plans for maximum network uptime and business peace of mind.

 

Learn More