ReadyNAS 4220s not creating shares

[ximen]

Hello! I can not create new shares on ReadyNAS 4220s, ISCSI LUNs also could not be created. When I try to add share, web interface simply restarts. In console (journalctl, dmesg) I can see readynasd daemon segfault and restart. I've installd latest FW (6.10.4 Hotfix 1) and rebooted storage - still no success.

Is there any way to fix this or maybe create resources from ssh? Any ideas?

Thank you.

[StephenB]

Is the root partition full?

[ximen]

Thank you for your attention!

No, none of partitions are full:

root@DATANAS:/var/log/readynasd# df -h
Filesystem Size Used Avail Use% Mounted on
udev 10M 4.0K 10M 1% /dev
/dev/md0 4.0G 1.3G 2.4G 36% /
tmpfs 3.9G 0 3.9G 0% /dev/shm
tmpfs 3.9G 11M 3.9G 1% /run
tmpfs 2.0G 1.7M 2.0G 1% /run/lock
tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
/dev/md127 5.5T 172G 5.3T 4% /HyperV
/dev/md126 11T 3.7T 7.3T 34% /Datanas
/dev/md126 11T 3.7T 7.3T 34% /apps
/dev/md126 11T 3.7T 7.3T 34% /home
/dev/md126 11T 3.7T 7.3T 34% /run/nfs4/Datanas/IT

[StephenB]

Was the root ever full?  There is a script you could potentially run, but I'm not sure if if it will help. https://gitlab.codycook.us/readynas-scripts/share_lun_ui_fix.sh

Obviously confirm that the volume isn't in read-only status first.

[ximen]

Thank you very much for help! This script turned out to be very useful - it have made all shares I've tried to create visible, so I have now at least one way to create new shares.

However readynasd still restarting and unable to create iSCSI LUN...

I'll try to find something useful about iSCSI in this script.

[StephenB]

---

@ximen wrote:

This script turned out to be very useful - it have made all shares I've tried to create visible,

---

How did you try to create them?  Normally shares are btrfs subvolumes - is that what you created?

[ximen]

When I try to create share via web UI the only thing being created is btrfs subvolume. Then readynasd faulting. In result share (subvolume) exists in filesystem, but not being exported via Samba nor showing in UI. I also tried rn_nml with same result. After applying suggested script they begin to work properly.

[mdgm]

What about the following command?:

# btrfs fi show

[ximen]

root@DATANAS:~# btrfs fi show
Label: '7c6ecfd4:root' uuid: cc262a82-c364-4d88-8473-497b8299e134
Total devices 1 FS bytes used 1.25GiB
devid 1 size 4.00GiB used 4.00GiB path /dev/md0

Label: '7c6ecfd4:HyperV' uuid: 47d1f27f-b193-4902-957b-5245665aba93
Total devices 1 FS bytes used 170.93GiB
devid 1 size 5.45TiB used 221.02GiB path /dev/md127

Label: '7c6ecfd4:Datanas' uuid: b9beef89-79b7-4ed8-8149-7c894db264b6
Total devices 1 FS bytes used 3.67TiB
devid 1 size 10.89TiB used 6.11TiB path /dev/md126

[mdgm]

The thing about the df command is that it’s not designed for the BTRFS filesystem. Whilst it can give you a rough idea on usage it doesn’t provide the full picture.

[ximen]

Thanks! I'm not familiar enough with BTRFS.

root@DATANAS:~# btrfs fi show
Label: '7c6ecfd4:root' uuid: cc262a82-c364-4d88-8473-497b8299e134
Total devices 1 FS bytes used 1.25GiB
devid 1 size 4.00GiB used 4.00GiB path /dev/md0

Label: '7c6ecfd4:HyperV' uuid: 47d1f27f-b193-4902-957b-5245665aba93
Total devices 1 FS bytes used 170.93GiB
devid 1 size 5.45TiB used 221.02GiB path /dev/md127

Label: '7c6ecfd4:Datanas' uuid: b9beef89-79b7-4ed8-8149-7c894db264b6
Total devices 1 FS bytes used 3.67TiB
devid 1 size 10.89TiB used 6.11TiB path /dev/md126

[StephenB]

---

@ximen wrote:

root@DATANAS:~# btrfs fi show
Label: '7c6ecfd4:root' uuid: cc262a82-c364-4d88-8473-497b8299e134
Total devices 1 FS bytes used 1.25GiB
devid 1 size 4.00GiB used 4.00GiB path /dev/md0

---

This looks like it needs some attention - perhaps a balance?

[ximen]

Yeah, thanks! Live and learn... After btrfs balance /

Label: '7c6ecfd4:root'  uuid: cc262a82-c364-4d88-8473-497b8299e134
        Total devices 1 FS bytes used 1.23GiB
        devid    1 size 4.00GiB used 1.94GiB path /dev/md0

But nothing else changed, readynasd still restarting on share create

[mdgm]

What about if you do an OS Re-install?

Do you still have the problem after doing that?

[StephenB]

---

@ximen wrote:

But nothing else changed, readynasd still restarting on share create

---

Might be time to consider doing a full factory default and rebuild the entire thing (restoring files from backup).

Though painful, starting over would ensure a clean file system and configuration.

[ximen]

I'm pretty sure factory defaults and rebuild will solve the problem, but this is the worst case solution - to backup all data I will need to buy another one storage (

[ximen]

Is there a way to do this and leave data intact? I don't know how it will impact on current shares.

[StephenB]

---

@ximen wrote:

I'm pretty sure factory defaults and rebuild will solve the problem, but this is the worst case solution - to backup all data I will need to buy another one storage (

---

I agree it's painful.  

Though IMO everyone should have a backup plan in place anyway - RAID isn't enough to protect your data.  So maybe consider getting  USB drives to back up the NAS even if you don't choose to do the factory default.

The puzzle here is that we can't easily tell if something is wrong with the file system or if something is still wrong with the configuration on the OS.  You could try doing btrfs scrubs on the data volume (maybe on the HyperV volume first), and see if that turns up anything. 

You could also try paid support, they might be able to figure it out and repair it.

[ximen]

---

Though IMO everyone should have a backup plan in place anyway - RAID isn't enough to protect your data. .

---

This ReadyNAS is our backup plan - it mainly stores backups for our servers )
Anyway thank you very much for help! I'll revert to factoy defaults when it will be possible.