NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Permission Issues: ReadyNAS RR4312X goes total read only mode, inoperable
We have two of these RR4312X (ReadyNAS 4312 with 10GBASE/T not showing up in the model list above). One is working fine still, the other one went totally read only all of a sudden. Please help! ...
Well, since I don't work for Netgear I don't have any way to gather stats.
But BTRFS corruption doesn't show up very often here.
So I have been having trouble communicating with L3 Support staff, so I might just ask my question here.
So we paid for the premium support with the hope of resolving this issue, and it came back basically like this:
- File System is in a very bad shape:
Data, single: total=30.85TiB, used=28.25TiB
System, DUP: total=8.00MiB, used=3.34MiB
Metadata, DUP: total=27.00GiB, used=24.21GiB
GlobalReserve, single: total=512.00MiB, used=201.25MiB
After a little back and forth, the L3 staff followed up with:
- Poor setup: the customer ended up with almost 30 GB of metadata that are quite enough to cause troubles.
I have not had any luck getting the L3 staff to explain further what all these means. All I have access to (as the customer) is the GUI, and in the GUI there is no information about any of those things. How am I supposed to monitor or do anything about those???
I guess I could probably enable SSH service and check there. However when I try to enable SSH it says "For security reasons, we recommend that you do not enable SSH. If you enable SSH root access, NETGEAR reserves the right to deny you technical support." So it appears we're not supposed to do that.
I'm very concerned because we have two of these NAS, and I'm afraid the other one will be down soon as well. Could you help me understand this issue?
Another thing is the L3 Staff mentioned that the hard drives used in the NAS is not in the HCL. I swear the hard drives were in the list last year when we bought it, otherwise we wouldn't spend the $$$$$ to buy two of these. Do hard drives gets pulled out of HCL ever?
Thanks for your help.
I can't speak for L3, but I will see if I can find someone who can. I do see your volume is quite full (91%), and that could be part of it.
BTW what hard drives did you purchase?
Thanks for your reply,
How do you see that it was 91%? Is it from this line: Data, single: total=30.85TiB, used=28.25TiB
I'm not sure why it is shown total 30TiB, because the total (according to GUI) is 36TB.
As far as I know according to the GUI, it never went any lower than 6TB free (of 36TB), so never any more than 83% full. At that point, we had a 4TB iSCSI LUN that was suddenly crashing our ESXi server, so we removed the 4TB LUN (The LUN was almost full at 3.5TB actual data). When we did that, the free space only went down to 8TB, which where it is currently at (77% full). And then all these mess started happening. So that about 2TB space is unaccounted for, which may be the symptom of some bad stuff happening.
Our other same model NAS also had the same issue, suddenly it crashed the ESXi (a different ESXi host). So on that one we took the LUN down, but it is still working fine (although we are really worried now!!). That particular one does have more space left at any time (currently 61% full). The still working NAS also has lower firmware version 6.7.4., I don't know if the newer firmware are more prone to this issue (the broken one on latest 6.7.5).
Other than the LUN (at the time) it is just normal SMB shares.
The hard drives are Hitachi Deskstar NAS HDN724040ALE640, 4TB x12 (using Netgear's X-RAID single 36TB volume). The L3 staff keep saying it is a regular desktop drive, do not use regular desktop drive, etc. However it is not a regular desktop drive, its a NAS drive, and I'm sure last year I checked the HCL and it was there at the time. It does not show up in the HCL currently though, so the L3 staff basically said (paraphrasing), "well you screw up, sorry." However it is a bit funny that the HCL does have one approved regular Deskstar HDS721010CLA332 (not NAS) hard drive in there, with the note "This disk should be compatible based on the test result of another disk in the same series from the disk manufacturer," yet there are no other Deskstar drives in the list!
A bit of suggestion to the forum viewers, save/make a screenshot of the HCL at the time of purchase!
Thanks
ddx wrote:
The hard drives are Hitachi Deskstar NAS HDN724040ALE640, 4TB x12 (using Netgear's X-RAID single 36TB volume). The L3 staff keep saying it is a regular desktop drive, do not use regular desktop drive, etc. However it is not a regular desktop drive, its a NAS drive,
Certainly it is a NAS drive, though it's spec sheet specifies Applications/Environments as desktop NAS - https://www.hgst.com/sites/default/files/resources/DS_NAS_spec.pdf. Not sure it's intended for a 12 bay rackmount. On the other hand, I don't know that it won't function in a rack mount either. How do the SMART stats look?
ddx wrote:
How do you see that it was 91%? Is it from this line: Data, single: total=30.85TiB, used=28.25TiB
I'm not sure why it is shown total 30TiB, because the total (according to GUI) is 36TB.
That was it. I don't understand the discrepancy either.
ddx wrote:I guess I could probably enable SSH service and check there. However when I try to enable SSH it says "For security reasons, we recommend that you do not enable SSH. If you enable SSH root access, NETGEAR reserves the right to deny you technical support." So it appears we're not supposed to do that.
SSH is a feature. You CAN use it.
Sometimes, you hear things like "it's forbidden" or "not allowed", it's not. It's a feature available for everyone, you can even enable it from the GUI.
What this warning means is that if you perform intrusive actions via SSH and break your system, it's not NETGEAR Support's job to figure it out for you. You broke it, you fix it.
You can use SSH freely as long as it's nonintrusive actions. The rest is your own responsibility.
An example of a nonintrusive command you can use:
btrfs filesystem usage /data
How do I check the SMART stat on the GUI? Otherwise is says everything is normal.
Is there a big difference between NAS drives for the form factor of "Desktop" or for "Rackmount"? Not Netgear product, but Synology has a 12-bay "Desktop" NAS called "Synology DiskStation DS2415+" that has my exact hard drive on their compatibility list (and many other Deskstar NAS series hard drives).
Here's the above part in the btrfs.log:
Label: '2fe77d04:root' uuid: f64a0e0e-8d77-4f2a-8ba4-c61db0d62943
Total devices 1 FS bytes used 511.58MiB
devid 1 size 4.00GiB used 1.63GiB path /dev/md0Label: '2fe77d04:data' uuid: 2f0b2f9c-cbfd-43fe-85af-39ebb45250d7
Total devices 1 FS bytes used 28.27TiB
devid 1 size 36.34TiB used 30.90TiB path /dev/md127We do not use snapshots on anything.
Bit rot protection is enabled on all the shares.
Compression is not enabled.
I don't believe I had CoW on the LUN.
About SSH, does the NAS keep logs of what commands we run? Otherwise, how would one tell?
I do want to check our still running NAS if their data usage is in check, but want to make sure before we will be denied support.
Thanks for your responses,
ddx wrote:
How do I check the SMART stat on the GUI? Otherwise is says everything is normal.
Unfortunately there's no good way - an odd omission. It is in the log zip though - disk_info.log and smart_history.log
ddx wrote:
How do I check the SMART stat on the GUI? Otherwise is says everything is normal.
Is there a big difference between NAS drives for the form factor of "Desktop" or for "Rackmount"? Not Netgear product, but Synology has a 12-bay "Desktop" NAS called "Synology DiskStation DS2415+" that has my exact hard drive on their compatibility list (and many other Deskstar NAS series hard drives).
I don't know about HGST specifically, but generally "desktop NAS" drives are intended for smaller NAS. WDC Reds for instance say "built for single-bay to 8-bay". Vibration protection might be weaker than you'd see in an enterprise class drive.
How much of this is sales hype and how much is real depends on who you ask. BackBlaze for instance doesn't buy it - they use desktop-class drives in their 60-bay storage pods.
ddx wrote:
About SSH, does the NAS keep logs of what commands we run? Otherwise, how would one tell?
IMO The warning is a bit too strong. There's a better formulation here: https://kb.netgear.com/30068/ReadyNAS-OS-6-SSH-access-support-and-configuration-guides
- Access by SSH is not discouraged, but is recommended for advanced users only.
- As such, using SSH is at the user's own risk.
- Support is offered for configuring SSH using available options provided in the Admin Page.
- Support will not be offered for using SSH.
- Support may be denied if it is determined that actions taken through SSH have contributed to problems encountered on the ReadyNAS. However, you may factory reset the ReadyNAS and restore data from backup at which point normal support may resume.
- SSH access does not affect the hardware warranty.
Of course there is information in the downloaded log zip file (which is rotated). That includes apt-history.log. I don't think there's anything hidden.
- Access by SSH is not discouraged, but is recommended for advanced users only.
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
