One Million IOPS (4k) possible with ReadyNAS MetaData /ReadyTier in 6.10 Firmware
We current have an RR4312X running XRAID2 (Raid6) 58TB with a mixuture of Drives (4x10TB 6x6TB & 2x4TB) with 16GB RAM using 2x10Gbps LACP Bounded to our switch that RSync every night to a 2nd RR4312X (XRAID6)
We have two problems 1) if a Raid 6 drive fails it can take weeks to recover & performance degradation 2) we need to increase throughput as our clients are using the NAS for running Hyper-V drives with SMB /LUN Shares backups etc..and are starting to run into performance issues..
Some Questions.. if we Max out the Ram on both R4312X to 64GB does this increase performance/throughput or is the Ram just for running Apps on the NAS? if we move from RAID6 to RAID 0 & Mirroring both NAS servers (Rsync or ReadyDR /Snapshots) with several 10TB and an 2 SSD MetaData /ReadyTier cache.. would that significantly increase performance? if so does Netgear have performance numbers?.. the other option is to move to ALL SSD but ReadyNAS max out at 48TB (4TB SSD x12 drives) has anyone tested performance & would it be possible to reach 1M IOPS (4k) with Readynas?
The other problem we have is multiple files with the same name/file size in multiple locations.. if ReadyNAS does NOT Support DeDuplication could we in fact impliment DeDup by by installing a program like Unitrends backup that support this on a VM running on a share on the NAS.. in terms of folder compression /bit rot protection does this significantly impact performance..
Are there any other options we have to increase performance with ReadyNAS? or is our only Option to buy 2 HP DL385 Gen10 Servers with 12 Drives Mirrored with Thunderbolt 3 connection between both servers running S2D (Windows 2016 Storage Spaces Direct) or to buy 4 Servers 4 Node Cluster (That uses Erasure Encodoing & reduces rebuild times to about 40mins vs Weeks with RAID6 on a 10TB drive) We are thinking mostly 10TB Drives with Optane NVME SSD Cache using RDMA 10Gbps Network card..some of these solutions give over 1M IOPS or going with another solution like Pure Storage, Qumulo Nimble Storage etc - problem here Quotes are VERY Expensive even Hybrid solutions (never mind all NVME SSD)
So I guess we are trying to figure out how to increase performance without spending a fortune on a difference solution for example does Synology or QNAP have solutions or is Netgear planning to address any of these issues of performance - any thoughts /suggestions - thanks..
Model: RN628X|ReadyNAS 628X - Ultimate Performance Business Data Storage - 8-Bay
(That uses Erasure Encoding & reduces rebuild times to about 40mins vs Weeks with RAID6 on a 10TB drive)
I just want to clarify that RAID-5 and RAID-6 also use Erasure Coding. The real distinction is that the goal of RAID is to build virtual disks with protection against disk loss. The newer forms of Erasure Coding are protecting individual files ("objects"), and aren't necessarily attempting to build redundant block storage. Also, they can use modes that go beyond dual redundancy and the encoded blocks can be stored on other servers.
It'd be interesting to know more about how the fast build time is accomplished. With mechanical disks, the rebuild time (for either approach) is limited by the disk I/O speed. Just writing 10 TB of data to a disk at 250 MB/sec will take over 11 hours (just do the math). Writing 10 TB of data to a blank disk in 40 minutes needs a sustained write speed over 4 GB/sec. No mechanical disk can handle anything close to that.
The other problem we have is multiple files with the same name/file size in multiple locations.. if ReadyNAS does NOT Support DeDuplication could we in fact impliment DeDup by by installing a program like Unitrends backup that support this on a VM running on a share on the NAS.. in terms of folder compression /bit rot protection does this significantly impact performance..
The ReadyNAS storage won't seek out and dedup files. Though COW does allow duplicate files to share the same datablocks. So you might be able to find a utility somewhere that would identify the duplicates on a volume, and you could then re-write them (using --reflink) to reduce the on-disk space. There would be no impact on bit rot protection.
But I don't understand the "folder compression" comment. Folder compression will of course significantly impact performance.
Also, LUNs are just raw block storage as far as a NAS is concerned. Since the NAS can't see the underlying file system, deduplication has to be the responsibility of the VM.
