One Million IOPS (4k) possible with ReadyNAS MetaData /ReadyTier in 6.10 Firmware

I think you'll need to get the performance benchmarks you need from Netgear. 

I will say that 20 gb of network connection can carry at most 600K IOPs(4K).  600,000*4096*8 is 19.7 gigabits.  

---

kevinfor2014 wrote:

(That uses Erasure Encoding & reduces rebuild times to about 40mins vs Weeks with RAID6 on a 10TB drive)

---

I just want to clarify that RAID-5 and RAID-6 also use Erasure Coding.  The real distinction is that the goal of RAID is to build virtual disks with protection against disk loss.   The newer forms of Erasure Coding are protecting individual files ("objects"), and aren't necessarily attempting to build redundant block storage.  Also, they can use modes that go beyond dual redundancy and the encoded blocks can be stored on other servers. 

It'd be interesting to know more about how the fast build time is accomplished.  With mechanical disks, the rebuild time (for either approach) is limited by the disk I/O speed.  Just writing 10 TB of data to a disk at 250 MB/sec will take over 11 hours (just do the math).  Writing 10 TB of data to a blank disk in 40 minutes needs a sustained write speed over 4 GB/sec.  No mechanical disk can handle anything close to that.

---

kevinfor2014 wrote:

The other problem we have is multiple files with the same name/file size in multiple locations.. if ReadyNAS does NOT Support DeDuplication could we in fact impliment DeDup by by installing a program like Unitrends backup that support this on a VM running on a share on the NAS..  in terms of folder compression /bit rot protection does this significantly impact performance..

 

---

The ReadyNAS storage won't seek out and dedup files.  Though COW does allow duplicate files to share the same datablocks.  So you might be able to find a utility somewhere that would identify the duplicates on a volume, and you could then re-write them (using --reflink) to reduce the on-disk space.  There would be no impact on bit rot protection.

But I don't understand the "folder compression" comment.  Folder compression will of course significantly impact performance.

Also, LUNs are just raw block storage as far as a NAS is concerned. Since the NAS can't see the underlying file system, deduplication has to be the responsibility of the VM.