NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
ovidiu
Jan 11, 2014Aspirant
Readynas 6 Jumbo frames optimization, SMB versions OS4 & OS6
I have a ReadyPRO 6 that I got last month instead of my previous Ultra 6 that got funky when restarting it. (thanks to extended warranty). I had previously the infrant NV's variants since the company started making them.
I also have the Synology 1812+ and 1010+ and an acer home server (for PS3 streaming). I had also the Thecus one. (7700)
I was always puzzled by the not slow transfer speed on Readynas OS4.xx (and 3.xx before) . But sometimes it was going well.
I tried all the possible tweaks existent on the forums and on the net along this years without really getting it.
Sometimes it worked, sometimes it did not.
When I got the new Pro 6 and put the previous Ultra 6 HD's back, everything worked well, but I got fed up with the "vodoo" involved in the transfer speed.
So I wanted to just get my data from the disks and then sell the Pro 6 unit (new unit that still has a transfered one year warranty)
I was going again through the optimizations, but I noticed that if I transfer from my readynas to the Synology, my tweaks do not really have any influence.
Another thing that helped me was the transfer to my MAC - funny enough, the Mac was transfering at a fast speed when the windows was slow (7 64 bit - but the same happened on Vista and before on XP) .
So it made it clear that there is a Windows problem (the SMB version I assumed, because the network card drivers were working either fast or slow on the same driver version - version of the network card driver was not relevant) Or my switch (a cheap *** trandnet - but I had the expensive metal netgear with no luckuntil it just fried spontaneously - didi not even bother to return it for warranty replacement - too hot))
WHAT made the difference was the Jumbo Frame setting in the network card driver. (I was macthing befor the MTU on Windows with the card and the NAS, or multipliers etc... the netsh commands - not really making any difference)
The difference was made when I chose a 3000k as jumbo frame (keeping the 9000 on the NAS and router).
On OS4 that was the sweetspot for the Windows network card driver . If I put it to 9k (as it logically appeared to mathc the value on the Readynas, I would have got 5-6 times less transfer speed ).
If I put no jumbo frames I kind of had the same result.
The other values 1k, 2k 4k or 5k 6k 7k worked, but not that fast. 8 k was again painfully slow.
So I managed to transfer my 9 TB in about 3 days to the Synology. average speed of 37MB/s
Now, because I had nothing to lose I updated the OS to Readynas OS6. I had it first to 6.14 following mdgm post and the factory default (which happend anyway when you change the OS - no need to specifically do it). Then updated to 6.16 [T5 and T6] and factory default again, just to get all the File system modifications to the latest BTRF status
I then made the MTU value in the OS6 to 9000 ( as it was uniquely possible on the Readynas OS4.xx).
Now the transfer rate is 87 MB/s - a vast improvement.
So my conclusion is that the SMB implementation on the Os4.xx is very sensitive to jumbo frames. I read that is an SMB implementation 1.2 and the new one is capable of SMB 3.0 (though windwos 7 is capable only to do SMB 2.0 or 2.1 I am not sure).
I tried forcing the SMB value only to 2.0 on the Readynas Os6 (you can do that with a plugin available in the Apps) in order to make sure that there will be no problem with windows. But after I tried with the SMB 3.0 active and noticed no difference, I conlcuded that the SMB implementation on the OS 6 is smarter and can scale down to a lower version of the protocol.
So after more than 8 byear of lurking and reading and seeing people come and go at infrant, this is my post that maybe will help others in trying to get the voodoo out of the jumbo frame and speed transfers
I also have the Synology 1812+ and 1010+ and an acer home server (for PS3 streaming). I had also the Thecus one. (7700)
I was always puzzled by the not slow transfer speed on Readynas OS4.xx (and 3.xx before) . But sometimes it was going well.
I tried all the possible tweaks existent on the forums and on the net along this years without really getting it.
Sometimes it worked, sometimes it did not.
When I got the new Pro 6 and put the previous Ultra 6 HD's back, everything worked well, but I got fed up with the "vodoo" involved in the transfer speed.
So I wanted to just get my data from the disks and then sell the Pro 6 unit (new unit that still has a transfered one year warranty)
I was going again through the optimizations, but I noticed that if I transfer from my readynas to the Synology, my tweaks do not really have any influence.
Another thing that helped me was the transfer to my MAC - funny enough, the Mac was transfering at a fast speed when the windows was slow (7 64 bit - but the same happened on Vista and before on XP) .
So it made it clear that there is a Windows problem (the SMB version I assumed, because the network card drivers were working either fast or slow on the same driver version - version of the network card driver was not relevant) Or my switch (a cheap *** trandnet - but I had the expensive metal netgear with no luckuntil it just fried spontaneously - didi not even bother to return it for warranty replacement - too hot))
WHAT made the difference was the Jumbo Frame setting in the network card driver. (I was macthing befor the MTU on Windows with the card and the NAS, or multipliers etc... the netsh commands - not really making any difference)
The difference was made when I chose a 3000k as jumbo frame (keeping the 9000 on the NAS and router).
On OS4 that was the sweetspot for the Windows network card driver . If I put it to 9k (as it logically appeared to mathc the value on the Readynas, I would have got 5-6 times less transfer speed ).
If I put no jumbo frames I kind of had the same result.
The other values 1k, 2k 4k or 5k 6k 7k worked, but not that fast. 8 k was again painfully slow.
So I managed to transfer my 9 TB in about 3 days to the Synology. average speed of 37MB/s
Now, because I had nothing to lose I updated the OS to Readynas OS6. I had it first to 6.14 following mdgm post and the factory default (which happend anyway when you change the OS - no need to specifically do it). Then updated to 6.16 [T5 and T6] and factory default again, just to get all the File system modifications to the latest BTRF status
I then made the MTU value in the OS6 to 9000 ( as it was uniquely possible on the Readynas OS4.xx).
Now the transfer rate is 87 MB/s - a vast improvement.
So my conclusion is that the SMB implementation on the Os4.xx is very sensitive to jumbo frames. I read that is an SMB implementation 1.2 and the new one is capable of SMB 3.0 (though windwos 7 is capable only to do SMB 2.0 or 2.1 I am not sure).
I tried forcing the SMB value only to 2.0 on the Readynas Os6 (you can do that with a plugin available in the Apps) in order to make sure that there will be no problem with windows. But after I tried with the SMB 3.0 active and noticed no difference, I conlcuded that the SMB implementation on the OS 6 is smarter and can scale down to a lower version of the protocol.
So after more than 8 byear of lurking and reading and seeing people come and go at infrant, this is my post that maybe will help others in trying to get the voodoo out of the jumbo frame and speed transfers
12 Replies
Replies have been turned off for this discussion
- fastfwdVirtuosoDid you try Jumbo Frames OFF for either OS4 or OS6?
- ovidiuAspirantYes. On both OS4 and OS6 is very slow. The sweetspot was at around 3000 on OS4. Not really a "hotspot" on OS6. I would assume that it is different for each system,, but not by much.
- arnomcAspirantVery interesting user experience feedback thanks ovidiu. I was surprised how low was your performance for a Pro6 under 4.x
ovidiu wrote: I then made the MTU value in the OS6 to 9000 ( as it was uniquely possible on the Readynas OS4.xx).
Now the transfer rate is 87 MB/s - a vast improvement.
How was the speed transfer for your pro6 with OS 6.1.x without JF, or with JF values other than 9000 compare to the maximum you reached at MTU9000 ?
I guess that in those tests you were copying files greater than 1GB ? (for reliable results).
Thanks for your input. It could help me when I'll try again the JF under 6.1.5 - super_poussinVirtuosoJF are disabled on my side (9000) because it makes rsync backup always crash
- arnomcAspirantthanks. I don't intend to use rsync right now, but it's still good to remember for the future ;)
- fastfwdVirtuosoA couple more data points, for what it's worth.
With NASTester 1.4 (http://www.808.dk/?nastester) transferring data between my Pro 6 running RAIDiator 4.2.24 and my Win7-64 laptop's SSD:
JF OFF (MTU 1500): 105MB/s Write, 110MB/s Read
JF ON (MTU 9000): 110MB/s Write, 123MB/s Read
Predictably, there's a larger improvement when transferring to the Ultra 2 Plus, which has slower hardware and therefore wastes more time responding to network interrupts. I was surprised, though, at the magnitude of the improvement:
JF OFF (MTU 1500): 70MB/s Write, 94MB/s Read
JF ON (MTU 9000): 110MB/s Write, 123MB/s Read
No issues so far with rsync (or anything else). - arnomcAspirantI guess your Ultra 2 is also under 4.2.25 (like your Pro 6) isn't it ? Those results are very close to the ones published by Netgear there :
http://www.readynas.com/?page_id=3962
I remember some tweaks for 4.2.x about enabling disk write cache and disabling full data journaling (http://kb.netgear.com/app/answers/detai ... ultra-plus). In my knowledge, there is no such settings in OS 6 anymore. - arnomcAspirantI just did a factory default so I made some tests on my legacy Ultra 2 under 6.1.6 with either a Win8.1 (M4 128GB SSD) or a MBA 13’’ (SSD & thunderbolt ethernet adapter). Windows was used for CIFS/SMB test and the OS X Maverick for AFP and samba (smb2). All were tested with drag and drop method with each time 2 different files around 8GiB size (like Netgear did for http://www.readynas.com/?page_id=3962) and there wasn’t any significant speed difference between the 2 files.
I used my Ultra 2 for 18 month under RAIDiator 4.2, and at that time it had samsung 2TB 3 platters F4 ecogreen : HD204UI minimum speed is the same for read & write at 62MB/sec. Now for OS 6.1.6 I have Toshiba 3TB 3 platters DT01ABA300 which read & write speed is at minimum 75MB/s.
Therefore the readyNAS was completely empty for the purpose of those tests.
Bandwidth speeds will be written in MiB/sec (for 1 to 3 minutes total time of copy) to avoid artificially increasing the speed compare to Netgear’s numbers (some may know that windows indicate size to be GB but in fact it’s GiB). As I said I made 2 test for each speed to have a vague idea of speed comparison for os4 / os6 and also for Jumbo frames which were set at 9K (http://www.mylesgray.com/hardware/test- ... s-working/)
1) CIFS drag & drop MTU@1500
read = 108 MiB/sec
write = 84-85 MiB/sec
2) CIFS drag & drop with Jumbo Frames at 9000
read = 111-114 MiB/sec
write = 105-107 MiB/sec
3) AFP drag & drop MTU@1500
read = 105-107 MiB/sec
write = 84-85 MiB/sec
4) AFP drag & drop with Jumbo Frames at 9000
read = 109-116 MiB/sec
write = 100-101 MiB/sec
5) SMB2 drag & drop on Mavericks with 9K Jumbo Frames
read = 103-104 MiB/sec
write = 102-104 MiB/sec
In the end you can see the increased speed from RAIDiator 4.2 to readyNAS 6.1 ! Even for a very low speed atom (Pineview D405 @ 1.50GHz). You can also see that AFP is now nearly at the speed of SMB. And in the end Jumbo frames are giving a little extra boost to reach the 100+ MiB/sec. close to the maximum for gigabit. Keep in mind that it's best case scenario, and the more you fill your NAS with data, and move data often, the less you can observe those maximum speed.
Note: for mac os x users : even if you can apply jumbo frames in networking settings and still have ethernet connection, you need to reboot !! Otherwise you'll end up with only 40MiB/s speed s compare to the 100MiB/s. I also didn't tried iSCSI, - arnomcAspirantHere is the beginning of my transfers of file around 2.5GB size from a hard drive (win8.1 - cifs) with jumbo frames 9K (the first folder started at 21:40) :

- Labdoc1LuminaryThanks for tips here. I have successfully improved network speed with this setup (see below). Testing with ping -f -l 4000 was important (Thanks Myles Gray). I found that the bonded ports using Adaptive Load Balancing, both ports before bonding and the bonded port set to JF=4000, fragmented the ping. However, setting the Bonded port to JF=4018 (same as the sending computer NIC) fixed the problem.
Setup:
Pro Pioneer, upgraded RAM and OS to 6.3.3 Beta 11, 8MB non-ECC PC6400 Corsair, Static IP, SMB, Switches: Netgear GS108e Jumbo Frame capable, Trendnet TEG-50 Jumbo Frame capable, Computer: ThinkPad W510 Win 8.1 x 64 Crucial C300 SSD NTFS, Intel 82577LM JF 4018,
Using NAS Tester 4000 Mb transfer,
JF Effect:
(1) No JF, No bonding...108 MB/sec
(2) JF, No bonding...119 MB/sec
(3) Adaptive Load Balancing Bonding + JF ...119 MB/sec
So, why use bonding? The speed of Shadowprotect backups has increased 2.5-3x with Bonding compared to JF only, now 70-90 MB/sec. With JF only, 50-60 MB/sec.
I am waiting for a Processor upgrade to arrive and maybe that will further increase speed on the backups.
Related Content
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!