- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Slow Transfer for Multiple Small Files and Slow Saving Visual Studio Files
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Slow Transfer for Multiple Small Files and Slow Saving Visual Studio Files
I have a new ReadyNAS 102 running Firmware 6.4.1. It is connected to my network via a TRENDnet Gigabit Switch (TEG-S82g), which is connected to my ASUS 802.11AC Gigabit Router (RT-AC66U). My computer, the router, and my ReadyNAS are all configured to utilize Jumbo Frames (I configured my network adaptor via the Device Manager... I did not change the MTU of my Local Area Connection via the command line). The MTU of the ReadyNAS is set to 9000.
Large files seem to transfer very quickly (anywhere between 30-70MB/S). Small files transfer at a a fraction of this speed (10KB/s - 7MB/s).
Additionally, if I work on a Visual Studio projects housed on the server, saving and compiling SASS files or creating Solutions can take upwards of 4 minutes. When done locally from files on my machine, this task is normally completed in 5-15 seconds. Also, I continue to get messages that say that files have been altered outside of the Visual Studio interface and I can't seem to figure out what might be causing files to change.
I have disabled all of the ReadyNAS anti-virus features, no snapshots are running, no Bit Rot protection is running. The files are being accessed via shares (iSCSI was 1000 times faster, but does not allow for multiple people accessing the drive) that I have mapped to my Windows 10 computer.
I'm at a lose for how to improve this performance. I need to transfer hundreds of thousands of small files from our old network "solution" (which was a drive connected to my computer) and I need Visual Studio files to save quickly without having to move them back and forth between machines.
Does anyone have any suggestions? Please let me know if you need more information.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Slow Transfer for Multiple Small Files and Slow Saving Visual Studio Files
There are some relevant fixes in ReadyNASOS 6.4.2 (RC1).
You could either disable Jumbo Frames for now (changing the MTU back to 1500) or update to 6.4.2-RC1.
Skywalker wrote:
However, the benefits of jumbo frames on RN10x are questionable at best. The Marvell chipset used in RN10x is not capable of doing TCP checksum or segementation offloading on packets larger than 1600 bytes. So you'll usually experience much better TX performance with a smaller MTU.
Welcome to the community!
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Slow Transfer for Multiple Small Files and Slow Saving Visual Studio Files
Unfortunately this provided zero improvement. Visual Studio files still take minutes to save. Small files still transfer at KB/s.
Turning off Jumbo Frames reduced large file size transfer from 60-70 MB/s to 40 MB/s or less.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Slow Transfer for Multiple Small Files and Slow Saving Visual Studio Files
@QuantumDynamix wrote:
Large files seem to transfer very quickly (anywhere between 30-70MB/S). Small files transfer at a a fraction of this speed (10KB/s - 7MB/s).
Additionally, if I work on a Visual Studio projects housed on the server, saving and compiling SASS files or creating Solutions can take upwards of 4 minutes. When done locally from files on my machine, this task is normally completed in 5-15 seconds. Also, I continue to get messages that say that files have been altered outside of the Visual Studio interface and I can't seem to figure out what might be causing files to change.
I'm at a lose for how to improve this performance. I need to transfer hundreds of thousands of small files from our old network "solution" (which was a drive connected to my computer) and I need Visual Studio files to save quickly without having to move them back and forth between machines.
I don't think any NAS will handle this particular task very well. CIFS itself is not well suited for handling massive transfers of small files. Even an RN716X with a 10 gbit network connection only manages 10-20 MB/sec on the NASPT directory copy benchmark.
The usual answer to this challenge is to use a source control system of some kind - so the NAS can centralize the software branch storage, but the builds/development are done with local copies, You could possibly use some sync software to obtain a similar result.