NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Solved
Upgrading openssh help
Hi all, I've been suffering from really slow rsync speeds when copying files from one NV+ to another. Speeds around 700k/sec compared to having a computer in between doing the copying via afp/nfs...
You're just not going to get 30 MB/sec on an NV+ with rsync. I get about 4 MB/sec on my rsync backup jobs (which uses the daemon method) - remote source is my Pro-6. So I think the results you are getting are normal.
Eirik in the original post says he got 7.5 MB/sec, but that was his only post (ever) so we can't follow up with him. But from the script, it appears that he built SSL, which isn't relevant if you don't use encryption. We don't know anything about his network setup, or how much memory was in his NAS. You could perhaps enable jumbo frames and see if you get any improvement.
Apart from that I have no suggestions.
Ok I ran a few tests, with mixed results.
First, using the weakest encryption and no compression.
# rsync -aHAXxv --numeric-ids --progress -e "ssh -T -c arcfour -o Compression=no -x" large.iso 192.168.1.4:/media/Files/ sending incremental file list large.iso 2392064 0% 2.25MB/s 0:04:43
With that, I got a good bump to ~2.25MB/s. Still though, very slow.
I tried copying locally to see if there are any improvements. Same results.
# rsync --stats -h large.iso copy.iso Number of files: 1 Number of files transferred: 1 Total file size: 8.95M bytes Total transferred file size: 8.95M bytes Literal data 8.95M bytes Matched data 0 bytes File list size: 30 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 8.95M Total bytes received: 31 sent 8.95M bytes received 31 bytes 2.56M bytes/sec total size is 8.95M speedup is 1.00
Now, I ran an rsync daemon on the destination. Instructions below for anyone who would like to do the same:
On the destination NAS, create the following file and add the lines below. Make sure uid/gid is the same as the destination folder. My destination is /media/Files and i'm using default port (hence commented port below).
# vi /etc/rsyncd.conf pid file = /var/run/rsyncd.pid lock file = /var/run/rsync.lock log file = /var/log/rsync.log #port = 12000
[files] path = /media/Files comment = Files read only = no uid = media gid = nogroup list = yes hosts allow = 192.168.1.3 timeout = 300
Then run it as a daemon
# rsync --daemon # ps -ef | grep rsync | grep -v grep root 4799 1 0 20:35 ? 00:00:00 rsync --daemon (to kill) # pkill rsync or # pkill `cat /var/run/rsyncd.pid`
Results from NAS1:
# rsync --progress --stats -h large.iso rsync://root@192.168.1.4/files large.iso 61.64M 9% 3.93MB/s 0:02:27
So .. Yes I got over double the performance - from ~700k - 1.25MB/sec to ~4MB/sec. However, it's nowhere near what I was expecting, which is up to 30MB/sec at the least when using a Mac :(
One more test... Mounting NAS2 onto NAS1 using NFS.
# mount.nfs 192.168.1.4:/media/ /mnt/xn2/ # mount | grep xn2 192.168.1.3:/media/ on /mnt/xn2 type nfs (rw,addr=192.168.1.4)
Results with a normal rsync:
# rsync -av --progress large.iso /mnt/xn2/Files/
sending incremental file list
large.iso
24739840 3% 3.92MB/s 0:02:37
Results with weak encrypton and no compression:
# rsync -aHAXxv --numeric-ids --progress -e "ssh -T -c arcfour -o Compression=no -x" large.iso /mnt/xn2/Files/
sending incremental file list
large.iso
24608768 3% 3.90MB/s 0:02:38
So I've hit another limit of ~4MB/sec :(
ReadyNAS doesn't have `nc` - would have been a good test. Also, can't find a way to display progress with `cp` or `scp`.
Looking at `top`, yea rsync seems to be a hog..
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 4990 root 15 0 5408 2016 1312 S 50.3 0.2 0:38.74 rsync 4992 root 25 0 5120 1152 768 R 46.1 0.1 0:35.36 rsync
What do you think? Any advice on what else I can try?
You're just not going to get 30 MB/sec on an NV+ with rsync. I get about 4 MB/sec on my rsync backup jobs (which uses the daemon method) - remote source is my Pro-6. So I think the results you are getting are normal.
Eirik in the original post says he got 7.5 MB/sec, but that was his only post (ever) so we can't follow up with him. But from the script, it appears that he built SSL, which isn't relevant if you don't use encryption. We don't know anything about his network setup, or how much memory was in his NAS. You could perhaps enable jumbo frames and see if you get any improvement.
Apart from that I have no suggestions.
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
