NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Rsync - VERY slow file lists
I've been browsing the forum trying to find this answer, but I can't find a definite answer.
I've set up rsync between my Readynas NV+ and Pro 4. I have already synchronized them by manually copying all content from source to destination, but I'm moving one of them to a remote location, so I need to use rsync.
During the first run, sending/receiving the incrementals file list is incredible slow! I'm looking at 5-6 minutes pr. GB when creating the file list. The first share, containing 121gb, took 7 hours and 45 minutes - even though no data was copied, because the content was the same. I tried adding 2gb if data to the source and ran it again, and it finished in 3 minutes, including copying files.
Right now I'm running rsync on another share, containing about 20gb of photos. The two shares is identical, but the job is still running after 2.5 hours sending/receiving file list...
Is rsync using -c (checksum) as default on the ReadyNas? If so, is there any way to disable it to speed up the process? Any other way to speed up the initial process. Need to figure out this before I start sync of my 1.8tb video-archive. :)
I've set up rsync between my Readynas NV+ and Pro 4. I have already synchronized them by manually copying all content from source to destination, but I'm moving one of them to a remote location, so I need to use rsync.
During the first run, sending/receiving the incrementals file list is incredible slow! I'm looking at 5-6 minutes pr. GB when creating the file list. The first share, containing 121gb, took 7 hours and 45 minutes - even though no data was copied, because the content was the same. I tried adding 2gb if data to the source and ran it again, and it finished in 3 minutes, including copying files.
Right now I'm running rsync on another share, containing about 20gb of photos. The two shares is identical, but the job is still running after 2.5 hours sending/receiving file list...
Is rsync using -c (checksum) as default on the ReadyNas? If so, is there any way to disable it to speed up the process? Any other way to speed up the initial process. Need to figure out this before I start sync of my 1.8tb video-archive. :)
3 Replies
- No one?
The last share I ran, containing 416gb of data, took 30 hours. My video-archive is 2947gb. Sure hope someone has some ideas before starting this sync. :) Just to be clear, the source and destinations share are identical, so it's the process of creating file list that's the problem. - A quick update. Just finished synchronizing my video-archive. 2947gb finished in just under 10 days - no data copied, just building the file lists. New runs on the same archive fortunately only takes a few seconds when no data is added.
- I am wondering if the round-trip-time to the remote site is one reason for the slow build time.
Though the other possibility was that rsync was copying. Did you check the logs?
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
