NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Slow rsync between esata and /data
Because I do not have a Gigabit Switch so I thought I'd transfer data from my external HDD (NTFS) drives to /data with rsync (all done on the NAS by ssh into the NAS as root and run the command), but ...
The CPU is simply saturated by using the combination of (full-)rsync and ntfs
%Cpu(s): 32.3 us, 55.7 sy, 0.0 ni, 0.0 id, 5.0 wa, 0.0 hi, 7.0 si, 0.0 st
5.0% waiting => theres not much time spent waiting on the disk, your not I/O Bound
the nas is spending roughly 1/3 of its time in each rsync process, and in the ntfs process
ntfs performance is cpu bound in the linux implementation, AFAIK. I simply think that code isn't very optimized (and hard to do, as they had to reverse engineer it. If i recall correctly, ntfs still involves userspace parts, which means there is a lot of kernel-userspace-kernel transition needed.)
rsync does heavy-checksumming on default, to see which parts of a file might have changed.
You're using rsync from the webgui as abackup job? then i think you can't modify the options...
if you can, try "--sizes-only". This will degrade rsync to a copy, that will assume files haven't changed when they're the same size in destination as in source, but this should speed up the process quite a bit...
%Cpu(s): 32.3 us, 55.7 sy, 0.0 ni, 0.0 id, 5.0 wa, 0.0 hi, 7.0 si, 0.0 st
5.0% waiting => theres not much time spent waiting on the disk, your not I/O Bound
the nas is spending roughly 1/3 of its time in each rsync process, and in the ntfs process
ntfs performance is cpu bound in the linux implementation, AFAIK. I simply think that code isn't very optimized (and hard to do, as they had to reverse engineer it. If i recall correctly, ntfs still involves userspace parts, which means there is a lot of kernel-userspace-kernel transition needed.)
rsync does heavy-checksumming on default, to see which parts of a file might have changed.
You're using rsync from the webgui as abackup job? then i think you can't modify the options...
if you can, try "--sizes-only". This will degrade rsync to a copy, that will assume files haven't changed when they're the same size in destination as in source, but this should speed up the process quite a bit...
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
