NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Rsync, hanging, OS 6,
I have a couple of old Sparc Duos that I am wanting to transfer the data to my new(to me) RN104. One of them has 0.2TB, the other 1.8TB data. I have previously transferred about 80% of the data from ...
The folder timestamps don't really make a difference. Rsync uses the file size and "modified" timestamp to determine if there is a newer file.
I don't think you realize that most of the OS, including rsync, is just Linux, not something Netgear invented, though they have chosen the default options for rsync and given us very little control. From what I can tell those options are -v -8 --timeout=1800 --recursive --links --times --omit-dir-times --devices --specials --one-file-system --modify-window=1 --delete --owner --group --acls --exclude [name of any excluded file here] for an incremental backup with files deleted on target that are deleted on source and one or more files excluded. From your observation, --omit-dir-times must be specified in OS6.x and not OS4.x (why, I have no idea). I never noticed how it behaved regarding directory timestamps when I was still using an OS 4.x device.
If you have SSH enabled, you can use top to see if rsync really is still running and what percentage of CPU it is taking. You may need to add a filter by pressing O, then typing COMMAND=rsync to only show the rsync process(es). If it's using a small amount of CPU time, it's probably going through files it does not need to update. If it's a large percentage, it's probably copying a file. If it's not really running, then something's amiss and you should stop it in Frontview. I do see the CPU time sit at zero for a while when it's running, even when very little else is taking any time, so you have to watch it a while to see that it really is running. I don't quite understand why, but surely it is one of the things that makes an rsync backup take so long.
I would love to have more control over rsync. An RSync Plus app would be one way if they don't want all of the options confusing those who would never use them.
Thanks Sandshark, that makes a lot of sense.
I haven't set SSH up yet so will go away to do that and learn about the top command you mention.
I'll come back with more information after that, but on the basis the HDD lights are still flashing on both drives I'm assuming that the backup job has not yet completed the file comparison process.
I like using rsync, but the job has been running for 96 hours now. There's only 1.6TB data in 5951 files in 1550 folders. That seems quite a bit slower than I remember on the sparc boxes when I thought using the RN104 with the faster processor would run quicker
OK, so I enabled SSH and used Putty to access the RN104.
The rsync job is still running, with CPU usage varying between 0.3% and 84.6%, generally in the range 20% to 35%.
I did notice that there were times when rsync appeared to be using CPU, but the process was not actually running (I was keeping an eye on the running / white highlighted processes too.
Does that look normal ?
I understand that the Readynas uses a linux type o/s (even though it has migrated from ext4 file system) Is there something else I should be looking at to improve the performance. My NAS's are configured using static IP, DNS server settings are from my ISP and the jobs are setup using the IP addresses directly.
I'm really interested in the enhanced Rsync approach you suggest. I am wondering if there is a way to edit the saved backup job directly to utilise the switches we want.
I have decided to balance the space utilisation of my Duos, so when this backup is complete I'll be running a backup using os4, but suspect the quickest way will be a windows timestamp copy so no direct speed comparison, unless I run rsync after the first job.
The backup job is still running, though it now looks as though all files / folders have been copied.
Having enabled SSH, I used puTTY to do a find for files called *backup*
It looks like the backup jobs are stored under /etc/frontview/backup_jobs.conf. I used FTP to get the file to my PC and an example of a backup job is copied below: (IP address part obfuscated)
I am wondering if we can manually customise the rsync operation using the line highlighted in red ?
<backupJob>
<job_id>008</job_id>
<name>Sparenas media to Nas104 (all folders)</name>
<enabled>0</enabled>
<sch_every>24</sch_every>
<sch_start>0</sch_start>
<sch_end>23</sch_end>
<sch_dow>127</sch_dow>
<src_type>remote</src_type>
<src_share_proto>rsync</src_share_proto>
<src_share_vol></src_share_vol>
<src_path>172.16.x.xx::media</src_path>
<src_login></src_login>
<src_password></src_password>
<src_port>0</src_port>
<src_eject>0</src_eject>
<dst_type>share</dst_type>
<dst_share_proto>media</dst_share_proto>
<dst_share_vol>data</dst_share_vol>
<dst_path></dst_path>
<dst_login></dst_login>
<dst_password></dst_password>
<dst_port>0</dst_port>
<dst_eject>0</dst_eject>
<opt_full_backup_freq>FIRST_TIME</opt_full_backup_freq>
<opt_remove_previous_backup>0</opt_remove_previous_backup>
<opt_chown_to_share_owner>0</opt_chown_to_share_owner>
<opt_rsync_options>0</opt_rsync_options>
<opt_email_this_to_alert_email>0</opt_email_this_to_alert_email>
<opt_rsync_exclude></opt_rsync_exclude>
<opt_misc_option>0</opt_misc_option>
<wol_addr></wol_addr>
</backupJob>
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
