NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Rsync, hanging, OS 6,
I have a couple of old Sparc Duos that I am wanting to transfer the data to my new(to me) RN104. One of them has 0.2TB, the other 1.8TB data. I have previously transferred about 80% of the data from ...
Thanks Sandshark, that makes a lot of sense.
I haven't set SSH up yet so will go away to do that and learn about the top command you mention.
I'll come back with more information after that, but on the basis the HDD lights are still flashing on both drives I'm assuming that the backup job has not yet completed the file comparison process.
I like using rsync, but the job has been running for 96 hours now. There's only 1.6TB data in 5951 files in 1550 folders. That seems quite a bit slower than I remember on the sparc boxes when I thought using the RN104 with the faster processor would run quicker
OK, so I enabled SSH and used Putty to access the RN104.
The rsync job is still running, with CPU usage varying between 0.3% and 84.6%, generally in the range 20% to 35%.
I did notice that there were times when rsync appeared to be using CPU, but the process was not actually running (I was keeping an eye on the running / white highlighted processes too.
Does that look normal ?
I understand that the Readynas uses a linux type o/s (even though it has migrated from ext4 file system) Is there something else I should be looking at to improve the performance. My NAS's are configured using static IP, DNS server settings are from my ISP and the jobs are setup using the IP addresses directly.
I'm really interested in the enhanced Rsync approach you suggest. I am wondering if there is a way to edit the saved backup job directly to utilise the switches we want.
I have decided to balance the space utilisation of my Duos, so when this backup is complete I'll be running a backup using os4, but suspect the quickest way will be a windows timestamp copy so no direct speed comparison, unless I run rsync after the first job.
The backup job is still running, though it now looks as though all files / folders have been copied.
Having enabled SSH, I used puTTY to do a find for files called *backup*
It looks like the backup jobs are stored under /etc/frontview/backup_jobs.conf. I used FTP to get the file to my PC and an example of a backup job is copied below: (IP address part obfuscated)
I am wondering if we can manually customise the rsync operation using the line highlighted in red ?
<backupJob>
<job_id>008</job_id>
<name>Sparenas media to Nas104 (all folders)</name>
<enabled>0</enabled>
<sch_every>24</sch_every>
<sch_start>0</sch_start>
<sch_end>23</sch_end>
<sch_dow>127</sch_dow>
<src_type>remote</src_type>
<src_share_proto>rsync</src_share_proto>
<src_share_vol></src_share_vol>
<src_path>172.16.x.xx::media</src_path>
<src_login></src_login>
<src_password></src_password>
<src_port>0</src_port>
<src_eject>0</src_eject>
<dst_type>share</dst_type>
<dst_share_proto>media</dst_share_proto>
<dst_share_vol>data</dst_share_vol>
<dst_path></dst_path>
<dst_login></dst_login>
<dst_password></dst_password>
<dst_port>0</dst_port>
<dst_eject>0</dst_eject>
<opt_full_backup_freq>FIRST_TIME</opt_full_backup_freq>
<opt_remove_previous_backup>0</opt_remove_previous_backup>
<opt_chown_to_share_owner>0</opt_chown_to_share_owner>
<opt_rsync_options>0</opt_rsync_options>
<opt_email_this_to_alert_email>0</opt_email_this_to_alert_email>
<opt_rsync_exclude></opt_rsync_exclude>
<opt_misc_option>0</opt_misc_option>
<wol_addr></wol_addr>
</backupJob>That appears to only store the configurations you have chosen from those available rather than letting you add your own. Basically, it's what gets displayed on the various tabs of the backup options. On my job that deletes file on target that are deleted on source, opt_rsync_options is a one where yours is a zero.
Thanks for the reply Stephen. :smileyhappy:
I am a bit confused as I posted this message, went back to edit it to put the firmware versions in and it then seemed to disappear off the forum listing, so I made another https://community.netgear.com/t5/Using-your-ReadyNAS/Rsync-hanging-OS-6/m-p/1241702#M126140 which Sandshark has contributed to. I don't know what happened, so could I ask that you merge the threads.
Back on topic:
Yes I made sure the raid sync was complete before I started populating the Nas_104. When I bought it it had a single 2TB disk as JBOD. I added one disk which made it degraded, then Raid 1 which took about 3 hours. Adding the third disk made it degraded again, changed to Raid 5 and the rebuild took 17 hours following which a reboot expanded the volume.
As of now the job has been running for 124 hours, the backup job is still showing as in progress, all data / folders have been replicated and there is no backup log available.
Before running this job I did run another, smaller job which transferred around 120MB data through Rsync with a reported transfer rate of 4.8kb / s (bits, not Bytes, just to be clear)
Having decided I have sufficient patience to let the job continue running I have also created another rsync job on my second Duo, transferring 665MB from Duo1 to Duo2 (none of this date is on Duo2). As of now that job has been running for 30 hours, is 70% complete with a throughput rate of 4.5kb /s
All three NAS's are on the same Netgear switch.
This is a home setup so very simple from a security perspective as I only have one user group and one user, both admin as you have recommended.
I'm glad you have also seen the folder date problem. One the one hand it may not be critical, but on the other the whole idea of a copy is that it is an exact copy, not a copy with a few pieces of information changed. Running the second job from the Duo2 will also allow me to confirm that OS4 works as I remember.
I have done a bit of digging and found the backup_jobs.conf file and on Sandsharks suggestion I believe that OS 6 is specifying --omir-dir-times parameter in the rsync process, which is different to OS4. I was hoping to be able to manually force the desired flags into the conf file, but am now coming to the view that there is another file which references the conf file for backup variables, with -o being specified in that core file. I have a little experience with Linux / unix so gues that other file will be compiled and in the bin or sbin directories ??
It would also be nice if the backup jobs had some sort of progress indicator, and I see you have had that request in for some time already
Thanks for any further suggestions or advice
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
