Reply
Topic Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Re: REPLICATE CANNOT INCREMENT LARGE FILES OFFSITE
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
2013-01-03
02:31 AM
2013-01-03
02:31 AM
REPLICATE CANNOT INCREMENT LARGE FILES OFFSITE
I have the following setup.
1. Client has a Duo V2 on site. Latest firmware and drivers and Replicate.
2. Windows 2008 server backup to the onsite NAS (Duo)
3. Backing this up to NAS in data center nightly
Basically this is producing approx 17GB of files (the WindowsImageBackup folder with a number of files including the main ncluding the main 16GB VHD file). Replicate sees these files and copies the WHOLE file up offsite each time. Replicate DOES NOT increment the file with the small amount of changes - even though the file is of the same name. It REMOVES the VHD file then backs up the file again. This will not be possible over the internet.
Also in my testing I have used the onsite NAS as flat file storage - and then Replicate does a wonderful job of copying any changed files to the off site NAS. But it does not increment Windows backups.
My goal would be to do a Windows backup to the NAS - then Replicate this offsite - then if disaster strikes - bring up a VM from the backup.
So my question is for everybody out there - how can I do this. I have spent the money on the hardware and REPLICATE does not do what I need it to do. If I backup flat files to the NAS - then how can I replicate large files off site - for instance a SQL database or an Exchange database.
I have even thought of using Backup Exec - but surely this would create a large set of backup files. Would Replicate only send the changes across - my theory is it will send the whole thing each night which just isn't possible. I even thought about MirrorFolder and mirroring the server drive to the onsite NAS - but there are still going to be some large files (exchange edb) that REPLICATE will struggle with.
Any ideas.......
1. Client has a Duo V2 on site. Latest firmware and drivers and Replicate.
2. Windows 2008 server backup to the onsite NAS (Duo)
3. Backing this up to NAS in data center nightly
Basically this is producing approx 17GB of files (the WindowsImageBackup folder with a number of files including the main ncluding the main 16GB VHD file). Replicate sees these files and copies the WHOLE file up offsite each time. Replicate DOES NOT increment the file with the small amount of changes - even though the file is of the same name. It REMOVES the VHD file then backs up the file again. This will not be possible over the internet.
Also in my testing I have used the onsite NAS as flat file storage - and then Replicate does a wonderful job of copying any changed files to the off site NAS. But it does not increment Windows backups.
My goal would be to do a Windows backup to the NAS - then Replicate this offsite - then if disaster strikes - bring up a VM from the backup.
So my question is for everybody out there - how can I do this. I have spent the money on the hardware and REPLICATE does not do what I need it to do. If I backup flat files to the NAS - then how can I replicate large files off site - for instance a SQL database or an Exchange database.
I have even thought of using Backup Exec - but surely this would create a large set of backup files. Would Replicate only send the changes across - my theory is it will send the whole thing each night which just isn't possible. I even thought about MirrorFolder and mirroring the server drive to the onsite NAS - but there are still going to be some large files (exchange edb) that REPLICATE will struggle with.
Any ideas.......
Message 1 of 5
Labels:
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
2013-01-03
02:56 AM
2013-01-03
02:56 AM
Re: REPLICATE CANNOT INCREMENT LARGE FILES OFFSITE
Can I also add I have just read a post called "Replicating VHD's" by TeknoJnky.....
He asked the same question about VHDs and Netgear advise it IS possible and will only copy over the delta (difference) between the files.
My tests showed the first thing it did was REMOVE the current file, then backup the new file again completely (even though the file name was the same and I only added about 10mb of changes to the 17GB file......
Any ideas.......
He asked the same question about VHDs and Netgear advise it IS possible and will only copy over the delta (difference) between the files.
My tests showed the first thing it did was REMOVE the current file, then backup the new file again completely (even though the file name was the same and I only added about 10mb of changes to the 17GB file......
Any ideas.......
Message 2 of 5
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
2013-01-07
11:26 AM
2013-01-07
11:26 AM
Re: REPLICATE CANNOT INCREMENT LARGE FILES OFFSITE
Yes, I am having a similar problem.
I had a backup job made that was supposed to back up several folders.
I ran it when both servers were connected to the same gigabit switch. The full backup job took 3 hours. Hooray.
Then, I took the one box offsite to my house, plugged it in, and it was taking forever to run, because it was trying to transfer the entire data set again.
So, I "unchecked" a few of the folders and saved the job, and tried to run it again. Now the damn thing has been running for nearly 24 hours, trying to back up ALL of the data again, even though now there are less files being requested to back up.
This Replicate is a royal pain.
Now, both the connection at work, and the connection at home, are slow, because there is so much data being transferred.
Why can't this be easy? Why did I pay for the software if it's extremely difficult to use successfully?
I had a backup job made that was supposed to back up several folders.
I ran it when both servers were connected to the same gigabit switch. The full backup job took 3 hours. Hooray.
Then, I took the one box offsite to my house, plugged it in, and it was taking forever to run, because it was trying to transfer the entire data set again.
So, I "unchecked" a few of the folders and saved the job, and tried to run it again. Now the damn thing has been running for nearly 24 hours, trying to back up ALL of the data again, even though now there are less files being requested to back up.
This Replicate is a royal pain.
Now, both the connection at work, and the connection at home, are slow, because there is so much data being transferred.
Why can't this be easy? Why did I pay for the software if it's extremely difficult to use successfully?
Message 3 of 5
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
2013-01-08
05:56 AM
2013-01-08
05:56 AM
Re: REPLICATE CANNOT INCREMENT LARGE FILES OFFSITE
If it helps wdrumheller - I have tested it with flat files - and they replicate perfectly. As long as you do the first backup with both NAS on the same LAN, then any subsequent replicate jobs offsite will be perfect - it will only send the changed files.
Having said that, original problem still exists - if it does see a difference in a file - it will copy the whole file offsite. Fine is word docs - useless if it is a 10GB backup file...
Netgear have advised me Replicate is 3rd party and they don't develop it - but when I login it says "NETGEAR" all over it. What a cop out from Netgear - and I hope others read this because REPLICATE is not suitable for using one nas as a windows backup target - and then replicating it offsite. It does NOT do this - however I assumed it did looking at the documentation. IT DOESNT. What it does do is mirror one NAS offsite if it has a lot of SMALL files on it. ANY LARGE files and you'll never get them offsite in any kind of window.....
Having said that, original problem still exists - if it does see a difference in a file - it will copy the whole file offsite. Fine is word docs - useless if it is a 10GB backup file...
Netgear have advised me Replicate is 3rd party and they don't develop it - but when I login it says "NETGEAR" all over it. What a cop out from Netgear - and I hope others read this because REPLICATE is not suitable for using one nas as a windows backup target - and then replicating it offsite. It does NOT do this - however I assumed it did looking at the documentation. IT DOESNT. What it does do is mirror one NAS offsite if it has a lot of SMALL files on it. ANY LARGE files and you'll never get them offsite in any kind of window.....
Message 4 of 5
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
2013-02-06
11:40 AM
2013-02-06
11:40 AM
Re: REPLICATE CANNOT INCREMENT LARGE FILES OFFSITE
Rickyhumby, this is exactly right. If you have large files, forget it.
I finally got it to backup my documents, images, and videos, with the servers both on the same LAN. Then, when separated by distance, they still back up perfectly.
However, I have backupexec writing a 400gb backup nightly, and then I try to back up that file (only the bits that have changed) and it has succeed twice in the past month.
So, large files are a pain. It's best to be backing up less than a gigabyte per job. 4 gigabytes is risky. 40 is damn near impossible.
I finally got it to backup my documents, images, and videos, with the servers both on the same LAN. Then, when separated by distance, they still back up perfectly.
However, I have backupexec writing a 400gb backup nightly, and then I try to back up that file (only the bits that have changed) and it has succeed twice in the past month.
So, large files are a pain. It's best to be backing up less than a gigabyte per job. 4 gigabytes is risky. 40 is damn near impossible.
Message 5 of 5