//
× We are currently experience some connectivity issues related to apps.readynas.com.Check for Updates.
× We are experiencing an outage of our ReadyCloud service and are working to resolve the issue..
× ReadyNAS Board Restructure - Complete - Please Read and Comment
× Nighthawk Pro Gaming is Streaming Live on Twitch! Live Q&A with the NPG Team and our Sponsors! (watch now…)
NETGEAR ® COMMUNITY
  • Downloads
  • MyNETGEAR
  • Community
  • Support
  • Netgear
  • United States
    • 中国 (汉语)
    • Deutschland (Deutsch)
    • España (Español)
    • France (Français)
    • Italia (Italiano)
    • 日本 (日本語)
    • Netherlands (Dutch)
    • Sweden (Svenska)
    • United States (English)
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
  • English
  • /
  • NETGEAR Forum
  • /
  • Business Solutions
  • /
  • ReadyNAS Network Storage
  • /
  • New ReadyNAS Users & General Discussion
  • /
  • ReadyNAS DR taking too long with IBM domino databa...
Log In
Join Now
  • Community Home
  • Community Browser:
  • NETGEAR Website
  • Support
  • Downloads
  • MyNETGEAR
Log In
  • English
  • /
  • NETGEAR Forum
  • /
  • Business Solutions
  • /
  • ReadyNAS Network Storage
  • /
  • New ReadyNAS Users & General Discussion
  • /
  • ReadyNAS DR taking too long with IBM domino databa...
  • Join Now
  • |
  • Log In
  • |
  • Help

Start a New Discussion

Discussion stats
  • 5 replies
  • ‎2019-10-22 07:26 PM
  • 238 views
  • 2 kudos
  • 2 in conversation
    • StephenB
    • denz09
Announcements

Networking Deals Guide for Business and SoHo

Enabling Next-Gen AV over IP Networks - Analyst Day 2019

Cost effective network deployment for small business #Webinar 11/6

New Managed M4300 Fiber and PoE Switches #Webinar

Let us help with AV-over-IP proavdesign@NETGEAR.com

Evolution of PoE #NowAtNETGEAR

Insight 5.7 Features #Webinar

NETGEAR Business Produces and Services @ IFA2019 Berlin

Insight 5.7 Update Now Available

Ethernet Splitter Vs. Ethernet Switch

New Small Remote Managed PoE Switches GC108P & GC108PP

NETGEAR Insight Pro Network Management System enables higher profitability for Resellers

Top Contributors
User Count
StephenB
Guru StephenB Guru
18
Sandshark
Sandshark Master
5
bedlam1
bedlam1 Prodigy
2
schumaku
schumaku Sensei
1
fastfwd
fastfwd Virtuoso
1
See All
Latest ReadyNAS Community News:
Reply
Topic Options
  • Subscribe to RSS Feed
  • Mark Topic as New
  • Mark Topic as Read
  • Float this Topic for Current User
  • Bookmark
  • Subscribe
  • Printer Friendly Page
  • All forum topics
  • Previous Topic
  • Next Topic
denz09
denz09 Aspirant
Aspirant
  • Mark as New
  • Bookmark
  • Subscribe
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content
‎2019-10-22 07:26 PM
‎2019-10-22 07:26 PM

ReadyNAS DR taking too long with IBM domino databases

I would like to know is there going to be improvement with ReadyDR copying IBM Domino nsf files because it doesn't seem to copy just a change it copies everything because every backup is taking 7 hours. 

 

The same thing is happening when I use readynas share to store vhdx file that I use for windows server backup it is taking days to backup up instead of change which shouldn't be that much it is copying everything so either I have something configured wrong or that is just how it is. 

 

Apreciate feedback 

Solved! Go to Solution.

Model: ReadyNAS-3100|ReadyNAS-3100
Message 1 of 6
screenshot of dr history.JPG ‏97 KB
0 Kudos
Reply

Accepted Solutions
StephenB
Guru StephenB Guru
Guru
  • Mark as New
  • Bookmark
  • Subscribe
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content
‎2019-10-23 08:12 AM
‎2019-10-23 08:12 AM

Re: ReadyNAS DR taking too long with IBM domino databases


@denz09 wrote:

In the readynas backup I have created a job to copy the files from the server to the share and then it gets a daily snapshot and gets transferred over readydr. 

 


That explains the problem.  Even if you use rsync in the backup job to do incremental backups, it will copy the entire file if something in it changes.  So if one block in NSF file changes, the backup job copies the entire file again.  ReadyDR (and btrfs snapshots generally) will treat the entire file as new - so they will also copy the entire file.

 

There is an option in rsync that uses checksums on each 2kb block, and that will only rewrite changed blocks in the nsf file.  But that option isn't used in the ReadyNAS backup jobs.  If the domino server is running linux, you could try running rsync with that option on it, instead of using the NAS backup job. Or you could try using ssh and running rsync manually on the ReadyNAS.  If that works, you could create your own cron job to do the domino->readynas backup.

 

I don't know of any good way to handle this if the domino server (or host of the vhdx files) is running windows.  I guess you could write a utility that compares two files, and re-writes blocks on the destination that differ.

 

No matter how you do it, if you only update changed blocks on the NAS you will end up with fragmented files.  And if they are defragmented, then the entire file will (again) be treated as new.  So you should probably turn off auto-defrag on the shares holding these files, and run scheduled defrags using the volume page setting.

 

 

 

 

View solution in original post

Message 4 of 6
1 Kudo
Reply

All Replies
StephenB
Guru StephenB Guru
Guru
  • Mark as New
  • Bookmark
  • Subscribe
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content
‎2019-10-22 10:39 PM
‎2019-10-22 10:39 PM

Re: ReadyNAS DR taking too long with IBM domino databases


@denz09 wrote:

I would like to know is there going to be improvement with ReadyDR copying IBM Domino nsf files because it doesn't seem to copy just a change it copies everything because every backup is taking 7 hours. 

 

The same thing is happening when I use readynas share to store vhdx file that I use for windows server backup ...

 

Appreciate feedback 


ReadyDR is built on the snapshot feature of BTRFS.  It is incremental in the sense that it will only copy blocks that were written since the previous backup.  But it isn't copying differences from the original file.  That is, if a block is rewritten with the same data it had before, it will be copied again.  

 

So how much data is transfered depends on the details on how the file on the NAS is updated. If the domino server is directly updating the NSF file on the NAS, then only those updated blocks will be transfered with ReadyDR.  But if a backup process is copying the full updated NSF file from the domino server to the NAS, then ReadyDR will transfer the entire file - even if the updated file is identical to the original that was already on the NAS.  

 

Another scenario: if the file is defragmented, then the full file is re-written by the file system.  So again, the full file would end up transfered by ReadyDR.

Message 2 of 6
1 Kudo
Reply
denz09
denz09 Aspirant
Aspirant
  • Mark as New
  • Bookmark
  • Subscribe
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content
‎2019-10-22 11:16 PM
‎2019-10-22 11:16 PM

Re: ReadyNAS DR taking too long with IBM domino databases

Thank you for the feedback.

 

I will explain how it is set up so maybe I did it wrong way. IBM now HCL Domino is located on the server and everynight it gets shut down for few hours for the backup. In the readynas backup I have created a job to copy the files from the server to the share and then it gets a daily snapshot and gets transferred over readydr. 

 

 

Message 3 of 6
0 Kudos
Reply
StephenB
Guru StephenB Guru
Guru
  • Mark as New
  • Bookmark
  • Subscribe
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content
‎2019-10-23 08:12 AM
‎2019-10-23 08:12 AM

Re: ReadyNAS DR taking too long with IBM domino databases


@denz09 wrote:

In the readynas backup I have created a job to copy the files from the server to the share and then it gets a daily snapshot and gets transferred over readydr. 

 


That explains the problem.  Even if you use rsync in the backup job to do incremental backups, it will copy the entire file if something in it changes.  So if one block in NSF file changes, the backup job copies the entire file again.  ReadyDR (and btrfs snapshots generally) will treat the entire file as new - so they will also copy the entire file.

 

There is an option in rsync that uses checksums on each 2kb block, and that will only rewrite changed blocks in the nsf file.  But that option isn't used in the ReadyNAS backup jobs.  If the domino server is running linux, you could try running rsync with that option on it, instead of using the NAS backup job. Or you could try using ssh and running rsync manually on the ReadyNAS.  If that works, you could create your own cron job to do the domino->readynas backup.

 

I don't know of any good way to handle this if the domino server (or host of the vhdx files) is running windows.  I guess you could write a utility that compares two files, and re-writes blocks on the destination that differ.

 

No matter how you do it, if you only update changed blocks on the NAS you will end up with fragmented files.  And if they are defragmented, then the entire file will (again) be treated as new.  So you should probably turn off auto-defrag on the shares holding these files, and run scheduled defrags using the volume page setting.

 

 

 

 

View solution in original post

Message 4 of 6
1 Kudo
Reply
denz09
denz09 Aspirant
Aspirant
  • Mark as New
  • Bookmark
  • Subscribe
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content
‎2019-10-24 06:22 PM
‎2019-10-24 06:22 PM

Re: ReadyNAS DR taking too long with IBM domino databases

Thank you for that detailed reply that has given me something else to think about and try. Unfortunately Domino is on the Windows server.

 

It is disappointing why netgear is abandening readyshare replicate which was a supperior service with an inferior service it just doesn't make sence. 

Message 5 of 6
0 Kudos
Reply
denz09
denz09 Aspirant
Aspirant
  • Mark as New
  • Bookmark
  • Subscribe
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content
‎2019-11-07 11:54 PM
‎2019-11-07 11:54 PM

Re: ReadyNAS DR taking too long with IBM domino databases

For users that have domino now it is HCL Domino I have enabled DAOS but after some reading it is only for new attachments and have now added the following command Compact -c -daos on mail file name and it has reduced the size of the nsf file. Now the backup has gone from 6 hours to 2 hours and there are still few more databases to go which will probable reduce it well under an hour. 

 

 

Message 6 of 6
0 Kudos
Reply
  • All forum topics
  • Previous Topic
  • Next Topic
Need More Help?
  • Contact Support
  • About Us
  • Investor Relations
  • Contact us
  • Careers
  • Sign Up
  • United States
    • 中国 (汉语)
    • Deutschland (Deutsch)
    • España (Español)
    • France (Français)
    • Italia (Italiano)
    • 日本 (日本語)
    • Netherlands (Dutch)
    • Sweden (Svenska)
    • United States (English)

© 1996-2019 NETGEAR®