Which backup method?

Sandshark wrote:

here is the script I run on my backup machine:

Mine is more complicated and runs as a service.  This runs on both the primary NAS (MainNasIP in the script) and the backups.    There is some unusual syntax which was needed to get it to run on both the v1 and OS-6 NAS.

There is an alternative method used to create the logs on the NV+ and Duo v1 that is triggered if rnutil does not exist on the NAS.  It's not exactly the same as the actual log zip, but it is close enough.

#!/bin/sh
#
# set up some useful variables
#
MainNasIP=10.0.0.15
NasIP=`exec hostname -i | awk -F " " '{print $NF}'`
RemoteShareName=Logs
test "$MainNasIP" != "$NasIP" \
   && { ShareName=LocalLogs; \
      Retention=7; } \
   || ShareName=Logs; \
test -e /usr/bin/rnutil && LogShare=/data/$ShareName || LogShare=/c/$ShareName
LogFolder=$LogShare/$(hostname)
HDSentinel=/apps/HDSentinel/HDSentinel
timestamp="$(date +%Y%m%d_%H%M%S)"
RsyncFilter="--include=$(date +%Y)/ --include=$(date +%Y-%m)/*** --exclude=*";
test -e /usr/bin/rnutil && RshParm=-rsh=rsh
#
# make output folder if not there
#
test -d $LogFolder || mkdir $LogFolder
#
# Save Logs in /Logs/hostname/year/year-month
# build the longer folder name in two steps, so mkdir works
#
LogFolder=$LogFolder/$(date +%Y);
test -d $LogFolder || mkdir $LogFolder;
LogFolder=$LogFolder/$(date +%Y-%m);
test -d $LogFolder || mkdir $LogFolder;
#
# get system logs with rnutil on OS-6, otherwise zip /var/logs
# rnutil will create an empty file named "1" in its folder; which is harmless. But let's delete it anyway
# get smartctl data (somewhat different command for OS-6 than OS-4)
#
test -e /usr/bin/rnutil \
   && { rnutil create_system_log -o $LogFolder/$(hostname)-$timestamp-System.zip;\
      rm ./1;\
      for i in a b c d e f g h i j k l m n; do smartctl -a -x -l defects /dev/sd${i} | egrep -v "local build|No such device|smartmontools"; done >>$LogFolder/$(hostname)-$timestamp-Smart.log; }\
   || { /apps/Scripts/diag >/tmp/diagnostics.log;\
      /apps/Scripts/90_CreateLogs;\
      zip -r -j $LogFolder/$(hostname)-$timestamp-System.zip /ramfs/log_zip/*;\
      test -d /ramfs/log_zip && rm -rf /ramfs/log_zip;\
      test -e /tmp/diagnostics.log && rm /tmp/diagnostics.log;\
      for i in a b c d e f g h i j k l m n; do smartctl -a -x /dev/hd${i} | egrep -v "local build|No such device|smartmontools"; done >>/$LogFolder/$(hostname)-$timestamp-Smart.log; }
#
# log HDsentinel info if present
#
test -e $HDSentinel && $HDSentinel -r $LogFolder/$(hostname)-$timestamp-HDSentinel
#
# Apply retention limits if variable set
#
test "$Retention" != "" && find $LogShare/$(hostname)/* -mtime +$Retention -exec rm {} \; 
test "$Retention" != "" && find $LogShare/$(hostname) -type d -empty -delete
#
# rsync logs to the main NAS if this is a backup NAS
# this requires that rsync be enabled as read-write on the destination share.
# retention is not being applied to the destination share
#
test "$MainNasIP" != "$NasIP" && rsync $RshParm -amv $RsyncFilter $LogShare/$(hostname)/* $MainNasIP::$RemoteShareName/$(hostname)
exit 0

update_logs.service is

[Unit]
Description=Capture Logs Service
After=network-online.target multi-user.target

[Service]
Type=oneshot
RemainAfterExit=no
ExecStart=/apps/Scripts/update_logs

[Install]
WantedBy=multi-user.target

and update_logs.timer

[Unit]
Description=Capture Logs Service

[Timer]
OnCalendar=*-*-* 22:59:00
Unit=update_logs.service

[Install]
WantedBy=multi-user.target

Thanks to both of you for your backup scripts, I will check them out in detail and see what I want to do.

One more question. in the front view there is a backup log that shows up after the backup is complete, which shows every file that was backedup.  Do either of you know where that file is created and updated while the backup is in progress?

Dewdman42 wrote:

Do either of you know where that file is created and updated while the backup is in progress?

The backup logs are in /var/log/frontview/backup/

yea I look at those already but those are not the same logs shown in front view.  At the end of backup front view log shows a bunch of information about the time and date of the backup and also shows a line for every file that was backed up.  That information is not contained in /var/log/frontview/backup/ anywhere that I have been able to find.

Dewdman42 wrote:

That information is not contained in /var/log/frontview/backup/ anywhere that I have been able to find.

Did you look in the backup_XXX_copy.XXXXXXXXXX.log files?

The last field is an epoch timestamp, you can convert it to human-readable time using https://www.epochconverter.com/ 

The linux date command will also convert it. (date -d @XXXXXXXXXX)

FWIW, I don't think the info you see in Frontview is coming from one file.  I think it is assembled, and the specifics might depend on what protocol you are using for backup. 

With rsync backup, I think I normally just see what is in backup_XXX.log in Frontview.  But I don't look there much, as my backup NAS are almost always powered down.