As noted in the introduction to the script set, the backup menus, are exceedingly dynamic. The menus you see will be similar but not identical to the ones in the notes below.
The examples in these notes are taken from the development version Q4 2016, the backup code has had an almost complete rewrite.
There are an awful lot of possible combinations.
In the case of CentOS 7.x, I calculate that as 746,496 possible combinations......
09/11/2016-exp Linux Ver CentOS rel 5.11 kernel 2.6.18-408.el5.centos.plusxen
Default Print Queue := nosystemdefaultdestination
RMcobol Ver 7.10.00 Serial 7H-0063-00000-0016
Data Set := "TestData" {/usr/share/roadtech/Roadrunner}
----- ----- ----- ----- ----- ----- ----- ----- -----
Roadrunner Backup Menu
----- ----- ----- ----- ----- ----- ----- ----- -----
1 Backup live Roadrunner data to POSIX archive.
2 Copy Live Roadrunner data to alternate disk area.
3 Backup data from copy at 20:20:21 on 11/15/16 to POSIX archive.
4 Manual confirmation that the copy at 20:20:21 on 11/15/16 has been copied off of this server.
5 .
6 Print recent RoadRunner backup log.
r Background copy last clone run 13:50:50 11/11/16 to tape.
x Xclone Menu.
----- ----- ----- ----- ----- ----- ----- ----- -----
M Main menu.
----- ----- ----- ----- ----- ----- ----- ----- -----
[ ]
|
See my Backup and Archiving FAQ, for more details.
The scripts endeavour to track the date and time of the last successful backup, for each data set, also whether that backup was to external media or not.
I am not aware of any GPS enable tracking systems for backup media, that would detect when the media was "off site". LTO tape cartridges contain a contact less memory device, but it has a very short range, less than 20mm, it is intended to be used by the drive to record usage details.
Generally tape cartridges intended for use in large automated library systems, have had provision for a label using text and a code39 bar code. Since 2010 HP enterprise has produced a range of labels, for LTO media that incorporates a RFID tag. This is intended to work as part of an asset tracking system, with detectors at key doorways.
RFID tags are also available for DVDs. For USB flash sticks it is possible to have them made with embedded RFID tags, or in the form of a label.
Support matrix for new scripts.
| OS | Target backup media | |||
|---|---|---|---|---|
| Mag Tape | Optical CD/DVD/Bluray | Disk | USB | |
| AIX | Yes | No | Yes? | No |
| CentOS 5.x | Yes | Yes? | Yes? | Yes? |
| CentOS 6.x | Yes? | Yes? | Yes? | Yes? |
| CentOS 7.x | Yes | Yes | Yes | Yes |
| CentOS 8.x | Yes? | Yes? | Yes? | Yes? |
| CentOS Stream | Yes? | Yes? | Yes? | Yes? |
| RHEL 8.x | Yes? | Yes? | Yes? | Yes? |
| Rocky 8.x | Yes? | Yes? | Yes? | Yes? |
| Oracle 8.x | Yes? | Yes? | Yes? | Yes? |
The scripts will detect a number of archive programs, in some cases they will distinguish between versions.
RTadmin/SYSTEM utilities/Show configuration Will report, on both available devices, and installed programs.
| Program | CentOS 7.x | CentOS 6.x | CentOS 5.x | AIX |
|---|---|---|---|---|
| cpio | Yes? | ? | Yes? | Yes |
| sysvcpio | NA | NA | NA | Yes? |
| bsdcpio | Yes? | ? | NA | NA |
| pax | Yes? | ? | Yes? | Yes? |
| spax | Yes? | ? | Yes? | NA |
| opax | Yes? | ? | NA | NA |
If you are interested more details can be found here.
This menu option will only display if you have a plausible target device.
09/11/2016-exp Linux Ver CentOS rel 7.2.1511 kernel 3.10.0-327.36.2.el7.x86_64
Default Print Queue := nosystemdefaultdestination
RMcobol Ver 12.09 Serial 6E-1000-76544-0010
Data Set := "Base data set" {/usr/roadrunner/Base}
There are 3 datasets.
System supports multiple data sets
Do you wish to backup?
----- ----- ----- ----- ----- ----- -----
S /usr/roadrunner/Base
M All data sets.
Q I have changed my mind.
----- ----- ----- ----- ----- ----- -----
|
Menu shows estimated size of backup and the available classes. If there is only one class available menu will be skipped.
09/11/2016-exp Linux Ver CentOS rel 7.2.1511 kernel 3.10.0-327.36.2.el7.x86_64
Default Print Queue := nosystemdefaultdestination
RMcobol Ver 12.09 Serial 6E-1000-76544-0010
Data Set := "Base data set" {/usr/roadrunner/Base}
Quanitty of data to be backed up
IEC units 23,802,857 KiB, 23,245 MeB, 23 GiB.
SI units 24,374,125 kB, 24,375 MB, 25 GB.
There are 3 classes of device available.
Which class of device do you wish to backup to?
----- ----- ----- ----- ----- ----- -----
T Tape Drive - st0
O Optical Drive - sr0 sr1
U USB - sdd sdc sde
D Write archive to /RTstaging rr-backup.%Y.%m.%d_%H%M
Q I have changed my mind.
----- ----- ----- ----- ----- ----- -----
|
If you have a tape drive data can be written direct to the drive.
09/11/2016-exp Linux Ver CentOS rel 5.11 kernel 2.6.18-408.el5.centos.plusxen
Default Print Queue := nosystemdefaultdestination
Please select backup device
----- ----- ----- ----- -----
1 SEAGATE DAT_DAT72-000
Q Quit. Changed my mind
|
In addition to a suitable drive, the scripts have to be able to find enough work space to build the ISO image. The drive and media must have a large enough capacity to hold the image.
May revisit this and look at possibilities to compress the data, and or split data across multiple optical disks.
|
|
Scripts scan attached devices for file systems with an appropriate label. They will not allow the user to overwrite a random attached device. In the example below the drive has a label of "RT_Backup_Monday". They also check that the device is capable of taking a file of the estimated size.
Checking device sizes /dev/sdd vendor SanDisk model Cruzer Blade at 15,633,408 KiB is too small /dev/sdc vendor BUFFALO model HD-PCFU3 at 976,762,584 KiB is possible /dev/sde vendor BUFFALO model HD-PCFU3 at 976,762,584 KiB is possible Remaining devices for consideration sdc sde Considering /dev/sdc Vendor BUFFALO Model HD-PCFU3 Size 953,869 MiB /dev/sdc1 File system type ext4 label RT_Backup_Tuesda Max single file 866,265,236 KiB. formatted as RoadTech backup device /dev/sdc1 is mounted as /opt/RoadTech/mnt/Tuesday Do you wish to use this disk? [yYnN] n Considering /dev/sde Vendor BUFFALO Model HD-PCFU3 Size 953,869 MiB /dev/sde1 File system type ntfs label RT_Backup_Monday Max single file 952,855,624 KiB. formatted as RoadTech backup device /dev/sde1 is mounted as /opt/RoadTech/mnt/Monday Do you wish to use this disk? [yYnN] y Drive is mounted as /opt/RoadTech/mnt/Monday. Reached end of RTselectUSBfilesystemLinux RT_block sde RT_partition RT_udevPartPath /devices/pci0000:00/0000:00:1a.7/usb1/1-4/1-4:1.0/host10/target10:0:0/10:0:0:0/block/sde/sde1 RT_udevPartFS ntfs RT_udevPartLabel RT_Backup_Monday RT_mount /opt/RoadTech/mnt/Monday /opt/RoadTech/mnt/Monday RTselectList2archiveCommand Command used to create backup is :- find ./usr/roadrunner/Base ./usr/roadrunner/data.hwc ./usr/roadrunner/data.blank -print|/usr/bin/spax -w -vd -x pax >/opt/RoadTech/mnt/Monday/rr/rr-backup.2016.11.13_1427/archive Preparing to save 32796 files to device /opt/RoadTech/mnt/Monday/rr/rr-backup.2016.11.13_1427/archive This is the continuation device if required. / Please insert media in device and press RETURN. Commencing backup of header file, plus 32796 data files. Archive program has started Processed 357 of 32797 files (1%).................... Processed 2700 of 32797 files (8%).................... Processed 5063 of 32797 files (15%).................... Processed 7926 of 32797 files (24%).................... Processed 10242 of 32797 files (31%).................... Processed 13847 of 32797 files (42%).................... Processed 23011 of 32797 files (70%).................... Processed 23090 of 32797 files (70%).................... Processed 23172 of 32797 files (70%).................... Processed 23648 of 32797 files (72%).................... Processed 23907 of 32797 files (72%).................... Processed 23935 of 32797 files (72%).................... Processed 23935 of 32797 files (72%).................... Processed 23935 of 32797 files (72%).................... Processed 23935 of 32797 files (72%).................... Processed 23935 of 32797 files (72%).................... Processed 23935 of 32797 files (72%).................... Processed 23935 of 32797 files (72%).................... Processed 23952 of 32797 files (73%).................... Processed 23952 of 32797 files (73%).................... Processed 23970 of 32797 files (73%).................... Processed 23981 of 32797 files (73%).................... Processed 25956 of 32797 files (79%).................... Processed 26701 of 32797 files (81%).................... Processed 30388 of 32797 files (92%).................... Processed 31033 of 32797 files (94%).................... Processed 31034 of 32797 files (94%).................... Processed 31035 of 32797 files (94%).................... Processed 31181 of 32797 files (95%).................... Processed 31343 of 32797 files (95%).................... Processed 31525 of 32797 files (96%).................... Processed 31584 of 32797 files (96%).................... Processed 31608 of 32797 files (96%).................... Processed 31781 of 32797 files (96%).................... Processed 31807 of 32797 files (96%).................... Processed 31824 of 32797 files (97%).................... Processed 32416 of 32797 files (98%)........ Processed 32796 of 32797 files (99%) cleaning up after /usr/bin/spax Finished press RETURN to continue Finished backup to /opt/RoadTech/mnt/Monday/rr/rr-backup.2016.11.13_1427. total 23811397 -rwxrwxrwx. 1 rr rr 467 Nov 3 15:41 header -rwxrwxrwx. 1 rr rr 1365160 Nov 13 14:25 toc -rwxrwxrwx. 1 rr rr 24381501440 Nov 13 14:40 archive -rwxrwxrwx. 1 rr rr 29 Nov 13 14:40 BackupOutcome umount: /opt/RoadTech/mnt/Monday: umount failed: Operation not permitted Error unmounting /dev/sde1 from /opt/RoadTech/mnt/Monday |
RTselectList2archiveCommand Command used to create backup is :- find ./usr/share/roadtech/Roadrunner -print|/usr/bin/bsdcpio -ovB -H pax >/RTstaging/rr/rr-backup.2016.11.13_1501/archive Preparing to save 6504 files to device /RTstaging/rr/rr-backup.2016.11.13_1501/archive This is the continuation device if required. / Please insert media in device and press RETURN. Commencing backup of header file, plus 6504 data files. Archive program has started Processed 1773 of 6505 files (27%)....... cleaning up after /usr/bin/bsdcpio Processed 6505 of 6505 files (100%) Finished press RETURN to continue |
Feature was added back in 1993 for an IBM RS6000 running AIX 3.2 with fast disks, and a comparatativly slow tape drive. It was considerably quicker to copy from the live data on a logical volume in a volume group backed by a SSA connected disk array, to a LV in a second volume group backed with fast/wide SCSI disks. Than to backup direct to the tape drive.
A backup to tape operation would then be run after users had signed back in to RoadRunner. This minimised the period when the application was unavailable.
Modern tape drives are much quicker say 30MB/s rather than 300 KB/s. If you are using solid state drives, or multiple disks in a RAID array it may still be quicker. Even when it is not quicker it may be useful, as it creates a static copy, that may be copied over a moderate speed link to a remote device.
09/11/2016-exp Linux Ver CentOS rel 7.2.1511 kernel 3.10.0-327.36.2.el7.x86_64
Default Print Queue := nosystemdefaultdestination
RMcobol Ver 12.09 Serial 6E-1000-76544-0010
Data Set := "Base data set" {/usr/roadrunner/Base}
Quanitty of data to be backed up
IEC units 150,036 KiB, 147 MeB.
SI units 153,636 kB, 154 MB.
There are 7 copy options available.
Which type do you want?
----- ----- ----- ----- ----- ----- -----
S Rsync to Staging LV (/usr/roadrunner/RTstaging) + /RRcopy
B Rsync to Backup server
C run rrclone.sh
Q I have changed my mind.
----- ----- ----- ----- ----- ----- -----
|
Prerequisite StagingLV mounted, writable, and with sufficent space.
Checking /usr/roadrunner/data.hwc sending incremental file list symlink has no referent: "/usr/roadrunner/data.hwc/AN_X_Change_v1.0.xslt" symlink has no referent: "/usr/roadrunner/data.hwc/AN_X_DelvNote_v1.0.xslt" symlink has no referent: "/usr/roadrunner/data.hwc/AN_X_OrderAck_v1.0.xslt" symlink has no referent: "/usr/roadrunner/data.hwc/AN_X_PreAdviceAck_v1.0.xslt" symlink has no referent: "/usr/roadrunner/data.hwc/AN_X_SplitImport_v1.0.xslt" symlink has no referent: "/usr/roadrunner/data.hwc/AN_X_StockSnapshot_v1.0.xslt" symlink has no referent: "/usr/roadrunner/data.hwc/Firmin_InvoiceGroup_v1.0.xslt" symlink has no referent: "/usr/roadrunner/data.hwc/PREORD.CSV" symlink has no referent: "/usr/roadrunner/data.hwc/SHREWS.CSV" symlink has no referent: "/usr/roadrunner/data.hwc/hazimp.csv" IO error encountered -- skipping file deletion .clonedir .clonestat sent 317904 bytes received 64 bytes 635936.00 bytes/sec total size is 24076015968 speedup is 75718.36 rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1052) [sender=3.0.9] Unable to copy current system !!!!!!!!!!!!! Please inform your systems administrator. |
This menu item will only appear if there is a copy area, and the scripts believe that the copy area contains valid data.
Providing that these conditions are met sub menus are identical, to those for creating a POSIX archive file from the live data.If an off machine backup is performed via the other options on the backup menu the log files are automatically updated to reflect this.
This leaves one rare situation.
|
|