Difference between revisions of "BXadmin:AFS Backups"

From CCGB
Jump to: navigation, search
Line 39: Line 39:
 
** '''vosbackup-by-path''' : List of path regexes to vos backup
 
** '''vosbackup-by-path''' : List of path regexes to vos backup
 
** '''vosbackup-by-volume''' : List of volume regexes to vos backup
 
** '''vosbackup-by-volume''' : List of volume regexes to vos backup
 +
 +
== cron ==
 +
Call all scripts with ''k5start -t -U -f <path/to/keytab>''
 +
 +
* '''daily-findmounts.sh''' - calls afs-backup.pl in find-mounts mode. logic for determining which paths to traverse is in the script itself
 +
* '''daily-vosbackup.sh''' - calls afs-backup.pl in vosbackup mode.
 +
* '''daily-tsm.sh''' - calls afs-backup.pl in tsm mode.

Revision as of 12:04, 31 March 2010

afs-backup.pl and associated scripts are here: http://github.com/phalenor/afs-backup

Installed into /afs/bx.psu.edu/service/afs-backup

Should probably make that /afs/bx.psu/edu/service/afs/backup ?

Testing directory is under testing/, with testing/etc/ -> etc/ and testing/var/ -> var/

Directory layout

  • var/
    • acl/
      • <volume name> - contains acls for that volume
    • log/ - contains dsmc logs right now
    • mounts/
      • mounts-by-path
      • mounts-by-volume
    • tmp/
    • vldb/
      • vldb.<date> - these should be routinely gzip'd
  • etc/
    • common/ - config files common to all backup hosts
    • hosts/
      • <short hostname>/ - config files for <short hostname>

Config files

  • basepath : Usually /afs/<cell>. This is used if paths specified in *-by-path files aren't relative
  • tsm mode
    • tsm-backup-tmp-mount-path : Absolute path to a temporary directory in AFS to mount root.cell.backup
    • dsm.sys.head : The top of the dsm.sys file to be generated
    • exclude.list : TSM exclude file
    • tsm-backup-by-path : List of path regexes to backup. Can prefix entries with ! to explicitly exclude.
    • tsm-backup-by-volume : List of volume regexes to backup. Can prefix entries with ! to explicitly exclude.
    • tsm-policy-by-path : List of path regexes and the TSM management class to bind those paths to, separated by whitespace
    • tsm-policy-by-volume : List of volume regexes and the TSM management class to bind the shortest mountpoint for those volumes (by number of characters) to, separated by whitespace
    • tsm-policy-default : Default management class to be used
    • tsm-policy-order : Order in which to select management class. Can be either "path volume" or "volume path"
  • vosbackup mode
    • vosbackup-by-path : List of path regexes to vos backup
    • vosbackup-by-volume : List of volume regexes to vos backup

cron

Call all scripts with k5start -t -U -f <path/to/keytab>

  • daily-findmounts.sh - calls afs-backup.pl in find-mounts mode. logic for determining which paths to traverse is in the script itself
  • daily-vosbackup.sh - calls afs-backup.pl in vosbackup mode.
  • daily-tsm.sh - calls afs-backup.pl in tsm mode.