Difference between revisions of "BXadmin:AFS Backups"
From CCGB
(Created page with 'afs-backup.pl and associated scripts are here: http://github.com/phalenor/afs-backup Installed into /afs/bx.psu.edu/service/afs-backup Should probably make that /afs/bx.psu/edu…') |
|||
| (5 intermediate revisions by one other user not shown) | |||
| Line 7: | Line 7: | ||
Testing directory is under testing/, with testing/etc/ -> etc/ and testing/var/ -> var/ | Testing directory is under testing/, with testing/etc/ -> etc/ and testing/var/ -> var/ | ||
| − | Directory layout | + | == Directory layout == |
* var/ | * var/ | ||
| Line 19: | Line 19: | ||
** vldb/ | ** vldb/ | ||
*** vldb.<date> - these should be routinely gzip'd | *** vldb.<date> - these should be routinely gzip'd | ||
| + | * etc/ | ||
| + | ** common/ - config files common to all backup hosts | ||
| + | ** hosts/ | ||
| + | *** <short hostname>/ - config files for <short hostname> | ||
| + | |||
| + | == Config files == | ||
| + | * '''basepath''' : Usually /afs/<cell>. This is used if paths specified in *-by-path files aren't relative | ||
| + | * tsm mode | ||
| + | ** '''tsm-backup-tmp-mount-path''' : Absolute path to a temporary directory in AFS to mount root.cell.backup | ||
| + | ** '''dsm.sys.head''' : The top of the dsm.sys file to be generated | ||
| + | ** '''exclude.list''' : TSM exclude file | ||
| + | ** '''tsm-backup-by-path''' : List of path regexes to backup. Can prefix entries with ''!'' to explicitly exclude. | ||
| + | ** '''tsm-backup-by-volume''' : List of volume regexes to backup. Can prefix entries with ''!'' to explicitly exclude. | ||
| + | ** '''tsm-policy-by-path''' : List of path regexes and the TSM management class to bind those paths to, separated by whitespace | ||
| + | ** '''tsm-policy-by-volume''' : List of volume regexes and the TSM management class to bind ''the shortest mountpoint for those volumes (by number of characters) to, separated by whitespace | ||
| + | ** '''tsm-policy-default''' : Default management class to be used | ||
| + | ** '''tsm-policy-order''' : Order in which to select management class. Can be either "path volume" or "volume path" | ||
| + | * vosbackup mode | ||
| + | ** '''vosbackup-by-path''' : List of path regexes to vos backup | ||
| + | ** '''vosbackup-by-volume''' : List of volume regexes to vos backup | ||
| + | |||
| + | == cron == | ||
| + | Call all scripts with ''k5start -t -U -f <path/to/keytab> <script>'' | ||
| + | |||
| + | * '''daily-findmounts.sh''' - calls afs-backup.pl in find-mounts mode. logic for determining which paths to traverse is in the script itself | ||
| + | * '''daily-vosbackup.sh''' - calls afs-backup.pl in vosbackup mode. | ||
| + | * '''daily-tsm.sh''' - calls afs-backup.pl in tsm mode. | ||
| + | |||
| + | |||
| + | == See Also == | ||
| + | * [[bxa:Tape Backups]] | ||
Latest revision as of 11:35, 29 October 2012
afs-backup.pl and associated scripts are here: http://github.com/phalenor/afs-backup
Installed into /afs/bx.psu.edu/service/afs-backup
Should probably make that /afs/bx.psu/edu/service/afs/backup ?
Testing directory is under testing/, with testing/etc/ -> etc/ and testing/var/ -> var/
Contents
Directory layout
- var/
- acl/
- <volume name> - contains acls for that volume
- log/ - contains dsmc logs right now
- mounts/
- mounts-by-path
- mounts-by-volume
- tmp/
- vldb/
- vldb.<date> - these should be routinely gzip'd
- acl/
- etc/
- common/ - config files common to all backup hosts
- hosts/
- <short hostname>/ - config files for <short hostname>
Config files
- basepath : Usually /afs/<cell>. This is used if paths specified in *-by-path files aren't relative
- tsm mode
- tsm-backup-tmp-mount-path : Absolute path to a temporary directory in AFS to mount root.cell.backup
- dsm.sys.head : The top of the dsm.sys file to be generated
- exclude.list : TSM exclude file
- tsm-backup-by-path : List of path regexes to backup. Can prefix entries with ! to explicitly exclude.
- tsm-backup-by-volume : List of volume regexes to backup. Can prefix entries with ! to explicitly exclude.
- tsm-policy-by-path : List of path regexes and the TSM management class to bind those paths to, separated by whitespace
- tsm-policy-by-volume : List of volume regexes and the TSM management class to bind the shortest mountpoint for those volumes (by number of characters) to, separated by whitespace
- tsm-policy-default : Default management class to be used
- tsm-policy-order : Order in which to select management class. Can be either "path volume" or "volume path"
- vosbackup mode
- vosbackup-by-path : List of path regexes to vos backup
- vosbackup-by-volume : List of volume regexes to vos backup
cron
Call all scripts with k5start -t -U -f <path/to/keytab> <script>
- daily-findmounts.sh - calls afs-backup.pl in find-mounts mode. logic for determining which paths to traverse is in the script itself
- daily-vosbackup.sh - calls afs-backup.pl in vosbackup mode.
- daily-tsm.sh - calls afs-backup.pl in tsm mode.
