Difference between revisions of "BXadmin:SAM-QFS Testing"

From CCGB
Jump to: navigation, search
 
(8 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
= testing setup =
 +
 
/dev/dsk/c1t1d0 = LUN 13 in esxi host group on ds4200, 1TB
 
/dev/dsk/c1t1d0 = LUN 13 in esxi host group on ds4200, 1TB
  
Line 8: Line 10:
  
 
= notes/commands =
 
= notes/commands =
−
equipment types (mcf):
+
== commands ==
 +
* Create filesystem: '''sammkfs <fs>'''
 +
* fs info: '''samfsinfo <fs>'''
 +
* '''sam-fsd''' Check mcf, defaults.conf, diskvols.conf file for correctness
 +
* '''samd config''' Initialize environment and apply changes to mcf, etc.
 +
 
 +
== equipment types (mcf) ==
 
* ms = fs with archiving, data + metadata on same device. only accepts md types
 
* ms = fs with archiving, data + metadata on same device. only accepts md types
 
* ma = fs with archiving, data and metadata on separate devices,  
 
* ma = fs with archiving, data and metadata on separate devices,  
Line 15: Line 23:
 
* mr = striped or RR device for storing data, uses SAU
 
* mr = striped or RR device for storing data, uses SAU
 
* gxxx = stripe groups, 0..127
 
* gxxx = stripe groups, 0..127
 +
 +
== allocation schemes ==
 +
http://wikis.sun.com/display/SAMQFSDocs51/File+System+Design+Basics#FileSystemDesignBasics-DualandSingleAllocationSchemes
 +
* md : small = 4KB, large = DAU = 64KB, can be 16, 32, or 64
 +
* mm : small = 4KB, large = 16KB
 +
 
= files =
 
= files =
 
== /etc/opt/SUNWsamfs/mcf ==
 
== /etc/opt/SUNWsamfs/mcf ==
Line 27: Line 41:
 
/dev/dsk/c1t1d0s2              11              md              samfs1  on
 
/dev/dsk/c1t1d0s2              11              md              samfs1  on
 
</pre>
 
</pre>
 +
 +
== /etc/vfstab ==
 +
<pre>samfs1  -  /samfs1 samfs  -  yes -</pre>
 +
 +
== /etc/opt/SUNWsamfs/archiver.cmd ==
 +
http://wikis.sun.com/display/SAMQFSDocs51/Configuring+the+Archiver
 +
 +
Archive sets to set AFS namei special files to release_n status:
 +
<pre>no_release_special . -name AFSIDat/.+?/.+?/special/.* -release n
 +
    1 60m
 +
 +
no_release_dotvol . -name \.vol$ -release n
 +
    1 60m
 +
 +
no_release_direntry . -name AFSIDat/.+?/.+?/.+?/.+?/[^+02468ACEGIKMOQSUWYacegikmoqsuwy].+ -release n
 +
    1 60m
 +
 +
no_release_lock . -name Lock.* -release n
 +
    1 60m
 +
 +
no_release_dotfiles . -name ^\.vol.* -release n
 +
    1 60m
 +
</pre>
 +
 +
Disk VSN recycling can only be done by archive set. See sam-recycler(1M). Where vicepa.1 is defined by ''vicepa.1 dk -pool test_pool'',
 +
<pre>params
 +
vicepa.1 -archmax 21474836480
 +
vicepa.1 -unarchage access
 +
vicepa.1 -sort path
 +
vicepa.1 -recycle_mingain 10
 +
vicepa.1 -recycle_minobs 10
 +
</pre>
 +
 +
'''sam-recycler''' should be run by cron. You can specify family_set or archive_set as options to recycle by family/archive set at different intervals.
 +
 +
Maximum tar file size:
 +
<pre>archmax = dk 10737418240</pre>
 +
 +
VSN Pools:
 +
<pre>vsnpools
 +
test_pool dk MD1K-BIG-LZJB-SAMFS1
 +
endvsnpools</pre>
 +
 +
Archive set to VSN assignment:
 +
<pre>vsns
 +
allsets.1 dk -pool test_pool
 +
vicepa.1 dk -pool test_pool
 +
no_release_special.1 dk -pool test_pool
 +
no_release_dotvol.1 dk -pool test_pool
 +
no_release_direntry.1 dk -pool test_pool
 +
no_release_lock.1 dk -pool test_pool
 +
no_release_dotfiles.1 dk -pool test_pool
 +
endvsns</pre>
 +
 +
== /etc/opt/SUNWsamfs/releaser.cmd ==
 +
Specifies directives to sam-releaser, such as how to determine what files to release, age, various weighting metrics. See releaser.cmd(4).
 +
 +
<pre>logfile = /var/log/samfs/releaser.log
 +
rearch_no_release
 +
min_residence_age = 1800</pre>
 +
 +
To apply per-fs, set ''fs = <filesystem>''. fs-specific directives override global directives.
 +
 +
== /etc/opt/SUNWsamfs/diskvols.conf ==
 +
Assignes VSNs to disk volumes.
 +
 +
<pre>MD1K-BIG-LZJB-SAMFS1    /nfs/s3.persephone.bx.psu.edu/md1k-big-lzjb/samfs1</pre>
  
 
= References =
 
= References =
Line 32: Line 113:
 
* http://mail.opensolaris.org/mailman/listinfo/sam-qfs-discuss
 
* http://mail.opensolaris.org/mailman/listinfo/sam-qfs-discuss
 
* http://wikis.sun.com/display/SAMQFSDocs51/Home
 
* http://wikis.sun.com/display/SAMQFSDocs51/Home
 +
* http://wikis.sun.com/display/SAMQFSDocs51/Configuring+the+Archiver
 +
* http://www.williamhathaway.com/wordpress/2007/04/26/qfs-on-top-of-zfs/
 +
* http://hub.opensolaris.org/bin/view/User+Group+qosug/sam-and-zfs

Latest revision as of 13:30, 31 January 2011

testing setup

/dev/dsk/c1t1d0 = LUN 13 in esxi host group on ds4200, 1TB

hostname is fs7, 64-bit, 2vCPU, 1GB RAM, RDM over 4GFC with NPIV, solaris 10u8

SUNWsamfsr = 5.1.4,REV=5.10.2010.04.05

SUNWsamfsu = 5.1.4,REV=5.10.2010.04.05

notes/commands

commands

  • Create filesystem: sammkfs <fs>
  • fs info: samfsinfo <fs>
  • sam-fsd Check mcf, defaults.conf, diskvols.conf file for correctness
  • samd config Initialize environment and apply changes to mcf, etc.

equipment types (mcf)

  • ms = fs with archiving, data + metadata on same device. only accepts md types
  • ma = fs with archiving, data and metadata on separate devices,
  • md = striped or RR using DAU for storing data
  • mm = metadata device. can specify multiple. stored RR if there are multiple by default
  • mr = striped or RR device for storing data, uses SAU
  • gxxx = stripe groups, 0..127

allocation schemes

http://wikis.sun.com/display/SAMQFSDocs51/File+System+Design+Basics#FileSystemDesignBasics-DualandSingleAllocationSchemes

  • md : small = 4KB, large = DAU = 64KB, can be 16, 32, or 64
  • mm : small = 4KB, large = 16KB

files

/etc/opt/SUNWsamfs/mcf

http://wikis.sun.com/display/SAMQFSDocs51/About+the+Master+Configuration+File 

## /etc/opt/SUNWsamfs/mcf
#
# Equipment             Eq      Eq    Family   Device   Additional
# Identifier            Ord     Type    Set     State    Parameters
#-----------            ---     ----   ------   ------   ----------
samfs1                                  10              ms              samfs1  on
/dev/dsk/c1t1d0s2               11              md              samfs1  on

/etc/vfstab

samfs1  -   /samfs1 samfs   -   yes -

/etc/opt/SUNWsamfs/archiver.cmd

http://wikis.sun.com/display/SAMQFSDocs51/Configuring+the+Archiver

Archive sets to set AFS namei special files to release_n status: 

no_release_special . -name AFSIDat/.+?/.+?/special/.* -release n
    1 60m

no_release_dotvol . -name \.vol$ -release n
    1 60m

no_release_direntry . -name AFSIDat/.+?/.+?/.+?/.+?/[^+02468ACEGIKMOQSUWYacegikmoqsuwy].+ -release n
    1 60m

no_release_lock . -name Lock.* -release n
    1 60m

no_release_dotfiles . -name ^\.vol.* -release n
    1 60m

Disk VSN recycling can only be done by archive set. See sam-recycler(1M). Where vicepa.1 is defined by vicepa.1 dk -pool test_pool, 

params
vicepa.1 -archmax 21474836480
vicepa.1 -unarchage access
vicepa.1 -sort path
vicepa.1 -recycle_mingain 10
vicepa.1 -recycle_minobs 10

sam-recycler should be run by cron. You can specify family_set or archive_set as options to recycle by family/archive set at different intervals.

Maximum tar file size: 

archmax = dk 10737418240

VSN Pools: 

vsnpools
test_pool dk MD1K-BIG-LZJB-SAMFS1
endvsnpools

Archive set to VSN assignment: 

vsns
allsets.1 dk -pool test_pool
vicepa.1 dk -pool test_pool
no_release_special.1 dk -pool test_pool
no_release_dotvol.1 dk -pool test_pool
no_release_direntry.1 dk -pool test_pool
no_release_lock.1 dk -pool test_pool
no_release_dotfiles.1 dk -pool test_pool
endvsns

/etc/opt/SUNWsamfs/releaser.cmd

Specifies directives to sam-releaser, such as how to determine what files to release, age, various weighting metrics. See releaser.cmd(4). 

logfile = /var/log/samfs/releaser.log
rearch_no_release
min_residence_age = 1800

To apply per-fs, set fs = <filesystem>. fs-specific directives override global directives.

/etc/opt/SUNWsamfs/diskvols.conf

Assignes VSNs to disk volumes. 

MD1K-BIG-LZJB-SAMFS1    /nfs/s3.persephone.bx.psu.edu/md1k-big-lzjb/samfs1

References

Retrieved from "https://wiki.bx.psu.edu/index.php?title=BXadmin:SAM-QFS_Testing&oldid=1004"