Difference between revisions of "SLab:File System Layout"

From CCGB
Jump to: navigation, search
(→‎Users Directory)
Line 3: Line 3:
  
 
The Schuster Lab's data can be found in the /afs/bx.psu.edu/depot/data/schuster_lab directory.
 
The Schuster Lab's data can be found in the /afs/bx.psu.edu/depot/data/schuster_lab directory.
 +
 +
The volume mounted at this location is RO-replicated. The main purpose of this root data.schuster_lab volume is to contain mounpoints to other volumes, as well as the symlink farm under ''sequencing/''
  
 
= Sequencing Directory =
 
= Sequencing Directory =
Line 10: Line 12:
 
Access to all of the Schuster Lab's sequencing data is through the sequencing directory.  This directory contains archived run directories as well as directories for runs that are currently in progress.
 
Access to all of the Schuster Lab's sequencing data is through the sequencing directory.  This directory contains archived run directories as well as directories for runs that are currently in progress.
  
−
== archive ==
+
Most of the top-level run directories under sequencing/ are symlinks managed by the new symlink management system: http://github.com/phalenor/ssdfs
−
 
 
−
* /afs/bx.psu.edu/depot/data/schuster_lab/sequencing/archive/
 
−
** 454/
 
−
*** by_date/
 
−
*** flat/
 
−
*** by_project/
 
−
** illumina/
 
−
*** by_date/
 
−
*** flat/
 
−
*** by_project/
 
−
 
 
−
The sequencing archive directory contains a read-only archive of all sequencing runs and contains a sub directory for each sequencing platform.  Within each sequencing platform directory, runs are organized by the date the run was started.
 
−
 
 
−
Directory for the 454 R_2010_01_22_16_12_03_FLX11080447_John_ChineseChestnut_Run9 run.
 
−
<pre>
 
−
/afs/bx.psu.edu/depot/data/schuster_lab/sequencing/archive/454/by_date/2010/2010_01_22/R_2010_01_22_16_12_03_FLX11080447_John_ChineseChestnut_Run9
 
−
</pre>
 
−
 
 
−
Directory for the Illumina 100201_HWUSI-EAS610_0006 run.
 
−
<pre>
 
−
/afs/bx.psu.edu/depot/data/schuster_lab/sequencing/archive/illumina/by_date/2010/2010_02_01/100201_HWUSI-EAS610_0006
 
−
</pre>
 
  
 +
SSDFS is not currently capable of delegating commands to normal users, and requires some finesse when executing certain commands due to NFS permissions. Email admin-at-bx.psu.edu if something under sequencing/ doesn't look right.
  
−
In addition, each sequencing platform directory contains a <code>flat/</code> sub directory that contains symbolic links to every run for that platform.
+
Layout:
−
 
+
* /afs/bx.psu.edu/depot/data/schuster_lab/sequencing/
−
<code>flat/</code> directory for the 454 R_2010_01_22_16_12_03_FLX11080447_John_ChineseChestnut_Run9 run.
 
−
<pre>
 
−
/afs/bx.psu.edu/depot/data/schuster_lab/sequencing/archive/454/flat/R_2010_01_22_16_12_03_FLX11080447_John_ChineseChestnut_Run9
 
−
</pre>
 
−
 
 
−
<code>flat/</code> directory for the Illumina 100201_HWUSI-EAS610_0006 run.
 
−
<pre>
 
−
/afs/bx.psu.edu/depot/data/schuster_lab/sequencing/archive/illumina/flat/100201_HWUSI-EAS610_0006
 
−
</pre>
 
−
 
 
−
 
 
−
The <code>by_project/</code> directories can be used to organize all runs for a specific project
 
−
 
 
−
For the chestnut project:
 
−
<pre>
 
−
/afs/bx.psu.edu/depot/data/schuster_lab/sequencing/archive/illumina/by_project/chestnut/runs/100211_HWUSI-EAS610_0005
 
−
</pre>
 
−
 
 
−
== staging and temp ==
 
−
* /afs/bx.psu.edu/depot/data/schuster_lab/sequencing/staging/
 
 
** 454/
 
** 454/
 +
*** $YEAR/
 +
**** $YEAR/$YEAR-$MONTH/
 +
*** incoming/
 
** illumina/
 
** illumina/
−
* /afs/bx.psu.edu/depot/data/schuster_lab/sequencing/temp/
+
*** $YEAR/
−
** 454/
+
**** $YEAR/$RUN_NAME/
−
** illumina
+
*** Instruments/
−
 
+
*** HWUSI-EAS610/
−
The sequencing staging and sequencing temp directories are used to hold sequencing runs that are still being processed (either the run is not finished, or signal processing is being done).
+
*** incoming/
 +
**** illumina-4 -> /nfs/s2.persephone.bx.psu.edu/md1k-4-data/illumina/
 +
**** illumina-5 -> /nfs/s2.persephone.bx.psu.edu/md1k-5-data/illumina/
 +
**** illumina-6 -> /nfs/s2.persephone.bx.psu.edu/md1k-6-data/illumina/
  
 
== support ==
 
== support ==

Revision as of 16:19, 4 October 2010

Schuster Lab Root Directory

  • /afs/bx.psu.edu/depot/data/schuster_lab

The Schuster Lab's data can be found in the /afs/bx.psu.edu/depot/data/schuster_lab directory.

The volume mounted at this location is RO-replicated. The main purpose of this root data.schuster_lab volume is to contain mounpoints to other volumes, as well as the symlink farm under sequencing/

Sequencing Directory

  • /afs/bx.psu.edu/depot/data/schuster_lab/sequencing

Access to all of the Schuster Lab's sequencing data is through the sequencing directory. This directory contains archived run directories as well as directories for runs that are currently in progress.

Most of the top-level run directories under sequencing/ are symlinks managed by the new symlink management system: http://github.com/phalenor/ssdfs

SSDFS is not currently capable of delegating commands to normal users, and requires some finesse when executing certain commands due to NFS permissions. Email admin-at-bx.psu.edu if something under sequencing/ doesn't look right.

Layout:

  • /afs/bx.psu.edu/depot/data/schuster_lab/sequencing/
    • 454/
      • $YEAR/
        • $YEAR/$YEAR-$MONTH/
      • incoming/
    • illumina/
      • $YEAR/
        • $YEAR/$RUN_NAME/
      • Instruments/
      • HWUSI-EAS610/
      • incoming/
        • illumina-4 -> /nfs/s2.persephone.bx.psu.edu/md1k-4-data/illumina/
        • illumina-5 -> /nfs/s2.persephone.bx.psu.edu/md1k-5-data/illumina/
        • illumina-6 -> /nfs/s2.persephone.bx.psu.edu/md1k-6-data/illumina/

support

  • /afs/bx.psu.edu/depot/data/schuster_lab/sequencing/support/
    • 454/
    • illumina/

The sequencing support directory contains manuals, software, and reference genomes used during sequencing and sequence processing.

Projects Directory

  • /afs/bx.psu.edu/depot/data/schuster_lab/projects

The projects directory contains directories for project specific data including the Tasmanian Devil, KB1, and Woolly Mammoth projects.

Users Directory

  • /afs/bx.psu.edu/depot/data/schuster_lab/users

The users directory contains directories for people within the Schuster Lab.

Retrieved from "https://wiki.bx.psu.edu/index.php?title=SLab:File_System_Layout&oldid=637"