Last modified: Tue May 26 23:02:08 BST 2009
Nick West
Return to home page

Grid: Flux Files

Introduction

This section contains instructions on managing flux sets on CASTOR and on NFS disk at RAL. The root directories are:- 
  CASTOR:    /castor/ads.rl.ac.uk/prod/minos/tape/flux/gnumi/v19
  NFS Disk:  /stage/minos-data1/vo/mc_production/flux/gnumi/v19

Copying flux set from FNAL to CASTOR

  1. Set up GridTools and Kerberised SSH 
    source /stage/minos-data1/software/grid/setup_minos_local-SL4.sh
source /stage/minos-data1/vo/grid/sshkrb5/setupkssh.sh

/usr/kerberos/bin/kinit -l 6d -r 6d -A -k  -t /stage/minos-data1/vo/grid/mcarchiver.keytab \
    mcarchiver/minos/csfa.rl.ac.uk@FNAL.GOV

  2. Set up CASTOR environment 
    export STAGE_SVCCLASS=minosTape
export STAGE_HOST=genstager.ads.rl.ac.uk
export RFIO_USE_CASTOR_V2=YES

  3. Define the flux set to copy and create the CASTOR directory 
    flux_dir= required flux set e.g. fluka05_le010z-185i
castor_top=/castor/ads.rl.ac.uk/prod/minos/tape/flux/gnumi/v19
dir=$castor_top/$flux_dir
rfmkdir      $dir
rfchmod 0770 $dir

  4. Run DCM to copy the flux set 
    dcm disk_to_castor --exclude ".*\\.root,.*\\.log,.*\\.dat,.*\\.err,.*\\.input" \
   nwest@minos21.fnal.gov:/minos/data/flux/gnumi/v19/$flux_dir \
   $castor_top/$flux_dir
    Note that the command can safely be run multiple times; it skips any data already copied.

Copying flux set from CASTOR to disk

Although the flux files can be used directly from CASTOR, for large production runs, performance can be improved by copying to disk as follows.

  1. Set up GridTools 
    source /stage/minos-data1/software/grid/setup_minos_local-SL4.sh

  2. Set up CASTOR environment 
    export STAGE_SVCCLASS=minosTape
export STAGE_HOST=genstager.ads.rl.ac.uk
export RFIO_USE_CASTOR_V2=YES

  3. Define the flux set to copy and create the NFS disk directory 
    flux_dir= required flux set e.g. fluka05_le010z-185i
castor_top=/castor/ads.rl.ac.uk/prod/minos/tape/flux/gnumi/v19
disk_top=/stage/minos-data1/vo/mc_production/flux/gnumi/v19
dir=$disk_top/$flux_dir
mkdir      $dir
chmod 0770 $dir

  4. Run DCM to copy the flux set 
    dcm castor_to_disk $castor_top/$flux_dir $disk_top/$flux_dir
    Note that the command can safely be run multiple times; it skips any data already copied.
Return to home page