ATHENA Simulation and Reconstruction Campaigns

Step 1: Install eic-shell

This covenience script provides transparent access to the containers. In this repository directory, run:

curl https://eicweb.phy.anl.gov/containers/eic_container/-/raw/master/install.sh | bash

Step 2: Install minio client

This client for S3 data storage allows downloading or streaming data files.

wget https://dl.min.io/client/mc/release/linux-amd64/mc
chmod a+x mc
./mc config host add S3 https://dtn01.sdcc.bnl.gov:9000 $MCUSER $MCKEY

A username and key can be obtained from your colleagues in slack.

Step 3: Data ingress

Copy source files into input/. The minio client does not currently support cp from S3 with wildcard patterns.

for i in `./mc find S3/eictest/ATHENA/EVGEN/JETS/crossDivNrgCrab/ -name "*.hepmc.gz"` ; do
  ./mc cp $i input/
done

Step 4a: Test interactively for 10 events

./simulate_hepmc.sh input/test_crossDivNrgCrab_25mRad_5x41_v1.hepmc 10

Step 4b: Test one batch job for 100 events

sbatch --array 1-1 ./simulate_hepmc.sh input/test_crossDivNrgCrab_25mRad_5x41_v1.hepmc 100

Step 4c: Submit a full batch production

sbatch --array 1-100 ./simulate_hepmc.sh input/test_crossDivNrgCrab_25mRad_5x41_v1.hepmc

The default chunk size is 10,000 events. The default time request and default chunk size in the submission script are expected to be compatible (but it never hurts to verify).

Step 5: Data egress (requires rw access)

./mc cp output/*.root S3rw/eictest/ATHENA/FULL/JETS/crossDivNrgCrab/2021-06-09/