Skip to content

Install in-container and out-of-container full simulation campaigns scripts

Wouter Deconinck requested to merge install-full-simulation-campaign-scripts into master

The goal is to enable simulation workflows that avoid depending on any locally installed (and potentially modified) components. This includes earlier dispatch to the container than we've been doing now, i.e. (with some details removed)

EICSHELL="singularity exec /cvmfs/singularity.opensciencegrid.org/eicweb/jug_xl:nightly/ eic-shell"
cat << EOF | ${EICSHELL}
  /opt/campaigns/single/scripts/run.sh ${INPUT_FILE} ${EVENTS_PER_TASK} ${TASK_ID:-}
EOF

and handling the parts before dispatch in scripts (also) accessible directly through /cvmfs, i.e.

JUG_XL="/cvmfs/singularity.opensciencegrid.org/eicweb/jug_xl:nightly"
sbatch --array 1-10 ${JUG_XL}/opt/campaigns/slurm/scripts/submit.sh single e-_1GeV_45to135deg.steer 10000

and

JUG_XL="/cvmfs/singularity.opensciencegrid.org/eicweb/jug_xl:nightly"
${JUG_XL}/opt/campaigns/condor/scripts/submit.sh 10 single e-_1GeV_45to135deg.steer 10000

Of course, when this is all inside the container nightlies, it ensure we are running with the latest (and traceable) submission scripts, and can potentially scale the number of submitters more easily.

Merge request reports