Skip to content
Snippets Groups Projects

Install in-container and out-of-container full simulation campaigns scripts

Merged Wouter Deconinck requested to merge install-full-simulation-campaign-scripts into master

The goal is to enable simulation workflows that avoid depending on any locally installed (and potentially modified) components. This includes earlier dispatch to the container than we've been doing now, i.e. (with some details removed)

EICSHELL="singularity exec /cvmfs/singularity.opensciencegrid.org/eicweb/jug_xl:nightly/ eic-shell"
cat << EOF | ${EICSHELL}
  /opt/campaigns/single/scripts/run.sh ${INPUT_FILE} ${EVENTS_PER_TASK} ${TASK_ID:-}
EOF

and handling the parts before dispatch in scripts (also) accessible directly through /cvmfs, i.e.

JUG_XL="/cvmfs/singularity.opensciencegrid.org/eicweb/jug_xl:nightly"
sbatch --array 1-10 ${JUG_XL}/opt/campaigns/slurm/scripts/submit.sh single e-_1GeV_45to135deg.steer 10000

and

JUG_XL="/cvmfs/singularity.opensciencegrid.org/eicweb/jug_xl:nightly"
${JUG_XL}/opt/campaigns/condor/scripts/submit.sh 10 single e-_1GeV_45to135deg.steer 10000

Of course, when this is all inside the container nightlies, it ensure we are running with the latest (and traceable) submission scripts, and can potentially scale the number of submitters more easily.

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
Please register or sign in to reply
Loading