Add and use local storage in pipeline

• Add docker runner with binding to local file system.
• Using the scratch disk under /scratch/eicweb
• Setup cron job to clean up old data
• bind under /scratch then create a project_pipeline directory.

added critical event processing labels

changed the description

@sly2j I have added to the /etc/gitlab-runner/config.toml for the tagless runner the volume flag.

In the runners.docker section "/scratch/eicweb:/scratch:rw" was appended to the list of volumes.

This worked as expected. I tested it with a job from eicd: https://eicweb.phy.anl.gov/EIC/eicd/-/jobs/61828#L23

marked the checklist item Add docker runner with binding to local file system. as completed

marked the checklist item Using the scratch disk under /scratch/eicweb as completed

changed the description

marked the checklist item bind under /scratch then create a project_pipeline directory. as completed

I am creating a directory for each pipeline. It is slightly redundant with the project name and then pipeline ID. The latter is unique on the entire server but I thought the having the project name first will help with the clean up.

assigned to @whit

created merge request !21 (closed) to address this issue

mentioned in merge request !21 (closed)

For the clean up see issue #22 (closed)

closed

mentioned in commit 6a9eab54