Commit 8009c367 authored by Dmitry Romanov's avatar Dmitry Romanov
Browse files

Updates on containers

parent d31122d1
<mxfile host="app.diagrams.net" modified="2021-05-23T04:59:18.781Z" agent="5.0 (Windows)" etag="kjT0lvC8KGgghN0-KTZw" version="14.7.0" type="device"><diagram id="SZMAlSkkSlNbT5CupUWZ" name="Page-1">7Vhdc5swEPw1fmwHg3Gcx9iOk3bSTqdpJ81TR4YLqBGIkURs99f3DgQGlLTuZ9JO/eCRVjrpfLsrgUfBItueKVakr2QMYuR78XYULEe+P/ND/CZgVwOT0KuBRPG4hsZ74JJ/Bgs200oeg+5NNFIKw4s+GMk8h8j0MKaU3PSn3UjR37VgCTjAZcSEi17x2KT2ZzW/gvBz4Ena7Dz27EjGmskW0CmL5aYDBaejYKGkNHUr2y5AUO2autRxqwdG28QU5OaQgJeb17fry6OX+jg/n1/DsVbvgmd2lTsmSvuDY1hzln9cMw02b7NriqE3PBMsx948SrmIL9hOlrS5Niy6bXrzVCr+WeaGCRwaI4DDylhuA68345IiESb0hguxkEKqarfA82aL1YpwnNnBV9UHcSXLPIbYbkKz7B7jSdO3uXtVEkretiT6FA8a579pKui10AXTpkm9YY1GY6bTaj/qMMGTHNsRRgOmNncJaaoLysC2A1mCzkBmYNQOp9jRidXKrt/d7JXX+iftqG5qMWbFnrQL7/WADSuJ75CH78hjzjSPyM+VTCg+IwdRjpgi4XcgZJFRDagY0S0OY1on5OUIIxfUuJHKKAqnHpjIUZpT3Jq9RgW5rETYFYyFNG7J8+QCbqg2k4EuiHVig6PBT+wWRhYN8WzdqkVJw0ynj7Q2knB5/qq1vk2+ZTs4kO3gd7EdOGx/KpOPyOgjHwQwjkM4enqG72sSEz2eHgVs+muOgln/KBj7f/AseLt6f3Rd6NOrF9cn6+m5vrpb62cTRx1LKAD5yCOODve9HIDIoUtW0XdZral5VgpmuMzrQ+AtXXiV78+A5WZi26yMeXscPHcEh0WrBGWyRkoOG0NfZzyOKdyxdiF5bqrqhPNRuKS1SiO1VdLhBg8OpvSpGDy81+Bb8cj+RnfP4slf4O+Zvw6mv8jfraGtOHzvsS/7qaOOlWNhUknFI1l5uZycQ1Fd+gafvSvX77MhLyvA53IsYxnZaCYSVIRJM/0vXvnhwSJ4KifC+Ngh3SEGz/gTepMibgTT9PzXO4n7PgwQgS03H2wVqX1N7eeh7S23naHlznYetBTEvTc0t5ad4t1XuwZTQBq+67/X3VdQu8Mbuia+4tchJ1qWKgIb1X0PGy7kDW722WAhPEMTMM5CyAHbdabZa+zhhL37E97LpV5xL562pj/xwuD919Nheho+34U/KKfpYB3v96hpuE34U2LC7v6Pj3r6/t+j4PQL</diagram></mxfile>
\ No newline at end of file
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
<svg xmlns="http://www.w3.org/2000/svg" style="background-color: rgb(255, 255, 255);" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="532px" height="222px" viewBox="-0.5 -0.5 532 222" content="&lt;mxfile host=&quot;app.diagrams.net&quot; modified=&quot;2021-05-23T04:59:45.708Z&quot; agent=&quot;5.0 (Windows)&quot; etag=&quot;HwFstbd4iSkIjxK1Q4GR&quot; version=&quot;14.7.0&quot; type=&quot;device&quot;&gt;&lt;diagram id=&quot;SZMAlSkkSlNbT5CupUWZ&quot; name=&quot;Page-1&quot;&gt;7Vhdc5swEPw1fmwHg3Gcx9iOk3bSTqdpJ81TR4YLqBGIkURs99f3DgQGlLTuZ9JO/eCRVjrpfLsrgUfBItueKVakr2QMYuR78XYULEe+P/ND/CZgVwOT0KuBRPG4hsZ74JJ/Bgs200oeg+5NNFIKw4s+GMk8h8j0MKaU3PSn3UjR37VgCTjAZcSEi17x2KT2ZzW/gvBz4Ena7Dz27EjGmskW0CmL5aYDBaejYKGkNHUr2y5AUO2autRxqwdG28QU5OaQgJeb17fry6OX+jg/n1/DsVbvgmd2lTsmSvuDY1hzln9cMw02b7NriqE3PBMsx948SrmIL9hOlrS5Niy6bXrzVCr+WeaGCRwaI4DDylhuA68345IiESb0hguxkEKqarfA82aL1YpwnNnBV9UHcSXLPIbYbkKz7B7jSdO3uXtVEkretiT6FA8a579pKui10AXTpkm9YY1GY6bTaj/qMMGTHNsRRgOmNncJaaoLysC2A1mCzkBmYNQOp9jRidXKrt/d7JXX+iftqG5qMWbFnrQL7/WADSuJ75CH78hjzjSPyM+VTCg+IwdRjpgi4XcgZJFRDagY0S0OY1on5OUIIxfUuJHKKAqnHpjIUZpT3Jq9RgW5rETYFYyFNG7J8+QCbqg2k4EuiHVig6PBT+wWRhYN8WzdqkVJw0ynj7Q2knB5/qq1vk2+ZTs4kO3gd7EdOGx/KpOPyOgjHwQwjkM4enqG72sSEz2eHgVs+muOgln/KBj7f/AseLt6f3Rd6NOrF9cn6+m5vrpb62cTRx1LKAD5yCOODve9HIDIoUtW0XdZral5VgpmuMzrQ+AtXXiV78+A5WZi26yMeXscPHcEh0WrBGWyRkoOG0NfZzyOKdyxdiF5bqrqhPNRuKS1SiO1VdLhBg8OpvSpGDy81+Bb8cj+RnfP4slf4O+Zvw6mv8jfraGtOHzvsS/7qaOOlWNhUknFI1l5uZycQ1Fd+gafvSvX77MhLyvA53IsYxnZaCYSVIRJM/0vXvnhwSJ4KifC+Ngh3SEGz/gTepMibgTT9PzXO4n7PgwQgS03H2wVqX1N7eeh7S23naHlznYetBTEvTc0t5ad4t1XuwZTQBq+67/X3VdQu8Mbuia+4tchJ1qWKgIb1X0PGy7kDW722WAhPEMTMM5CyAHbdabZa+zhhL37E97LpV5xL562pj/xwuD919Nheho+34U/KKfpYB3v96hpuE34U2LC7v6Pj3r6/t+j4PQL&lt;/diagram&gt;&lt;/mxfile&gt;"><defs/><g><path d="M 451 31 L 451 14.5 Q 451 1 437.5 1 L 14.5 1 Q 1 1 1 14.5 L 1 31" fill="#008cff" stroke="#000000" stroke-width="2" stroke-miterlimit="10" pointer-events="all"/><path d="M 1 31 L 1 47.5 Q 1 61 14.5 61 L 437.5 61 Q 451 61 451 47.5 L 451 31" fill="none" stroke="#000000" stroke-width="2" stroke-miterlimit="10" pointer-events="none"/><path d="M 1 31 L 451 31" fill="none" stroke="#000000" stroke-width="2" stroke-miterlimit="10" pointer-events="none"/><g fill="#FFFFFF" font-family="Helvetica" pointer-events="none" text-anchor="middle" font-size="14px"><text x="225.5" y="21.5">debian_base</text></g><g fill="#000000" font-family="Helvetica" pointer-events="none" text-anchor="middle" font-size="12px"><text x="227.5" y="48.5">Basic debian image with development packages: gcc, gfortran, etc</text></g><path d="M 491 111 L 491 94.5 Q 491 81 477.5 81 L 54.5 81 Q 41 81 41 94.5 L 41 111" fill="#e1d5e7" stroke="#9673a6" stroke-width="2" stroke-miterlimit="10" pointer-events="none"/><path d="M 41 111 L 41 127.5 Q 41 141 54.5 141 L 477.5 141 Q 491 141 491 127.5 L 491 111" fill="none" stroke="#9673a6" stroke-width="2" stroke-miterlimit="10" pointer-events="none"/><path d="M 41 111 L 491 111" fill="none" stroke="#9673a6" stroke-width="2" stroke-miterlimit="10" pointer-events="none"/><g fill="#000000" font-family="Helvetica" pointer-events="none" text-anchor="middle" font-size="14px"><text x="265.5" y="101.5">jug_dev</text></g><g transform="translate(-0.5 -0.5)"><switch><foreignObject style="overflow: visible; text-align: left;" pointer-events="none" width="100%" height="100%" requiredFeatures="http://www.w3.org/TR/SVG11/feature#Extensibility"><div xmlns="http://www.w3.org/1999/xhtml" style="display: flex; align-items: unsafe center; justify-content: unsafe center; width: 1px; height: 1px; padding-top: 126px; margin-left: 266px;"><div style="box-sizing: border-box; font-size: 0; text-align: center; "><div style="display: inline-block; font-size: 12px; font-family: Helvetica; color: #000000; line-height: 1.2; pointer-events: none; white-space: nowrap; ">Dependencies needed for full simulation: Root, Geant4, Gaudi, etc.</div></div></div></foreignObject><text x="266" y="130" fill="#000000" font-family="Helvetica" font-size="12px" text-anchor="middle">Dependencies needed for full simulation: Root, Geant4, Gaudi, etc.</text></switch></g><path d="M 531 191 L 531 174.5 Q 531 161 517.5 161 L 94.5 161 Q 81 161 81 174.5 L 81 191" fill="#d5e8d4" stroke="#82b366" stroke-width="2" stroke-miterlimit="10" pointer-events="none"/><path d="M 81 191 L 81 207.5 Q 81 221 94.5 221 L 517.5 221 Q 531 221 531 207.5 L 531 191" fill="none" stroke="#82b366" stroke-width="2" stroke-miterlimit="10" pointer-events="none"/><path d="M 81 191 L 531 191" fill="none" stroke="#82b366" stroke-width="2" stroke-miterlimit="10" pointer-events="none"/><g fill="#000000" font-family="Helvetica" pointer-events="none" text-anchor="middle" font-size="14px"><text x="305.5" y="181.5">jug_xl</text></g><g fill="#000000" font-family="Helvetica" pointer-events="none" text-anchor="middle" font-size="12px"><text x="307.5" y="208.5">Full simulation stack: DD4Hep detector geometry, reconstruction algorithms</text></g><path d="M 81 191 L 71 191 Q 61 191 61 181 L 61 151.1" fill="none" stroke="#000000" stroke-width="3" stroke-miterlimit="10" pointer-events="none"/><path d="M 61 144.35 L 65.5 153.35 L 61 151.1 L 56.5 153.35 Z" fill="#000000" stroke="#000000" stroke-width="3" stroke-miterlimit="10" pointer-events="none"/><path d="M 41 111 L 31 111 Q 21 111 21 101 L 21 71.1" fill="none" stroke="#000000" stroke-width="3" stroke-miterlimit="10" pointer-events="none"/><path d="M 21 64.35 L 25.5 73.35 L 21 71.1 L 16.5 73.35 Z" fill="#000000" stroke="#000000" stroke-width="3" stroke-miterlimit="10" pointer-events="none"/></g><switch><g requiredFeatures="http://www.w3.org/TR/SVG11/feature#Extensibility"/><a transform="translate(0,-5)" xlink:href="https://www.diagrams.net/doc/faq/svg-export-text-problems" target="_blank"><text text-anchor="middle" font-size="10px" x="50%" y="100%">Viewer does not support full SVG 1.1</text></a></switch></svg>
\ No newline at end of file
Develop using containers
========================
Install singularity
-------------------
The `oficial installation instructions <https://sylabs.io/guides/3.0/user-guide/installation.html>`_ have many steps.
Please don't install NeuroDebian repo from the repo as it holds v2.6 and eic image require singularity > 3.0.
Instead. If you have ubuntu, there is a `debian repo with 3.5.2 version <https://packages.debian.org/source/sid/singularity-container>`_,
which works pretty nicely (You will have to install dependencies, it will print them...)
.. code::
wget http://ftp.fi.debian.org/debian/pool/main/s/singularity-container/singularity-container_3.5.2+ds1-1_amd64.deb
sudo dpkg -i singularity-container/singularity-container_3.5.2+ds1-1_amd64.deb
Singularity install
-------------------
The below command creates the right working environment.
It checks if there are CVMFS images available (which is true for JLab and BNL farms) and links them or automatically download images
(which is a scenario for users laptops). It also creates eic_shell with the right environment setup, prepares the current dir to work with detector or etc.
.. code::
curl https://eicweb.phy.anl.gov/containers/eic_container/-/raw/master/install.sh | bash
Docker images
\ No newline at end of file
......@@ -3,8 +3,15 @@ Containers
`Containers repository <https://eicweb.phy.anl.gov/containers>`_
Installation
------------
.. figure:: ../_images/image-hierarhy.svg
:alt: Software plan
:width: 800
Singularity
-----------
#.
......@@ -66,11 +73,12 @@ Installation
you can add them with the ``-b`` flag. Run ``./install.py -h`` to see a list of all
supported options.
Usage
-----
A. Running the singularity development environment with modulefiles
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Modulefiles
^^^^^^^^^^^
Running the singularity development environment with modulefiles
#.
......@@ -94,26 +102,30 @@ A. Running the singularity development environment with modulefiles
eic-shell
B. Running the singularity development locally (without modulefiles)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Without modulefiles
^^^^^^^^^^^^^^^^^^^
Running the singularity development locally (without modulefiles)
#.
This is assuming you installed with the ``-l`` flag to a prefix ``$PREFIX``\ :
1. This is assuming you installed with the ``-l`` flag to a prefix ``$PREFIX``\ :
.. code-block:: bash
./install.py $PREFIX
#.
To start a shell in the container environment, do
2. To start a shell in the container environment, do
.. code-block:: bash
$PREFIX/bin/eic-shell
C. Using the docker container for your CI purposes
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Docker containers
-----------------
Containers are available at eicweb namespace at `the dockerhub <https://hub.docker.com/search?q=eicweb&type=image>`
#.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment