Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
D
detector_benchmarks
Manage
Activity
Members
Labels
Plan
Issues
21
Issue boards
Milestones
Wiki
Code
Merge requests
7
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package Registry
Container Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
EIC
benchmarks
detector_benchmarks
Commits
1ef4d2e8
Commit
1ef4d2e8
authored
1 year ago
by
Dmitry Kalinkin
Browse files
Options
Downloads
Patches
Plain Diff
benchmarks/barrel_ecal/config.yml: run via Snakemake
parent
77442e2d
No related branches found
No related tags found
No related merge requests found
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
benchmarks/barrel_ecal/Snakefile
+14
-11
14 additions, 11 deletions
benchmarks/barrel_ecal/Snakefile
benchmarks/barrel_ecal/config.yml
+18
-20
18 additions, 20 deletions
benchmarks/barrel_ecal/config.yml
with
32 additions
and
31 deletions
benchmarks/barrel_ecal/Snakefile
+
14
−
11
View file @
1ef4d2e8
...
@@ -3,7 +3,8 @@ DETECTOR_PATH = os.environ["DETECTOR_PATH"]
...
@@ -3,7 +3,8 @@ DETECTOR_PATH = os.environ["DETECTOR_PATH"]
rule emcal_barrel_particles_gen:
rule emcal_barrel_particles_gen:
input:
input:
script="benchmarks/barrel_ecal/scripts/emcal_barrel_particles_gen.cxx",
workflow.source_path("scripts/emcal_barrel_common_functions.h"),
script=workflow.source_path("scripts/emcal_barrel_particles_gen.cxx"),
params:
params:
JUGGLER_N_EVENTS = 100,
JUGGLER_N_EVENTS = 100,
output:
output:
...
@@ -67,7 +68,8 @@ ln {input} {output}
...
@@ -67,7 +68,8 @@ ln {input} {output}
rule emcal_barrel_particles_analysis:
rule emcal_barrel_particles_analysis:
input:
input:
script="benchmarks/barrel_ecal/scripts/emcal_barrel_particles_analysis.cxx",
workflow.source_path("scripts/emcal_barrel_common_functions.h"),
script=workflow.source_path("scripts/emcal_barrel_particles_analysis.cxx"),
sim="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_{PARTICLE}.edm4hep.root",
sim="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_{PARTICLE}.edm4hep.root",
wildcard_constraints:
wildcard_constraints:
PARTICLE="(electron|photon|piplus|piminus)", # avoid clash with "pions"
PARTICLE="(electron|photon|piplus|piminus)", # avoid clash with "pions"
...
@@ -88,13 +90,13 @@ rule emcal_barrel_particles_analysis:
...
@@ -88,13 +90,13 @@ rule emcal_barrel_particles_analysis:
shell:
shell:
"""
"""
cd {wildcards.DETECTOR_CONFIG}
cd {wildcards.DETECTOR_CONFIG}
root -l -b -q '
../
{input.script}+("{wildcards.PARTICLE}", true)'
root -l -b -q '{input.script}+("{wildcards.PARTICLE}", true)'
"""
"""
rule emcal_barrel_pions_analysis:
rule emcal_barrel_pions_analysis:
input:
input:
script=
"benchmarks/barrel_ecal/
scripts/emcal_barrel_pions_analysis.cxx",
script=
workflow.source_path("
scripts/emcal_barrel_pions_analysis.cxx"
)
,
sim="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_piplus_energies5.0_5.0.edm4hep.root",
sim="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_piplus_energies5.0_5.0.edm4hep.root",
output:
output:
expand(
expand(
...
@@ -105,13 +107,13 @@ rule emcal_barrel_pions_analysis:
...
@@ -105,13 +107,13 @@ rule emcal_barrel_pions_analysis:
shell:
shell:
"""
"""
cd {wildcards.DETECTOR_CONFIG}
cd {wildcards.DETECTOR_CONFIG}
root -l -b -q '
../
{input.script}+("../{input.sim}")'
root -l -b -q '{input.script}+("../{input.sim}")'
"""
"""
rule emcal_barrel_pi0_analysis:
rule emcal_barrel_pi0_analysis:
input:
input:
script=
"benchmarks/barrel_ecal/
scripts/emcal_barrel_pi0_analysis.cxx",
script=
workflow.source_path("
scripts/emcal_barrel_pi0_analysis.cxx"
)
,
sim="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_pi0_energies5.0_5.0.edm4hep.root",
sim="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_pi0_energies5.0_5.0.edm4hep.root",
fsam="{DETECTOR_CONFIG}/results/emcal_barrel_electron_calibration.json",
fsam="{DETECTOR_CONFIG}/results/emcal_barrel_electron_calibration.json",
output:
output:
...
@@ -124,7 +126,7 @@ rule emcal_barrel_pi0_analysis:
...
@@ -124,7 +126,7 @@ rule emcal_barrel_pi0_analysis:
shell:
shell:
"""
"""
cd {wildcards.DETECTOR_CONFIG}
cd {wildcards.DETECTOR_CONFIG}
root -l -b -q '
../
{input.script}+("../{input.sim}")'
root -l -b -q '{input.script}+("../{input.sim}")'
"""
"""
...
@@ -143,7 +145,7 @@ rule emcal_energy_scan:
...
@@ -143,7 +145,7 @@ rule emcal_energy_scan:
rule emcal_barrel_particles_energy_scan_analysis:
rule emcal_barrel_particles_energy_scan_analysis:
input:
input:
script=
"benchmarks/barrel_ecal/
scripts/emcal_barrel_energy_scan_analysis.cxx",
script=
workflow.source_path("
scripts/emcal_barrel_energy_scan_analysis.cxx"
)
,
scan_points="{DETECTOR_CONFIG}/sim_output/emcal_barrel_energy_scan_points_{PARTICLE}.txt",
scan_points="{DETECTOR_CONFIG}/sim_output/emcal_barrel_energy_scan_points_{PARTICLE}.txt",
output:
output:
"{DETECTOR_CONFIG}/results/energy_scan/emcal_barrel_{PARTICLE}_fsam_scan.png",
"{DETECTOR_CONFIG}/results/energy_scan/emcal_barrel_{PARTICLE}_fsam_scan.png",
...
@@ -156,13 +158,14 @@ rule emcal_barrel_particles_energy_scan_analysis:
...
@@ -156,13 +158,14 @@ rule emcal_barrel_particles_energy_scan_analysis:
shell:
shell:
"""
"""
cd {wildcards.DETECTOR_CONFIG}
cd {wildcards.DETECTOR_CONFIG}
root -l -b -q '
../
{input.script}+("{wildcards.PARTICLE}")'
root -l -b -q '{input.script}+("{wildcards.PARTICLE}")'
"""
"""
rule emcal_barrel_pion_rejection_analysis:
rule emcal_barrel_pion_rejection_analysis:
input:
input:
script="benchmarks/barrel_ecal/scripts/emcal_barrel_pion_rejection_analysis.cxx",
workflow.source_path("scripts/emcal_barrel_common_functions.h"),
script=workflow.source_path("scripts/emcal_barrel_pion_rejection_analysis.cxx"),
electron="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_electron_energies1.0_18.0.edm4hep.root",
electron="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_electron_energies1.0_18.0.edm4hep.root",
piminus="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_piminus_energies1.0_18.0.edm4hep.root",
piminus="{DETECTOR_CONFIG}/sim_output/sim_emcal_barrel_piminus_energies1.0_18.0.edm4hep.root",
output:
output:
...
@@ -190,5 +193,5 @@ rule emcal_barrel_pion_rejection_analysis:
...
@@ -190,5 +193,5 @@ rule emcal_barrel_pion_rejection_analysis:
shell:
shell:
"""
"""
cd {wildcards.DETECTOR_CONFIG}
cd {wildcards.DETECTOR_CONFIG}
root -l -b -q '
../
{input.script}+("../{input.electron}", "../{input.piminus}")'
root -l -b -q '{input.script}+("../{input.electron}", "../{input.piminus}")'
"""
"""
This diff is collapsed.
Click to expand it.
benchmarks/barrel_ecal/config.yml
+
18
−
20
View file @
1ef4d2e8
...
@@ -2,36 +2,34 @@ sim:emcal_barrel_pions:
...
@@ -2,36 +2,34 @@ sim:emcal_barrel_pions:
extends
:
.det_benchmark
extends
:
.det_benchmark
stage
:
simulate
stage
:
simulate
script
:
script
:
-
bash benchmarks/barrel_ecal/run_emcal_barrel_particles.sh piplus
-
snakemake --cores 1 $DETECTOR_CONFIG/sim_output/sim_emcal_barrel_{piplus,piminus}_energies5.0_5.0.edm4hep.root
-
bash benchmarks/barrel_ecal/run_emcal_barrel_particles.sh piminus
sim:emcal_barrel_pi0
:
sim:emcal_barrel_pi0
:
extends
:
.det_benchmark
extends
:
.det_benchmark
stage
:
simulate
stage
:
simulate
script
:
script
:
-
bash benchmarks/barrel_ecal/run_emcal_barrel_particles.sh pi0
-
snakemake --cores 1 $DETECTOR_CONFIG/sim_output/sim_emcal_barrel_pi0_energies5.0_5.0.edm4hep.root
sim:emcal_barrel_electrons
:
sim:emcal_barrel_electrons
:
extends
:
.det_benchmark
extends
:
.det_benchmark
stage
:
simulate
stage
:
simulate
script
:
script
:
-
if [[ "$RUN_EXTENDED_BENCHMARK" == "true" ]] ; then
bash benchmarks/barrel_ecal/run_emcal_barrel_energy_scan.sh electron
; fi
-
if [[ "$RUN_EXTENDED_BENCHMARK" == "true" ]] ; then
snakemake --cores $DETECTOR_CONFIG/results/energy_scan/emcal_barrel_electron_fsam_scan.png
; fi
-
export JUGGLER_N_EVENTS=400
-
export JUGGLER_N_EVENTS=400
-
bash benchmarks/barrel_ecal/run_emcal_barrel_particles.sh electron
-
snakemake --cores 1 $DETECTOR_CONFIG/sim_output/sim_emcal_barrel_electron_energies5.0_5.0.edm4hep.root
sim:emcal_barrel_photons
:
sim:emcal_barrel_photons
:
extends
:
.det_benchmark
extends
:
.det_benchmark
stage
:
simulate
stage
:
simulate
script
:
script
:
-
if [[ "$RUN_EXTENDED_BENCHMARK" == "true" ]] ; then
bash benchmarks/barrel_ecal/run_emcal_barrel_energy_scan.sh photon
; fi
-
if [[ "$RUN_EXTENDED_BENCHMARK" == "true" ]] ; then
snakemake --cores $DETECTOR_CONFIG/results/energy_scan/emcal_barrel_proton_fsam_scan.png
; fi
-
bash benchmarks/barrel_ecal/run_emcal_barrel_particles.sh photon
-
snakemake --cores 1 $DETECTOR_CONFIG/sim_output/sim_emcal_barrel_photon_energies5.0_5.0.edm4hep.root
sim:emcal_barrel_pion_rejection
:
sim:emcal_barrel_pion_rejection
:
extends
:
.det_benchmark
extends
:
.det_benchmark
stage
:
simulate
stage
:
simulate
script
:
script
:
-
bash benchmarks/barrel_ecal/run_emcal_barrel_pion_rejection.sh electron
-
snakemake --cores 1 $DETECTOR_CONFIG/sim_output/sim_emcal_barrel_{piminus,electron}_energies1.0_18.0.edm4hep.root
-
bash benchmarks/barrel_ecal/run_emcal_barrel_pion_rejection.sh piminus
calib:emcal_barrel_electrons
:
calib:emcal_barrel_electrons
:
extends
:
.det_benchmark
extends
:
.det_benchmark
...
@@ -40,8 +38,8 @@ calib:emcal_barrel_electrons:
...
@@ -40,8 +38,8 @@ calib:emcal_barrel_electrons:
-
[
"
sim:emcal_barrel_electrons"
]
-
[
"
sim:emcal_barrel_electrons"
]
script
:
script
:
-
ls -lhtR sim_output/
-
ls -lhtR sim_output/
-
rootls -t sim_output/sim_emcal_barrel_electron.edm4hep.root
-
rootls -t sim_output/sim_emcal_barrel_electron
_energies5.0_5.0
.edm4hep.root
-
root -b -q 'benchmarks/barrel_ecal/scripts/emcal_barrel_particles_analysis.cxx+("electron",
true
)'
-
snakemake --cores 1 $DETECTOR_CONFIG/results/emcal_barrel_electron_calibration.json
-
mv sim_output/sim_emcal_barrel_electron.edm4hep.root results/.
-
mv sim_output/sim_emcal_barrel_electron.edm4hep.root results/.
-
echo "JSON file(s) from analysis:" ; cat results/*.json
-
echo "JSON file(s) from analysis:" ; cat results/*.json
...
@@ -51,7 +49,7 @@ bench:emcal_barrel_pions:
...
@@ -51,7 +49,7 @@ bench:emcal_barrel_pions:
needs
:
needs
:
-
[
"
sim:emcal_barrel_pions"
]
-
[
"
sim:emcal_barrel_pions"
]
script
:
script
:
-
root -b -q benchmarks/barrel_ecal/scrip
ts/emcal_barrel_pions_
analysis.cxx+
-
snakemake --cores 1 $DETECTOR_CONFIG/resul
ts/emcal_barrel_pions_
Ethr.png
bench:emcal_barrel_electrons_scan
:
bench:emcal_barrel_electrons_scan
:
extends
:
.det_benchmark
extends
:
.det_benchmark
...
@@ -59,7 +57,7 @@ bench:emcal_barrel_electrons_scan:
...
@@ -59,7 +57,7 @@ bench:emcal_barrel_electrons_scan:
needs
:
needs
:
-
[
"
sim:emcal_barrel_electrons"
]
-
[
"
sim:emcal_barrel_electrons"
]
script
:
script
:
-
if [[ "$RUN_EXTENDED_BENCHMARK" == "true" ]] ; then
root -b -q 'benchmarks/barrel_ecal/scripts/emcal_barrel_energy_scan_analysis.cxx+("electron")'
; fi
-
if [[ "$RUN_EXTENDED_BENCHMARK" == "true" ]] ; then
snakemake --cores 1 $DETECTOR_CONFIG/results/energy_scan/emcal_barrel_electron_fsam_scan.png
; fi
bench:emcal_barrel_pi0
:
bench:emcal_barrel_pi0
:
extends
:
.det_benchmark
extends
:
.det_benchmark
...
@@ -68,7 +66,7 @@ bench:emcal_barrel_pi0:
...
@@ -68,7 +66,7 @@ bench:emcal_barrel_pi0:
-
[
"
sim:emcal_barrel_pi0"
,
"
calib:emcal_barrel_electrons"
]
-
[
"
sim:emcal_barrel_pi0"
,
"
calib:emcal_barrel_electrons"
]
script
:
script
:
-
echo "JSON file(s) from analysis:" ; cat results/*.json
-
echo "JSON file(s) from analysis:" ; cat results/*.json
-
root -b -q benchmark
s/
b
arrel_e
cal/scripts/emcal_barrel_pi0_analysis.cxx+
-
snakemake --cores 1 epic_craterlake/result
s/
B
arrel_e
mcal_pi0.json
bench:emcal_barrel_photons
:
bench:emcal_barrel_photons
:
extends
:
.det_benchmark
extends
:
.det_benchmark
...
@@ -77,10 +75,10 @@ bench:emcal_barrel_photons:
...
@@ -77,10 +75,10 @@ bench:emcal_barrel_photons:
-
[
"
sim:emcal_barrel_photons"
]
-
[
"
sim:emcal_barrel_photons"
]
script
:
script
:
-
ls -lhtR sim_output/
-
ls -lhtR sim_output/
-
rootls -t sim_output/sim_emcal_barrel_photon.edm4hep.root
-
rootls -t sim_output/sim_emcal_barrel_photon
_energies5.0_5.0
.edm4hep.root
-
root -b -q 'benchmarks/barrel_ecal/scripts/emcal_barrel_particles_analysis.cxx+("photon",
false
)'
-
snakemake --cores 1 $DETECTOR_CONFIG/results/emcal_barrel_photon_calibration.json
-
mv sim_output/sim_emcal_barrel_photon.edm4hep.root results/.
-
mv sim_output/sim_emcal_barrel_photon.edm4hep.root results/.
-
if [[ "$RUN_EXTENDED_BENCHMARK" == "true" ]] ; then
root -b -q 'benchmarks/barrel_ecal/scripts/emcal_barrel_energy_scan_analysis.cxx+("photon")'
; fi
-
if [[ "$RUN_EXTENDED_BENCHMARK" == "true" ]] ; then
snakemake --cores $DETECTOR_CONFIG/results/energy_scan/emcal_barrel_proton_fsam_scan.png
; fi
bench:emcal_barrel_pion_rejection
:
bench:emcal_barrel_pion_rejection
:
extends
:
.det_benchmark
extends
:
.det_benchmark
...
@@ -89,9 +87,9 @@ bench:emcal_barrel_pion_rejection:
...
@@ -89,9 +87,9 @@ bench:emcal_barrel_pion_rejection:
-
[
"
sim:emcal_barrel_pion_rejection"
]
-
[
"
sim:emcal_barrel_pion_rejection"
]
script
:
script
:
-
ls -lhtR sim_output/
-
ls -lhtR sim_output/
-
rootls -t sim_output/sim_emcal_barrel_pi
Rej_piminus
.edm4hep.root
-
rootls -t
$DETECTOR_CONFIG/
sim_output/sim_emcal_barrel_pi
minus_energies1.0_18.0
.edm4hep.root
-
rootls -t sim_output/sim_emcal_barrel_
piRej_
electron.edm4hep.root
-
rootls -t
$DETECTOR_CONFIG/
sim_output/sim_emcal_barrel_electron
_energies1.0_18.0
.edm4hep.root
-
root -b -q benchmarks/barrel_ecal/scripts/emcal_barrel_pion_rejection_analysis.cxx+
-
snakemake --cores 1 $DETECTOR_CONFIG/results/Barrel_emcal_pion_rej.json
collect_results:barrel_ecal
:
collect_results:barrel_ecal
:
extends
:
.det_benchmark
extends
:
.det_benchmark
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment