Skip to content
Snippets Groups Projects
Commit b69eb27c authored by Wouter Deconinck's avatar Wouter Deconinck
Browse files

feat: UPLOADFULL every n files

parent ab11999d
No related branches found
No related tags found
1 merge request!27feat: UPLOADFULL every n files
Pipeline #44088 passed with stage
in 3 minutes and 50 seconds
......@@ -289,7 +289,7 @@ if [ -f ${INPUT_FILE} ] ; then
fi
# Data egress if S3RW_ACCESS_KEY and S3RW_SECRET_KEY in environment
if [ "${UPLOADFULL:-false}" == "true" ] ; then
if [[ ${UPLOADFULL:-} > 0 && $((TASK % UPLOADFULL)) == 0 ]] ; then
if [ -x ${MC} ] ; then
if [ -n "${ONLINE:-}" ] ; then
if [ -n "${S3RW_ACCESS_KEY:-}" -a -n "${S3RW_SECRET_KEY:-}" ] ; then
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment