Skip to content
Snippets Groups Projects

    • Activity

    • All activity
    • Comments only
    • History only
    • Newest first
    • Oldest first
    • Sylvester Joosten added #69 as parent issue
    • Sylvester Joosten mentioned in issue #69
    • Sylvester Joosten assigned to @veprbl
    • Dmitry Kalinkin
      Dmitry Kalinkin @veprbl ·
      Maintainer

      Thanks for hotfixing this. I'm not sure how one could read from S3 directly without going for FUSE / s3fs. Perhaps, we could agree to store large files in /scratch/cache/....

    • Sylvester Joosten
      Sylvester Joosten @sly2j ·
      Owner

      That could definitely work, as long as you protect against race conditions. I think there are a few options going forward (including FUSE-mounting S3). The current approach doesn't scale beyond using a single runner machine. Anyhow, in this particular case, would migrating to xrootd bypass the storage issue?

    • Dmitry Kalinkin
      Dmitry Kalinkin @veprbl ·
      Maintainer

      I'm open to migrating to XRootD. What is stopping that is that the required background files are currently missing there, and we'd need to convert them to ROOT format. Ideally, we'd support both cases to allow users some flexibility.

    • Ghost User mentioned in commit 7246e0d3