stage-in to HPC

[kosarko]

We need to download data (incl restricted) into (stage-in) a computational cluster (there might be some wait time before resources are available, expect a non-interactive session).

As a first MVP one possible solution is that the user generates some sort of token(s)/url(s) and uses (pastes/hardcodes) these in the workflow.

The lifetime of the tokens/urls is expected to be in order of days (should be configurable at least on a global level).

[stranak]

If this is not something we have promissed to do now, I would postopone it. We are just now preparing a projekct in the OS II program for an AI repository with Ostrava and they want to do staging there as a prominent activity, using their LEXIS platform for the transfers. They want to do most of the development of the integration with CLARIN-DSpace, with some support from our side.