Cloud execution of the workflow

Since snakemake has cloud execution capabilities, we can relatively easily support such environments (e.g. kubernetes). Do we want to go in that direction?

added Discuss label

changed title from cloud execution of the workflow to Cloud execution of the workflow

mentioned in issue #97 (closed)

ELIXIR Cloud AAI is working on a Snakemake WES, Snakemake TES backend and support for Snakemake in the CWLab portal. With a few months down the road, this will probably be solved generically for any Snakemake pipeline. We could actually speed this up by helping the German ELIXIR node a bit with this. Both TES backend and WES should be pretty easy to do. With TESK and Funnel that would allow us to basically execute on every cloud and HPC environment...

removed milestone

This is very useful for the public, but it is hard to be implemented for v1.0.0 given the timelines.

added Future label

No additional tasks are related to this implementation. Testing is required before applying this.

changed milestone to %downstream

changed milestone to %upstream

added To Do label

removed To Do label

closed

removed milestone %upstream

reopened

removed Future label

Since we now have the implementation of the profiles for snakemake and people have more knowledge on the cloud execution would it make sense to build a cloud execution profile for the upcoming version? @kanitz @bakma @burri0000 @herrmchr @zavolan @gypas ?

I would say: not for this version, probably we can gradually add support for distinct platforms in the future.

added pipeline label

added Future label

[26.08.2021] Minigroup meeting: we decided we will not support cloud execution for this release.
CC: @zavolan @katsanto @kanitz

closed

reopened

closed