feat: new template for batch execution #123
Conversation
TaoSunVoyage
changed the title
|
The content and location of |
| @@ -0,0 +1,46 @@ | |||
| # For finding latest versions of the base image see | |||
| # https://github.com/SwissDataScienceCenter/renkulab-docker | |||
| ARG RENKU_BASE_IMAGE=renku/renkulab-batch | |||
There was a problem hiding this comment.
we'll probably want to point to a specific tag
There was a problem hiding this comment.
yes. probably 0.8.x in the next releases of renku-docker
| @@ -0,0 +1,39 @@ | |||
| # {{ name }} | |||
There was a problem hiding this comment.
do you want to mention in the readme something about the batch dockerfile and what the intent here is?
| @@ -0,0 +1,52 @@ | |||
| #!/bin/bash -l | |||
There was a problem hiding this comment.
is this file to be used by the renku CLI command?
There was a problem hiding this comment.
well, yes. but i am still not sure what would be the best for this script-template. content, location, etc. some decisions to be made.
There was a problem hiding this comment.
if it's an internal file that the user shouldn't really need to look at/change, it could go in a subdirectory of .renku e.g. .renku/templates/?
| @@ -18,6 +18,11 @@ | |||
| description: The simplest Julia 1.6.1-based renku project with a basic directory structure and necessary supporting files. | |||
| variables: | |||
| description: short description added at the beginning of the readme file | |||
| - folder: batch-minimal | |||
| name: Batch Version of Basic Python (3.8) Project | |||
| description: The simplest Python-3.8-based renku project for batch execution with a basic directory structure and necessary supporting files. | |||
There was a problem hiding this comment.
Maybe we can just build on the base python template and reword this with something like
Identical to the basic Python project, but also provides images and templates for running renku workflows on batch systems.
|
@TaoSunVoyage is this closed to being merged? I think we're going to tag a new release here soon. |
|
@ableuler not yet. We are waiting for the new workflow executor |
|
I'm not sure we need a separate template for batch execution. I rather envision a situation where a "batch" dockerfile (and associated configuration) is added to a normal project. Closing this for now, we may revisit at some later point. |
Add template for batch execution #118
Main difference between python-minimal template:
environment.yml, python dependencies have to be installed by pipDockerfile.batchfor batch version image, and a new job in.gitlab-ci.ymlsbatch-script-template.shtemplate for sbatch script