nextflow-io/nextflow

Custom AWS Batch job names

Open

#1.232 geöffnet am 18. Juli 2019

Auf GitHub ansehen
 (4 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Groovy (784 Forks)batch import
executor/aws-batchgood first issuestale

Repository-Metriken

Stars
 (3.382 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 16T 9h) (54 gemergte PRs in 30 T)

Beschreibung

Usage scenario

Hello! We have several people using Nextflow on AWS and it's getting confusing whose jobs are whose in the job queue. I'd like to be able to scan the job listing and see whose jobs are where, and since I often submit multiple workflows, also the workflow.runName to keep track of which workflow this e.g. trimming step is from. For example, Instead of "make_additional_gtf_1" I'd like the job name to be: maniac_franklin__olgabot__make_additional_gtf_1

Suggest implementation

One implementation I can think of is to add a variably-defined name_prefix to the workflow params:

params {
    name_prefix = "${workflow.runName}__${workflow.userName}"
} 

(Highlight the main building blocks of a possible implementation and/or related components)

Hello, I'd like to add the Nextflow variable ${workflow.runName} and local username $USER to the AWS batch job name

Is this possible to redefine in a configuration? I see that one can label individual process but I'd like to do this for all processes. Thank you! Warmest, Olga

Originally asked: https://groups.google.com/forum/#!topic/nextflow/odWQRzwtgAI

Contributor Guide