nextflow-io/nextflow

Custom AWS Batch job names

Open

#1,232 opened on Jul 18, 2019

View on GitHub
 (4 comments) (0 reactions) (0 assignees)Groovy (784 forks)batch import
executor/aws-batchgood first issuestale

Repository metrics

Stars
 (3,382 stars)
PR merge metrics
 (Avg merge 16d 9h) (54 merged PRs in 30d)

Description

Usage scenario

Hello! We have several people using Nextflow on AWS and it's getting confusing whose jobs are whose in the job queue. I'd like to be able to scan the job listing and see whose jobs are where, and since I often submit multiple workflows, also the workflow.runName to keep track of which workflow this e.g. trimming step is from. For example, Instead of "make_additional_gtf_1" I'd like the job name to be: maniac_franklin__olgabot__make_additional_gtf_1

Suggest implementation

One implementation I can think of is to add a variably-defined name_prefix to the workflow params:

params {
    name_prefix = "${workflow.runName}__${workflow.userName}"
} 

(Highlight the main building blocks of a possible implementation and/or related components)

Hello, I'd like to add the Nextflow variable ${workflow.runName} and local username $USER to the AWS batch job name

Is this possible to redefine in a configuration? I see that one can label individual process but I'd like to do this for all processes. Thank you! Warmest, Olga

Originally asked: https://groups.google.com/forum/#!topic/nextflow/odWQRzwtgAI

Contributor guide