flyteorg/flyte

Add Array Node Index To current_context [Core feature]

Open

#5534 aperta il 2 lug 2024

Vedi su GitHub
 (8 commenti) (0 reazioni) (1 assegnatario)Python (378 fork)batch import
enhancementgood first issuehacktoberfest

Metriche repository

Star
 (3705 star)
Metriche merge PR
 (Merge medio 3g 8h) (114 PR mergiate in 30 g)

Descrizione

Motivation: Why do you think this is important?

In many cases, the index of array node in map tasks is needed, especially if the task is programmed to output a file with a static name that will be overwritten by subsequent array nodes. the index will help add a good name to that file for example and can be backtraced.

Goal: What should the final outcome look like, ideally?

In the returned current_context() value, a filed of node_index or a good name should be there representing the map_task index.

Describe alternatives you've considered

I generated a random id for each instance to distinguish which output came from which node.

Propose: Link/Inline OR Additional context

No response

Are you sure this issue hasn't been raised already?

  • Yes

Have you read the Code of Conduct?

  • Yes

Guida contributor