aws/aws-sdk-pandas

EMR create_cluster support pass bootstrap arguments

Open

#3 191 ouverte le 29 août 2025

Voir sur GitHub
 (3 commentaires) (0 réactions) (1 assigné)Python (3 560 stars) (630 forks)batch import
enhancementgood first issuehelp wanted

Description

Is your idea related to a problem? Please describe. Currently the API emr.create_cluster only offer simple bootstraps_paths parameters, which not allow client to add additional arguments for the bootstrap scripts. This is limited the re-use-ablity of the scripts.

Describe the solution you'd like Please to have a pull request to enhance this, by pass a List[Union[str, dict[str, any]]] which can support both cases

  1. current sample list of bootstrap uri list
  2. the following bootstrap configurations with additional arguments, this will align with https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/emr/client/run_job_flow.html
{
  "name": "install CW agent",
  "path": "s3//example-bucket/emr-boostraps/install-cw.sh",
  "args": ["--target-aws-account", "121213", ... ],
}

P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.

Guide contributeur

Stack technique
python
Domaine
backendapicloud
Type d'issue
feature
DifficultéDifficulté estimée pour un nouveau contributeur, de 1 pour un très petit changement à 5 pour un travail expert.
3
Temps estiméFourchette de temps approximative pour investiguer, implémenter, tester et préparer une pull request.
1-3 hours
Statut d'activitéDisponibilité apparente de l'issue : fraîche, active, ancienne, bloquée ou en attente d'un mainteneur.
blocked
ClartéClarté avec laquelle l'issue explique le changement attendu, les critères d'acceptation et la prochaine étape.
mostly clear
Prérequis
PythonAWS EMR basicsboto3 API knowledge
Accessibilité débutantScore de 1 à 100 estimant l'accessibilité de cette issue pour un premier contributeur.
20
Direction de recherche
The issue requests adding support for bootstrap arguments in the `emr.create cluster` function. The current implementation only accepts a list of script paths. The solution should accept a list that can include either strings (paths) or dictionaries with additional arguments, aligning with boto3's `run job flow` API. Examine the existing implementation in the `awswrangler/emr.py` file, particularly the `create cluster` function. Review the boto3 documentation for `BootstrapActionConfig` structure. There is an assignee, so check for any linked PRs or ongoing work. The discussion in the issue may provide further details on expected behavior.