aws/aws-sdk-pandas

EMR create_cluster support pass bootstrap arguments

Open

#3,191 opened on Aug 29, 2025

View on GitHub
 (3 comments) (0 reactions) (1 assignee)Python (3,560 stars) (630 forks)batch import
enhancementgood first issuehelp wanted

Description

Is your idea related to a problem? Please describe. Currently the API emr.create_cluster only offer simple bootstraps_paths parameters, which not allow client to add additional arguments for the bootstrap scripts. This is limited the re-use-ablity of the scripts.

Describe the solution you'd like Please to have a pull request to enhance this, by pass a List[Union[str, dict[str, any]]] which can support both cases

  1. current sample list of bootstrap uri list
  2. the following bootstrap configurations with additional arguments, this will align with https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/emr/client/run_job_flow.html
{
  "name": "install CW agent",
  "path": "s3//example-bucket/emr-boostraps/install-cw.sh",
  "args": ["--target-aws-account", "121213", ... ],
}

P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.

Contributor guide

Tech stack
python
Domain
backendapicloud
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
blocked
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
mostly clear
Prerequisites
PythonAWS EMR basicsboto3 API knowledge
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20
Research direction
The issue requests adding support for bootstrap arguments in the `emr.create cluster` function. The current implementation only accepts a list of script paths. The solution should accept a list that can include either strings (paths) or dictionaries with additional arguments, aligning with boto3's `run job flow` API. Examine the existing implementation in the `awswrangler/emr.py` file, particularly the `create cluster` function. Review the boto3 documentation for `BootstrapActionConfig` structure. There is an assignee, so check for any linked PRs or ongoing work. The discussion in the issue may provide further details on expected behavior.
EMR create_cluster support pass bootstrap arguments · aws/aws-sdk-pandas#3191 | Good First Issue