aws/aws-sdk-pandas

EMR create_cluster support pass bootstrap arguments

Open

#3,191 创建于 2025年8月29日

在 GitHub 查看
 (3 评论) (0 反应) (1 负责人)Python (3,560 star) (630 fork)batch import
enhancementgood first issuehelp wanted

描述

Is your idea related to a problem? Please describe. Currently the API emr.create_cluster only offer simple bootstraps_paths parameters, which not allow client to add additional arguments for the bootstrap scripts. This is limited the re-use-ablity of the scripts.

Describe the solution you'd like Please to have a pull request to enhance this, by pass a List[Union[str, dict[str, any]]] which can support both cases

  1. current sample list of bootstrap uri list
  2. the following bootstrap configurations with additional arguments, this will align with https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/emr/client/run_job_flow.html
{
  "name": "install CW agent",
  "path": "s3//example-bucket/emr-boostraps/install-cw.sh",
  "args": ["--target-aws-account", "121213", ... ],
}

P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.

贡献者指南

技术栈
python
领域
backendapicloud
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
1-3 hours
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
blocked
清晰度议题是否清楚说明期望改动、验收标准和下一步。
mostly clear
前置要求
PythonAWS EMR basicsboto3 API knowledge
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
20
研究方向
The issue requests adding support for bootstrap arguments in the `emr.create cluster` function. The current implementation only accepts a list of script paths. The solution should accept a list that can include either strings (paths) or dictionaries with additional arguments, aligning with boto3's `run job flow` API. Examine the existing implementation in the `awswrangler/emr.py` file, particularly the `create cluster` function. Review the boto3 documentation for `BootstrapActionConfig` structure. There is an assignee, so check for any linked PRs or ongoing work. The discussion in the issue may provide further details on expected behavior.