aws/aws-sdk-pandas

EMR create_cluster support pass bootstrap arguments

Open

#3,191 建立於 2025年8月29日

在 GitHub 查看
 (3 留言) (0 反應) (1 負責人)Python (3,560 star) (630 fork)batch import
enhancementgood first issuehelp wanted

描述

Is your idea related to a problem? Please describe. Currently the API emr.create_cluster only offer simple bootstraps_paths parameters, which not allow client to add additional arguments for the bootstrap scripts. This is limited the re-use-ablity of the scripts.

Describe the solution you'd like Please to have a pull request to enhance this, by pass a List[Union[str, dict[str, any]]] which can support both cases

  1. current sample list of bootstrap uri list
  2. the following bootstrap configurations with additional arguments, this will align with https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/emr/client/run_job_flow.html
{
  "name": "install CW agent",
  "path": "s3//example-bucket/emr-boostraps/install-cw.sh",
  "args": ["--target-aws-account", "121213", ... ],
}

P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.

貢獻者指南

技術棧
python
領域
backendapicloud
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
1-3 hours
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
blocked
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
mostly clear
前置要求
PythonAWS EMR basicsboto3 API knowledge
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
20
研究方向
The issue requests adding support for bootstrap arguments in the `emr.create cluster` function. The current implementation only accepts a list of script paths. The solution should accept a list that can include either strings (paths) or dictionaries with additional arguments, aligning with boto3's `run job flow` API. Examine the existing implementation in the `awswrangler/emr.py` file, particularly the `create cluster` function. Review the boto3 documentation for `BootstrapActionConfig` structure. There is an assignee, so check for any linked PRs or ongoing work. The discussion in the issue may provide further details on expected behavior.