aws/aws-sdk-pandas

Add support for Elasticache

Open

#2,198 创建于 2023年4月13日

在 GitHub 查看
 (3 评论) (0 反应) (0 负责人)Python (3,560 star) (630 fork)batch import
featurehelp wanted

描述

Is your feature request related to a problem? Please describe. A common use case is upload data from S3 to AWS elasticache (Redis/Memcache). It would be great to have this functionality in aws-sdk-pandas. The read workflow is not required as its not typical functionality to read the key/values into dataframe.

Describe the solution you'd like Requesting an API similar to Opensearch index_df https://aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.opensearch.index_df.html#awswrangler.opensearch.index_df that will take dataframe key and value fields and does a batch insert to elasticache.

Describe alternatives you've considered

Additional context

贡献者指南

技术栈
pythonawsredis
领域
backenddatacloud
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
1-2 days
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
PythonAWS S3pandasElasticache
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
50
研究方向
First, examine the existing opensearch module at https://aws sdk pandas.readthedocs.io/en/stable/stubs/awswrangler.opensearch.index df.html and its source code to understand the API pattern. Then, design a similar API for Elasticache (Redis/Memcache) that takes a DataFrame with key and value columns and performs batch inserts. Consider using the redis py or python memcached client libraries. The implementation would likely involve adding a new module under `awswrangler/elasticache/` with functions like `index df` or `put records`. Review current PRs or discussions in the issue comments for any prior work or design decisions.