aws/aws-sdk-pandas

Add support for Elasticache

Open

Aperta il 13 apr 2023

Vedi su GitHub
 (3 commenti) (0 reazioni) (0 assegnatari)Python (3560 star) (630 fork)batch import
featurehelp wanted

Descrizione

Is your feature request related to a problem? Please describe. A common use case is upload data from S3 to AWS elasticache (Redis/Memcache). It would be great to have this functionality in aws-sdk-pandas. The read workflow is not required as its not typical functionality to read the key/values into dataframe.

Describe the solution you'd like Requesting an API similar to Opensearch index_df https://aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.opensearch.index_df.html#awswrangler.opensearch.index_df that will take dataframe key and value fields and does a batch insert to elasticache.

Describe alternatives you've considered

Additional context

Guida contributor

Tech stack
pythonawsredis
Dominio
backenddatacloud
Tipo issue
feature
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
3
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
1-2 days
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
stale
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
clear
Prerequisiti
PythonAWS S3pandasElasticache
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
50
Direzione di ricerca
First, examine the existing opensearch module at https://aws sdk pandas.readthedocs.io/en/stable/stubs/awswrangler.opensearch.index df.html and its source code to understand the API pattern. Then, design a similar API for Elasticache (Redis/Memcache) that takes a DataFrame with key and value columns and performs batch inserts. Consider using the redis py or python memcached client libraries. The implementation would likely involve adding a new module under `awswrangler/elasticache/` with functions like `index df` or `put records`. Review current PRs or discussions in the issue comments for any prior work or design decisions.