cube-js/cube

Support adding prefix/subfolder under an S3 bucket for Redshift

Open

#5114 opened on Aug 18, 2022

View on GitHub
 (1 comment) (2 reactions) (0 assignees)Rust (19,563 stars) (1,965 forks)batch import
driver:redshifthelp wanted

Description

Is your feature request related to a problem? Please describe. Ccube does not support adding prefix/subfolder under an S3 bucket in .env file. If you try to hard-code path after the bucket name it will have errors like: InvalidBucketName: Bucket name shouldn't contain '/', received (your wrong path here)

Describe the solution you'd like Maybe to have CUBEJS_DB_EXPORT_BUCKET changed to CUBEJS_DB_EXPORT_PATH

Describe alternatives you've considered

Contributor guide

Tech stack
typescriptnodejsawspostgresql
Domain
backenddatabasedatacloud
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
Cube.js configuration knowledgeEnvironment variable usageAWS S3 basics
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70
Research direction
Investigate how CUBEJS DB EXPORT BUCKET is used in Cube.js configuration parsing, likely in packages like @cubejs backend/server. The change involves adding a new environment variable for path/prefix and appending it to bucket names in S3 export calls. Ensure backward compatibility and update documentation.