Feature request: native bundle variable substitution in explicitly selected files
I maintainer di solito rispondono entro 1 giorno
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Idoneità per principianti
- 35/100
Direzione di ricerca
Start by reading the bundle configuration and deployment staging entry points, then trace how target variables are resolved and applied to native bundle configuration. The issue does not name specific files or tests; identify the relevant implementation and tests for file selection, rendering, and staging. Done means an opt-in workflow renders selected files from the resolved target context without modifying sources and covers the requested errors, escaping, sensitive values, and notebook behavior.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Feature request
Support opt-in deployment-time substitution of bundle variables in additional files and directories, using the same resolved context as native bundle configuration.
For example, a bundle could explicitly select SQL migrations, JSON/YAML configuration files, and notebook sources containing ${var.<name>}. The CLI would prepare rendered copies for deployment or for use by an external deployment step.
Example use case
The bundle defines catalog and schema variables, with different values per target. A separate SQL file contains:
CREATE TABLE IF NOT EXISTS `${var.target_catalog}`.`${var.target_schema}`.example (
id BIGINT
);
A JSON payload contains:
{
"catalog": "${var.target_catalog}",
"schema": "${var.target_schema}"
}
We would like to select these files by path, directory, or glob and have Databricks apply native variable resolution when preparing them for the selected target.
Current workaround and cost
We maintain a separate renderer in a deployment wrapper. It gets values from bundle validate -o json, substitutes them into additional files, and restores the working tree afterward.
This duplicates file-rendering and lifecycle work. It also couples the wrapper to validation-output redaction: with UC secrets present, unrelated string variable values are redacted even though native deployment has the actual values internally.
Reading defaults and resolving overrides ourselves would create a second implementation of Databricks bundle semantics. We want the CLI to own resolution.
Requested capability
- Explicitly opt in files, directories, or globs; ordinary synchronized files should keep their current behavior by default.
- Use the selected target's native resolution, including shared configuration, existing variable precedence, lookups, and substitutions.
- Prepare rendered copies without modifying source files in the working tree.
- Offer the rendered files through deployment staging and/or an output directory usable by external pre/post-deployment steps. A deployment-only upload transform would not cover SQL migrations executed by another tool.
- Report unresolved references with file locations and provide a way to keep literal placeholder syntax.
- Define escaping and type behavior for supported formats. For
.ipynb, substitute cell source without rewriting outputs or metadata. - Define sensitive-value handling so substitutions cannot inadvertently appear in logs or source control; document any restrictions.
The configuration key and command shape are up to the maintainers. The core request is reuse of the native resolved bundle context for explicitly selected file contents.
Benefit
This would let consumers keep a single source of truth for target-specific values, reduce custom renderers and Git restoration logic, and avoid depending on display-output redaction for file preparation.
Native file rendering would solve the payload-preparation portion of our wrapper. External SQL execution would still need a supported way to obtain its non-secret connection settings, such as the warehouse ID.
Related issue
#6000 describes a related JSON/SQL substitution need for Genie. This request is broader: explicitly selected file contents and rendered output that external deployment steps can consume.
If a supported workflow already provides this capability, a pointer to it would be appreciated.
- Lingua principale
- Go
- Stelle
- 409
- Fork
- 253
- Merge medio
- 1g 11h
- PR unite (30g)
- 212
Preparare l'ambiente
- Include un Dockerfile o un file Docker Compose
- Ha un modello di pull request
- Nessuna guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di databricks/cli
-
Apps commands only accept relative path to app.ymlForse già presa @yuri-rod l’ha presa 16 giorni fa. ApertaCLI
Difficoltà 2/5 1-3 ore Idoneità per principianti 82/100
databricks/cli#6910 ·
I maintainer di solito rispondono entro 1 giorno
-
DABs
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
databricks/cli#6670 ·
I maintainer di solito rispondono entro 1 giorno
-
bundle validate does not catch missing trigger.table_update.condition with multiple tablesForse già presa @yuri-rod l’ha presa 2 giorni fa. ApertaDABs Enhancement
Difficoltà 3/5 1-2 giorni Idoneità per principianti 72/100
databricks/cli#7101 ·
I maintainer di solito rispondono entro 1 giorno
-
DABs Enhancement
Difficoltà 5/5 Più di una settimana Idoneità per principianti 35/100
databricks/cli#7099 ·
I maintainer di solito rispondono entro 1 giorno
-
DABs
Difficoltà 4/5 3-5 giorni Idoneità per principianti 45/100
databricks/cli#7032 ·
I maintainer di solito rispondono entro 1 giorno
Tutte le issue di databricks/cli
Issue simili
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 60/100
-
✨ Propose the missing gate after three same-class findings instead of filing a fourthForse già presa @hivecommons-hive l’ha presa oggi. Apertaenhancement help wanted hive/claimed-by-scanner stage/040-covered-by-pr
Difficoltà 2/5 1-3 ore Idoneità per principianti 72/100
hivecommons/hive#13428 · 3 commenti · 1 reazione ·
I maintainer di solito rispondono entro 1 giorno
-
🕷️ bug
Difficoltà 2/5 1-3 ore Idoneità per principianti 70/100
sysadminsmedia/homebox#1805 ·
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100