Subsequent cluster deployments always causes updates on TF if cluster has DATA_SECURITY_MODE: SINGLE_USER

Open
#4,418 1 comment 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
42/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
go, terraform

Research direction

Read acceptance/bundle/integration_whl/interactive_single_user and compare its direct deployment behavior with the Terraform behavior described in the issue and PR 3768. Done when acceptance coverage records the intended handling of subsequent deployments for DATA_SECURITY_MODE: SINGLE_USER and the regression behavior is resolved.

Written by the indexing model from the issue text.

Description

DABs engine/direct No Autoclose
Describe the issue

Direct deployment does not update/restart the cluster on subsequent deploys which is correct, and thus changes for the wheel are not picked, which is expected in such case.

But this is a regression behaviour comparing to TF because TF test behaviour for wheel jobs on single-user interactive clusters is technically incorrect because TF in such a setup produces permanent drift (incorrect), which leads to cluster restart on each bundle deploy, and therefore wheel changes are picked up

  # databricks_cluster.shared_autoscaling will be updated in-place
  ~ resource "databricks_cluster" "shared_autoscaling" {
        id                             = "1015-102652-xxxxxxx"
      - single_user_name               = "aaaaaaaabbbb-bbbb-cccc-dddd-bb6ce382668a" -> null
        # (19 unchanged attributes hidden)
        # (1 unchanged block hidden)
    }

More details here https://github.com/databricks/cli/pull/3768

Configuration

See ‎acceptance/bundle/integration_whl/interactive_single_user acceptanct test

Is this a regression?

Yes, comparing to TF deployment behaviour

Dominant language
Go
Stars
427
Forks
267
Avg merge
2d 1h
Merged PRs (30d)
233

Getting set up

  • Ships a Dockerfile or Docker Compose file
  • Has a pull request template
  • No contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from databricks/cli

All issues in databricks/cli

Similar issues

More Go issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.