Skip to content

diag: own Location (move from libs/dyn) - #6974

Merged
denik merged 7 commits into
mainfrom
denik/diag-location-structpath
Oct 9, 2026
Merged

denik merged 7 commits into
mainfrom
denik/diag-location-structpath

Conversation

@denik

@denik denik commented Oct 7, 2026 •

Copy link
Copy Markdown
Contributor

Changes

Location moves from libs/dyn to libs/diag; callers use diag.Location directly. libs/diag no longer imports libs/dyn.

Why

Stacked on #6980 (diagnostic paths use structpath, which removes diag's other dependency on dyn). Prep for #6954, which removes libs/dyn from bundle configuration.

This pull request and its description were written by Isaac.

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Oct 7, 2026 •

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: c9b732f

Run: 37906339382

Env ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 276 16 4:24
✅​ aws-windows-latest-4core-16gb 278 14 3:39
✅​ azure linux-2core-8gb 275 16 4:05
✅​ azure-windows-latest-4core-16gb 277 14 4:24
✅​ gcp linux-2core-8gb 276 16 4:31
✅​ gcp-windows-latest-4core-16gb 278 14 4:01
Top 3 slowest tests (at least 2 minutes):
duration env testname
4:22 azure-windows-latest-4core-16gb TestAccept
3:58 gcp-windows-latest-4core-16gb TestAccept
3:37 aws-windows-latest-4core-16gb TestAccept

@denik
denik marked this pull request as ready for review October 7, 2026 12:30
@denik
denik requested review from a team as code owners October 7, 2026 12:30
@github-actions github-actions Bot added the AIR Databricks AI Runtime CLI label Oct 7, 2026
@denik
denik force-pushed the denik/diag-location-structpath branch from c8121ae to 8b3a26a Compare October 7, 2026 13:23
@denik
denik force-pushed the denik/diag-location-structpath branch from 30536d2 to 3afe070 Compare October 7, 2026 14:29
@denik denik changed the title diag: own Location and use structpath for diagnostic paths diag: own Location (move from libs/dyn) Oct 7, 2026
@denik
denik changed the base branch from main to denik/diag-paths-structpath October 7, 2026 14:29
@denik
denik force-pushed the denik/diag-location-structpath branch 5 times, most recently from 53d29f7 to 4be88ef Compare October 8, 2026 07:50
@denik
denik force-pushed the denik/diag-location-structpath branch 3 times, most recently from c17b428 to 87a5a1d Compare October 8, 2026 11:57
@denik
denik force-pushed the denik/diag-location-structpath branch from 87a5a1d to d4aea66 Compare October 8, 2026 16:20
@denik
denik force-pushed the denik/diag-location-structpath branch from d4aea66 to 52ca95b Compare October 8, 2026 16:35
@denik
denik added this pull request to stack #6997 October 9, 2026 08:18
Base automatically changed from denik/diag-paths-structpath to main October 9, 2026 08:38
denik and others added 7 commits October 9, 2026 10:38
Move Location from libs/dyn to libs/diag and use diag.Location directly, so
libs/diag no longer imports libs/dyn.

Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik force-pushed the denik/diag-location-structpath branch from 52ca95b to c9b732f Compare October 9, 2026 08:39
andreamatt pushed a commit to andreamatt/databricks-cli that referenced this pull request Oct 9, 2026
## Changes
`diag.Diagnostic.Paths` is `[]*structpath.PathNode` instead of
`[]dyn.Path`. Producers convert existing dyn paths with
`dyn.ToStructPaths` or build paths from keys with
`structpath.NewStringKeys`/`NewStringKeysSlice`/`MustParsePaths`.
`structpath.PureReferenceToPath` moves to
`dynvar.PureReferenceToStructPath` so structpath does not import dyn.

User-visible: diagnostic paths quote map keys that are not identifiers,
e.g. `resources.jobs['${var.env}_job']` instead of
`resources.jobs.${var.env}_job` (one golden).

## Why
First step of removing `libs/dyn` from bundle configuration: databricks#6974 moves
`Location` to `libs/diag` on top of this (it needs diag to no longer
import dyn), then databricks#6954.

This pull request and its description were written by Isaac.

---------

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik added this pull request to the merge queue Oct 9, 2026
Merged via the queue into main with commit 4e0f463 Oct 9, 2026
27 checks passed
@denik
denik deleted the denik/diag-location-structpath branch October 9, 2026 10:44
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 4e0f463

Run: 37919553630

Env ❌​FAIL 🔄​flaky ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 1428 1133 118:26
🔄​ aws-windows-latest-4core-16gb 3 1350 1158 137:24
❌​ azure linux-2core-8gb 12 2 1263 1185 104:45
❌​ azure-windows-latest-4core-16gb 12 2 1188 1210 128:17
🔄​ gcp linux-2core-8gb 3 1263 1189 110:41
✅​ gcp-windows-latest-4core-16gb 1191 1214 129:39
20 interesting tests: 12 FAIL, 8 flaky
Test Name aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb
❌​ TestAccept 🔄​f ❌​F ❌​F 🔄​f
❌​ TestAccept/bundle/deployment/bind/alert ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/deployment/bind/alert/DMS= ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/generate/alert ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/generate/alert/DMS= ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/generate/alert/DMS=true ✅​p ❌​F ❌​F ✅​p
🔄​ TestAccept/bundle/invariant/no_drift ✅​p ✅​p ✅​p 🔄​f
🔄​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1 ✅​p ✅​p 🔄​f ✅​p
🔄​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=genie_space.yml.tmpl/READPLAN= ✅​p ✅​p ✅​p 🔄​f
🔄​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_pydabs_1000_tasks.yml.tmpl/READPLAN=1 ✅​p ✅​p 🔄​f ✅​p
❌​ TestAccept/bundle/resources/alerts/basic ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/resources/alerts/basic/DMS= ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/resources/alerts/basic/DMS=true ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/resources/alerts/with_file ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/resources/alerts/with_file/DMS= ✅​p ❌​F ❌​F ✅​p
❌​ TestAccept/bundle/resources/alerts/with_file/DMS=true ✅​p ❌​F ❌​F ✅​p
🔄​ TestAccept/bundle/resources/postgres_branches/purge_on_delete_transitions 🔄​f 🙈​s 🙈​s 🙈​s
🔄​ TestAccept/bundle/resources/postgres_branches/purge_on_delete_transitions/DMS= 🔄​f
🔄​ TestAccept/bundle/resources/quality_monitors/create ✅​p 🔄​f ✅​p ✅​p
🔄​ TestAccept/bundle/resources/quality_monitors/create/DMS= ✅​p 🔄​f ✅​p ✅​p
Top 50 slowest tests (at least 2 minutes):
duration env testname
12:27 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
11:42 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
11:41 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
11:26 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:52 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
9:38 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
8:33 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
8:32 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
8:22 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:21 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
7:52 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:51 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:32 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:27 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:22 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:20 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:20 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:20 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:20 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:14 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:06 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:04 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:00 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:58 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
6:52 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:44 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:44 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:26 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
5:57 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:45 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
5:45 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
5:45 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:39 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
5:34 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:21 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:16 gcp-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
5:12 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=
5:05 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:04 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:04 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:02 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=
5:01 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
5:00 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true
4:47 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
4:34 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true
4:31 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=
4:23 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true
4:16 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/inline_config/DMS=
4:07 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=
4:05 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AIR Databricks AI Runtime CLI DABs DABs related issues PyDABs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants