Skip to content

air: show workspace-supported accelerators in compute help - #6993

Draft
caroline-db wants to merge 1 commit into
mainfrom
air/list-compute-options
Draft

caroline-db wants to merge 1 commit into
mainfrom
air/list-compute-options

Conversation

@caroline-db

Copy link
Copy Markdown
Contributor

Changes

  • Update databricks air run -h config.compute to show accelerator types available in the selected workspace, including per-node counts and launch stages.
  • Fall back to the built-in list when workspace-specific options are unavailable. Disabled or missing endpoints fall back silently; unexpected failures include a warning.

Why

Compute help currently advertises every accelerator type known to the CLI, including types unavailable in the selected workspace. Workspace-aware help keeps the guidance accurate while preserving compatibility during backend rollout.

Tests

  • go test ./cmd/air
  • Config-help acceptance test
  • Verified disabled and missing endpoints with a locally built CLI.
  • Verified workspace-aware accelerator filtering end to end.

@github-actions github-actions Bot added the AIR Databricks AI Runtime CLI label Oct 8, 2026
@caroline-db
caroline-db force-pushed the air/list-compute-options branch from 8e98332 to 4464f3f Compare October 8, 2026 18:31
@caroline-db
caroline-db force-pushed the air/list-compute-options branch from 4464f3f to 6b2cfe5 Compare October 8, 2026 18:37
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 6b2cfe5

Run: 37825803422

Env ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 276 17 5:28
✅​ aws-windows-latest-4core-16gb 278 15 3:58
✅​ azure linux-2core-8gb 275 17 5:14
✅​ azure-windows-latest-4core-16gb 277 15 4:11
✅​ gcp linux-2core-8gb 276 17 5:23
✅​ gcp-windows-latest-4core-16gb 278 15 4:07
Top 6 slowest tests (at least 2 minutes):
duration env testname
4:08 azure-windows-latest-4core-16gb TestAccept
4:05 gcp-windows-latest-4core-16gb TestAccept
3:56 aws-windows-latest-4core-16gb TestAccept
3:54 gcp linux-2core-8gb TestAccept
3:49 aws linux-2core-8gb TestAccept
3:49 azure linux-2core-8gb TestAccept

Comment thread cmd/air/runconfig.go
@@ -890,6 +896,63 @@ func renderConfigField(w io.Writer, f configField) {
fmt.Fprintf(w, "\nUse \"-h %s.<field>\" for details on a field.\n", f.path)
}

func filterKnownComputeOptions(options []computeOption) []computeOption {

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do we need another layer of filtering?

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AIR Databricks AI Runtime CLI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants