[air] Record workload submission and source staging telemetry by ben-hansen-db · Pull Request #6904 · databricks/cli

ben-hansen-db · 2026-10-01T16:39:37Z

Changes

Record AIR submission telemetry with requested compute, configuration-presence flags, outcome/latency, and job run ID. Include compressed source tarball bytes, GIT_ARCHIVE/PLAIN_TAR packaging mode, and separate packaging/upload durations. Cache hits report zero phase durations and omit the size; failed attempts retain measurements already collected.

Why

Bring workload visibility in line with Python AIR and help explain slow source staging. The companion ingestion schema, https://github.com/databricks-eng/universe/pull/2720990, has landed; gpu_type carries the API's canonical accelerator name (e.g. GPU_1xH100) as that schema defines. Events use the existing upload-at-exit pipeline and telemetry opt-out; first-log timing is deferred.

Tests

Added coverage for new uploads, cache reuse, absent versus zero measurements, Git and working-tree packaging, and failed packaging/upload/submission. ./task fmt, ./task checks, full ./task lint, doctests, and all root/tools module unit tests passed (11,641 tests; 143 skipped).

Full ./task test reached acceptance tests but stopped at the new prerequisite requiring jq >= 1.7 (this machine has 1.6).

This PR was written with Codex.

eng-dev-ecosystem-bot · 2026-10-01T17:07:22Z

Integration test report

Commit: eda943a

Run: 37858079793

	Env	✅pass	🙈skip	Time
✅	aws linux-2core-8gb	276	16	5:35
✅	aws-windows-latest-4core-16gb	278	14	3:25
✅	azure linux-2core-8gb	275	16	5:21
✅	azure-windows-latest-4core-16gb	277	14	3:35
✅	gcp linux-2core-8gb	276	16	5:09
✅	gcp-windows-latest-4core-16gb	278	14	3:27

Top 6 slowest tests (at least 2 minutes):

duration	env	testname
4:06	azure linux-2core-8gb	TestAccept
3:53	aws linux-2core-8gb	TestAccept
3:50	gcp linux-2core-8gb	TestAccept
3:33	azure-windows-latest-4core-16gb	TestAccept
3:25	gcp-windows-latest-4core-16gb	TestAccept
3:23	aws-windows-latest-4core-16gb	TestAccept

The landed air_run.proto defines gpu_type as an optional string holding the API's canonical accelerator name, not an enum, so send GPU_1xH100-style values and omit the field when unresolved. Count rank-partitioned containers as using a Unity Catalog image, since each container must set one. Co-authored-by: Isaac <no-reply@databricks.com>

Co-authored-by: Isaac <no-reply@databricks.com>

pietern · 2026-10-08T10:09:47Z

 		info = entry.Info
+		if info.ObjectType == workspace.ObjectTypeFile {
+			info.Size = int64(len(entry.Data))
+		}


Looks unrelated, can you drop from the diff?

yeah, this was to support code source bytes when it is cached but I think in case of cache hit we will actually leave it blank.

pietern · 2026-10-08T10:11:30Z

+	"github.com/stretchr/testify/require"
+)
+
+func TestAirRunEventOptionalMeasurements(t *testing.T) {


It looks like this test only verifies that JSON marshalling through pointers works.

If so, I recommend dropping it.

Good catch, dropped.

A cache hit uploads nothing, so leave code_source_size_bytes unset instead of reading the remote file size. This drops the fake workspace change that only existed to support it, and the JSON marshalling test in protos. Co-authored-by: Isaac <no-reply@databricks.com>

The cache check was inlined only to read the remote size, which cache hits no longer report. Co-authored-by: Isaac <no-reply@databricks.com>

eng-dev-ecosystem-bot · 2026-10-09T02:27:09Z

Integration test report

Commit: ef9eea3

Run: 37861111218

	Env	❌FAIL	🔄flaky	✅pass	🙈skip	Time
❌	aws linux-2core-8gb	35		1393	1133	139:00
❌	aws-windows-latest-4core-16gb	38		1315	1158	151:13
🔄	azure linux-2core-8gb		8	1269	1185	123:17
🔄	azure-windows-latest-4core-16gb		4	1198	1210	134:52
❌	gcp linux-2core-8gb	41		1225	1189	137:44
❌	gcp-windows-latest-4core-16gb	38		1153	1214	149:06

131 interesting tests: 119 FAIL, 12 flaky

	Test Name	aws linux-2core-8gb	aws-windows-latest-4core-16gb	azure linux-2core-8gb	azure-windows-latest-4core-16gb	gcp linux-2core-8gb	gcp-windows-latest-4core-16gb
❌	TestAccept	❌F	❌F	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/config-remote-sync/job_params_variables	✅p	🙈s	✅p	🙈s	❌F	🙈s
❌	TestAccept/bundle/config-remote-sync/job_params_variables/DMS=	✅p		✅p		❌F
❌	TestAccept/bundle/config-remote-sync/json_status_selectors	✅p	🙈s	✅p	🙈s	❌F	🙈s
❌	TestAccept/bundle/config-remote-sync/json_status_selectors/DMS=true	✅p		✅p		❌F
❌	TestAccept/bundle/config-remote-sync/multiple_files	✅p	🙈s	✅p	🙈s	❌F	🙈s
❌	TestAccept/bundle/config-remote-sync/multiple_files/DMS=	✅p		✅p		❌F
❌	TestAccept/bundle/config-remote-sync/multiple_files/DMS=true	✅p		✅p		❌F
❌	TestAccept/bundle/config-remote-sync/multiple_resources	✅p	🙈s	✅p	🙈s	❌F	🙈s
❌	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=	✅p		✅p		❌F
❌	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true	✅p		✅p		❌F
❌	TestAccept/bundle/config-remote-sync/output_json	✅p	🙈s	✅p	🙈s	❌F	🙈s
❌	TestAccept/bundle/config-remote-sync/output_json/DMS=true	✅p		✅p		❌F
❌	TestAccept/bundle/deployment/bind/dashboard/recreation	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/deployment/bind/dashboard/recreation/DMS=/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/deployment/bind/registered-model	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/deployment/bind/registered-model/DMS=	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/deployment/bind/schema	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/deployment/bind/schema/DMS=	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/deployment/bind/secret-scope	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/deployment/bind/secret-scope/DMS=	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/deployment/bind/vector_search_endpoint	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/deployment/bind/vector_search_endpoint/DMS=	✅p	✅p	🔄f	✅p	✅p	✅p
❌	TestAccept/bundle/dms/successful-recreate	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/dms/successful-recreate/DMS=true	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=job_pydabs_10_tasks.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=job_table_update_trigger.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=job_with_depends_on.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=model.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=pipeline.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=pipeline_allow_duplicate_names.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=registered_model.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
🔄	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=schema_empty_grants.yml.tmpl	✅p	✅p	✅p	🔄f	✅p	✅p
🔄	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=schema_tf_compat.yml.tmpl	✅p	✅p	✅p	🔄f	✅p	✅p
🔄	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=schema_uppercase_name.yml.tmpl	✅p	✅p	✅p	🔄f	✅p	✅p
🔄	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=secret_scope.yml.tmpl	✅p	✅p	✅p	🔄f	✅p	✅p
❌	TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=volume_uppercase_name.yml.tmpl	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/delete_idempotent	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=1	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=1	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_run.yml.tmpl/READPLAN=1	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_table_update_trigger.yml.tmpl/READPLAN=1	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=model_serving_endpoint.yml.tmpl/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=model_serving_endpoint.yml.tmpl/READPLAN=1	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=model_with_permissions.yml.tmpl/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=model_with_permissions.yml.tmpl/READPLAN=1	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=schema_grant_ref.yml.tmpl/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=schema_grant_ref.yml.tmpl/READPLAN=1	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=schema_uppercase_name.yml.tmpl/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=schema_uppercase_name.yml.tmpl/READPLAN=1	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/destroy_idempotent	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=dashboard.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=experiment.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=experiment.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=genie_space.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=instance_pool.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=instance_pool.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_pydabs_1000_tasks.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_pydabs_1000_tasks.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=pipeline_allow_duplicate_names.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=pipeline_allow_duplicate_names.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=pipeline_config_dots.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=pipeline_config_dots.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/no_drift	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=app.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret_scope_default_backend_type.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret_scope_default_backend_type.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=sql_warehouse.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=sql_warehouse.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_path_job_ref.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_path_job_ref.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_uppercase_name.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_uppercase_name.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/local_state_staleness	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/local_state_staleness/DMS=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/local_state_staleness/DMS=true	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/python/mutator-permissions-owner-5682	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/python/mutator-permissions-owner-5682/DMS=/PYDAB_VERSION=0.266.0	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/python/mutator-permissions-owner-5682/DMS=true/PYDAB_VERSION=0.266.0	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/quiet-levels	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/quiet-levels/DMS=true	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/alerts/with_file	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/alerts/with_file/DMS=	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/alerts/with_file/DMS=true	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/apps/lifecycle-started	❌F	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/apps/lifecycle-started-toggle	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/apps/lifecycle-started/DMS=	❌F	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS=	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS=true	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/basic	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/basic/DMS=	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/basic/DMS=true	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/factcheck/update_mask_spec	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/factcheck/update_mask_star	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/purge_on_delete	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/purge_on_delete/DMS=	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/purge_on_delete/DMS=true	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/recreate	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/recreate/DMS=	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/recreate/DMS=true	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/remove_history_retention	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/remove_history_retention/DMS=	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/remove_history_retention/DMS=true	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend/DMS=	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend/DMS=true	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/update_display_name	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=true	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/update_history_retention	❌F	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/update_history_retention/DMS=	❌F	❌F
❌	TestAccept/bundle/resources/postgres_projects/update_history_retention/DMS=true	❌F	❌F

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
14:07	azure linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
11:01	azure linux-2core-8gb	TestAccept/bundle/resources/clusters/deploy/update-after-create/DMS=
10:35	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
10:24	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DMS=
9:04	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:53	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
8:53	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
8:53	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:45	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
8:25	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
8:21	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:51	azure linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:47	aws linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:33	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:28	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:27	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:22	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:19	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:14	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:14	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:09	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:02	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:01	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:00	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
7:00	azure linux-2core-8gb	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:56	azure linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
6:54	aws linux-2core-8gb	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:46	azure linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
6:43	aws linux-2core-8gb	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:40	gcp linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
6:36	azure linux-2core-8gb	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:35	aws linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
6:17	gcp linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
6:12	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DMS=true
5:51	gcp linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
5:43	azure-windows-latest-4core-16gb	TestAccept/bundle/deploy/spark-jar-task/DMS=true
5:36	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:35	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:33	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:31	aws linux-2core-8gb	TestAccept/bundle/deploy/spark-jar-task/DMS=
5:28	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DMS=
5:25	gcp linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
5:22	aws-windows-latest-4core-16gb	TestAccept/bundle/deploy/spark-jar-task/DMS=true
5:18	azure linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:11	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:09	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:09	aws-windows-latest-4core-16gb	TestAccept/bundle/deploy/spark-jar-task/DMS=
5:08	aws linux-2core-8gb	TestAccept/bundle/deploy/spark-jar-task/DMS=true
5:08	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:06	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true

github-actions Bot added the AIR Databricks AI Runtime CLI label Oct 1, 2026

ben-hansen-db requested a review from maggiewang-db October 7, 2026 21:05

ben-hansen-db marked this pull request as ready for review October 7, 2026 21:05

ben-hansen-db requested review from a team as code owners October 7, 2026 21:05

ben-hansen-db requested review from parthban-db and rugpanov October 7, 2026 21:05

ben-hansen-db and others added 2 commits October 7, 2026 21:23

[air] Record workload submission and source staging telemetry

f663f41

ben-hansen-db force-pushed the air/workload-telemetry branch from df62798 to 097f685 Compare October 7, 2026 21:59

[air] Shorten AIR telemetry README section

856fa6b

Co-authored-by: Isaac <no-reply@databricks.com>

pietern reviewed Oct 8, 2026

View reviewed changes

pietern approved these changes Oct 8, 2026

View reviewed changes

ben-hansen-db and others added 2 commits October 8, 2026 23:01

[air] Restore snapshotExists

eda943a

The cache check was inlined only to read the remote size, which cache hits no longer report. Co-authored-by: Isaac <no-reply@databricks.com>

ben-hansen-db enabled auto-merge October 8, 2026 23:26

ben-hansen-db added this pull request to the merge queue Oct 8, 2026

Merged via the queue into main with commit ef9eea3 Oct 8, 2026
25 checks passed

ben-hansen-db deleted the air/workload-telemetry branch October 8, 2026 23:44

Navigation Menu

Repository navigation

[air] Record workload submission and source staging telemetry - #6904

[air] Record workload submission and source staging telemetry#6904
ben-hansen-db merged 5 commits into
mainfrom
air/workload-telemetry

ben-hansen-db commented Oct 1, 2026 •

edited

Loading

Uh oh!

eng-dev-ecosystem-bot commented Oct 1, 2026 •

edited

Loading

Uh oh!

pietern Oct 8, 2026

Uh oh!

ben-hansen-db Oct 8, 2026

Uh oh!

pietern Oct 8, 2026

Uh oh!

ben-hansen-db Oct 8, 2026

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Oct 9, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

ben-hansen-db commented Oct 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Why

Tests

Uh oh!

eng-dev-ecosystem-bot commented Oct 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Integration test report

Uh oh!

pietern Oct 8, 2026

Choose a reason for hiding this comment

Uh oh!

ben-hansen-db Oct 8, 2026

Choose a reason for hiding this comment

Uh oh!

pietern Oct 8, 2026

Choose a reason for hiding this comment

Uh oh!

ben-hansen-db Oct 8, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Oct 9, 2026

Integration test report

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

ben-hansen-db commented Oct 1, 2026 •

edited

Loading

eng-dev-ecosystem-bot commented Oct 1, 2026 •

edited

Loading