Skip to content

Align pipelines show preview and add pipeline ID support to history - #6995

Open
chenyuem-db wants to merge 1 commit into
mainfrom
chenyuem-db/pipelines-public-api
Open

chenyuem-db wants to merge 1 commit into
mainfrom
chenyuem-db/pipelines-public-api

Conversation

@chenyuem-db

Copy link
Copy Markdown

Changes

PRD: SDP Turbo CLI — Requirements

Implementation files below are relative to cmd/pipelines/.

databricks tables get FULL_NAME already uses the UC GetTable API and returns the full TableInfo including the schema. We don't need to add another pipelines schema cmd for this.

Command PRD requirement This PR Files
show P0: show the table name Added to text output. show.go
show P0: preview the first 5 rows by default Kept the existing default of 10 per review; callers can pass --limit 5. show.go (existing path)
show P0: allow more rows with --limit n Existing override retained. show.go (existing path)
show P0: support JSON output for agents Existing JSON format retained. show.go (existing path)
show P1: hint how to see more rows Added when the default text preview returns 10 rows. show.go
show P2: show immediate upstream/external sources Not included. —
history Accept <pipeline id> Added direct-ID mode without requiring a bundle. history.go
history P0 output requirement: last 5 pipeline runs, if available Deferred: determine how a limit composes with existing start/end-time filters, and whether API or CLI should implement it. —
history P0 output requirement: metrics matching the UI Deferred pending public API support. Existing state/time output is unchanged. —
history Support --output json Existing Key / Updates format retained. history.go (existing path)

Supporting files:

  • Acceptance: new acceptance/pipelines/history/basic/; updated show output snapshots.
  • Release note: .nextchanges/cli/pipelines-public-api.md.

Why

Keep history scoped to pipeline-ID support. Both ID and bundle modes retain the original pagination, time filters, output formats, and dry-run inclusion, returning all matching updates without a total limit. The API-versus-CLI decision for combining time filters with a default of 5 is left to follow-up work; utils.go and existing history unit tests are unchanged.

Tests

Pipelines unit tests, mock-API acceptance tests for history/show/help, Go lint, diff checks, and changelog validation passed locally.

Implementation assisted by Codex.

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Oct 8, 2026 •

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: e10050e

Run: 37848441644

Env ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 276 19 5:28
✅​ aws-windows-latest-4core-16gb 278 17 4:01
✅​ azure linux-2core-8gb 275 19 5:15
✅​ azure-windows-latest-4core-16gb 277 17 3:35
✅​ gcp linux-2core-8gb 276 19 5:22
✅​ gcp-windows-latest-4core-16gb 278 17 3:26
Top 6 slowest tests (at least 2 minutes):
duration env testname
4:05 azure linux-2core-8gb TestAccept
3:58 aws-windows-latest-4core-16gb TestAccept
3:56 aws linux-2core-8gb TestAccept
3:53 gcp linux-2core-8gb TestAccept
3:33 azure-windows-latest-4core-16gb TestAccept
3:23 gcp-windows-latest-4core-16gb TestAccept

@chenyuem-db
chenyuem-db force-pushed the chenyuem-db/pipelines-public-api branch from 8b617d6 to e10050e Compare October 8, 2026 21:39

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants