Skip to content

[WIP] Add Azure Data Factory Jobs Monitoring documentation#37962

Draft
kevinzenghu wants to merge 2 commits into
masterfrom
kevinzenghu/add-adf-jobs-monitoring-docs
Draft

[WIP] Add Azure Data Factory Jobs Monitoring documentation#37962
kevinzenghu wants to merge 2 commits into
masterfrom
kevinzenghu/add-adf-jobs-monitoring-docs

Conversation

@kevinzenghu

Copy link
Copy Markdown
Contributor

Summary

  • Documents Azure Data Factory Jobs Monitoring (pipeline runs, activities, lineage) — private preview.
  • Corrects an earlier internal finding: a code-only pass found an internal knowledge-base comment saying "not GA, do not promise to customers." Kevin confirmed directly that ADF is in preview with a real setup doc — that internal knowledge-base file is stale and should be updated separately (not in scope of this PR).

Source

Adapted from an internal setup guide: https://docs.google.com/document/d/1LQdwYkuyfid-Xhs59fuh8lylXHpswAGSMHgpE46wvDo/edit — no internal-only infrastructure in this one (standard Azure Portal / az CLI / Datadog UI paths only), unlike the parallel Postgres doc.

Open items

  • Confirm current phase (Preview, access-on-request) with DO PM before merging.
  • Sanity-check the exact role-assignment JSON and CLI commands against a live setup, since they're adapted from a doc rather than independently verified against code.
  • No screenshot included — flagging per the pipeline's screenshot policy.
  • Separately: the internal do_product_agent knowledge-base file (domains/data_observability/apps/apis/do_product_agent/internal/knowledge/engineering/integrations.md) still says "not GA" and should be corrected so it doesn't mislead the next person/agent who checks it.

Status

Work in progress — not ready for review yet. Draft, no reviewers requested.

AI assistance

Content adapted by Claude Code from a human-authored internal setup doc (linked above) into Datadog documentation style — flagging per the AI-assistance disclosure in CONTRIBUTING.md.

Corrects an earlier finding: a prior code-only pass found an internal
knowledge-base comment stating "not GA, do not promise to customers" and
concluded this shouldn't be publicly documented. Kevin confirmed directly
that ADF is in private preview with access available on request, backed
by a setup guide — the internal knowledge-base file was stale relative
to the feature's actual current phase (a real instance of the
"most recent live signal wins" precedence rule; the stale knowledge-base
file should be updated separately).

Content is adapted from that setup guide into house style (tabs for the
two role-assignment options, standard Datadog UI/CLI conventions),
following the existing AWS Glue Jobs Monitoring page's structure. No
internal-only URLs or infrastructure in this one — Azure Portal, az CLI,
and Datadog's own already-public UI paths only.

AI assistance: adapted by Claude Code from a human-authored internal
setup doc (linked in the PR), restructured into Datadog documentation
style; Azure permission/role details are not independently verified
against code, only against the source doc.
@github-actions

github-actions Bot commented Jul 5, 2026

Copy link
Copy Markdown
Contributor

Same class of bug just found and fixed for Airbyte: this PR's new page
and card-grid link were correctly added, but the separate sidebar-nav
config (config/_default/menus/main.en.yaml) was not — this branch
predates discovering that file exists. Added the missing entry right
after AWS Glue, matching the card-grid ordering already in this PR.
@github-actions github-actions Bot added the Architecture Everything related to the Doc backend label Jul 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Architecture Everything related to the Doc backend

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant