Skip to content

Add durable server-owned inference commands - #173

Draft
akgohain wants to merge 1 commit into
agent/platform-hardeningfrom
agent/durable-inference-command
Draft

Add durable server-owned inference commands#173
akgohain wants to merge 1 commit into
agent/platform-hardeningfrom
agent/durable-inference-command

Conversation

@akgohain

@akgohain akgohain commented Aug 4, 2026

Copy link
Copy Markdown
Collaborator

Summary

Moves approved agent inference requests onto the same durable server-command pattern already used for training.

  • Approval now stages a queued start_inference workflow command.
  • The server resolves workflow paths/configuration, submits inference idempotently, and records a workflow operation plus inference events.
  • The client monitors the accepted command without launching inference a second time in the browser.
  • Existing manual inference launch behavior remains unchanged.

Follow-on

This layer records successful worker acceptance. A later stacked PR will reconcile true worker completion, failure, cancellation, and recovery into durable operation state.

Verification

  • uv run pytest -q tests/test_pytc_runtime_routes.py tests/test_workflow_routes.py — 107 passed
  • Focused frontend tests — 20 passed
  • Production frontend build passed (pre-existing EHTool hook warnings remain).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant