Skip to content

fix(discovery): variants= dropped from manifest; model= shorthand vs ServerHandle (#378)#55

Merged
PaulFidika merged 1 commit into
masterfrom
fix/discovery-variant-dedup
Jul 4, 2026
Merged

fix(discovery): variants= dropped from manifest; model= shorthand vs ServerHandle (#378)#55
PaulFidika merged 1 commit into
masterfrom
fix/discovery-variant-dedup

Conversation

@PaulFidika

Copy link
Copy Markdown
Contributor

Closes #378 (tracker). Two @endpoint API bugs found by the inference-endpoints #343 port:

  1. variants= silently dropped from endpoint.lock: discover_functions deduped manifest entries by (declared_module, class_name, python_name); variant rows share all three with their base function. The stamped name is now part of the dedup key. Repro: any variants-using endpoint's manifest only contained the base function.
  2. model= shorthand + runtime= documented shape failed at decoration: _resolve_single_slot counted a ServerHandle-annotated setup() param as a slot candidate, so setup(self, model: str, server: ServerHandle) (the docs' engine-hosted example) raised "model= needs exactly one setup() parameter". ServerHandle params are now excluded.

Tests: two regressions added; full suite 221 passed, 1 skipped.

…ndle setup params in model= slot resolution (#378)
@PaulFidika PaulFidika merged commit 772f5e1 into master Jul 4, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant