Skip to content

task: first look at upstream v0.34.0, and the one divergence to carry - #290

Merged
glennneuber merged 1 commit into
mainfrom
docs/upstream-034-divergence
Sep 10, 2026
Merged

glennneuber merged 1 commit into
mainfrom
docs/upstream-034-divergence

Conversation

@glennneuber

Copy link
Copy Markdown

Written after checking 0.34.0 ahead of today's merges.

  • The native payload is unchanged between v0.33.3 and v0.34.0 (MLX_VERSION, MLX_C_VERSION, LLAMA_CPP_VERSION byte-identical), so 0.34.0 is a Go- and app-side release: every regression result in this fold's write-ups stays valid across the sync, and a Go-only binary swap measures it without a CUDA rebuild.
  • 88 files / 21 commits, mostly app/, x/mlxrunner (xgrammar, speculate), cmd/, server/. x/mlxrunner/client.go gains requestGrammar and does not touch admission. x/models/nn/nn.go, x/mlxrunner/mlx/ops_extra.go and the generated bindings are untouched.
  • One deliberate divergence: upstream fixed the same runnerRef.LogValue race on 2026-09-05 in b5d373f3 (fix data races in progress and sched ollama/ollama#18319), four days before server: fix the data race between runnerRef.unload and LogValue #289 and independently, using refMu.TryLock() with the fields omitted when contended. Because sync.Mutex is not reentrant, the 11 of ~25 log sites that already hold refMu always fail that TryLock and permanently lose name, inference, pid and num_ctx; upstream also ships no regression test. The doc records the comparison and the decision to keep ours at the sync, resolve the LogValue conflict in our favour, and offer ours upstream so the divergence can be retired.

🤖 Generated with Claude Code

0.34.0 keeps the 0.33.3 native payload byte-identical (MLX, MLX-C,
llama.cpp), so it is a Go/app release and every regression result in this
fold's write-ups survives the sync. It also fixes the same runnerRef
LogValue data race we fixed, four days earlier and independently, with
TryLock instead of a second mutex -- which permanently drops four attrs
from the 11 log sites that already hold refMu, and ships no test. Record
the comparison and the decision to keep ours at the sync.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@glennneuber
glennneuber merged commit cf5ebb4 into main Sep 10, 2026
1 check passed
@glennneuber
glennneuber deleted the docs/upstream-034-divergence branch September 10, 2026 11:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant