All pull requests

Pull requests

• spec : cost-aware MTP draft length (split 4/4 of #58)

  #102·LaurentZuijdwijk opened Sep 27, 2026Member·

  ·
  1

• ggml-cuda : shape-aware graph cache key (split 2/4 of #58)

  CUDAggml
  #100·LaurentZuijdwijk opened Sep 27, 2026Member·

  ·
  2

  

• server : preserve context checkpoints across slot save/restore

  server
  #98·ChrisC381 opened Sep 27, 2026·

  ·

• hip: optimize Qwen3.8-Flash-Next prefill on Strix Halo

  CUDAggmlmodeltesting
  #91·gaetan-puleo opened Sep 26, 2026Collaborator·

  ·
  1

• server : add --cache-disk for a persistent prompt cache

  documentationserver
  #81·storm1er opened Sep 22, 2026·

  ·
  3

• ggml-cuda : round growing pool requests up to a power of two

  CUDAggml
  #78·michal-zurkowski opened Sep 20, 2026·

  ·

• trace : add DeepSeek V4.1 cross-runtime correctness harness

  builddocumentationexamplesservertesting
  #71·ajaxdude opened Sep 17, 2026Member·2/2·

  ·

• deepseek41 : add core DeepSeek V4.1 runtime (arch, loader, Engram, expert store, memory admission, watchdog)

  buildconversiondocumentationggmlmodeltesting
  #70·ajaxdude opened Sep 17, 2026Member·1/2·

  ·

• llama : qwen35/qwen35moe GDN graph - 2-D output projection, in-place recurrent state, masked h_nextn fix

  modeltesting
  #57·SimonTeixidor opened Sep 14, 2026·

  ·
  2

• HIP : RDNA3.5 MMVQ/MMQ kernels and per-type dispatch thresholds for quantised matmul

  CUDAggml
  #56·SimonTeixidor opened Sep 14, 2026·

  ·
  2

• cuda: ROCmFPx tensor types + Q4_0_ROCMFP4_FAST MMQ tiles on HIP (gfx1151)

  CUDAggml
  #40·baraxnaxgaming-commits opened Sep 10, 2026·

  ·
  2

• ggml : backport persistent view initialization after buffer-size splits

  ggmltesting
  #37·arc-uri-el opened Sep 8, 2026·

  ·
  2

• server : preserve RAM-cached branches sharing a large prompt prefix

  server
  #36·arc-uri-el opened Sep 8, 2026·

  ·
  2

• Fix/rocmfpx encoder review

  ggmltestingVulkan
  #31·LaurentZuijdwijk opened Sep 7, 2026Member·

  ·
  1

• vulkan: fix ROCmFPx mat-vec cost at batch 3-8 on rocmfpx/wholesale-reference

  #7·LaurentZuijdwijk opened Aug 29, 2026Member·

  ·
  1