Skip to content

Upgrade llama.cpp from b11883 to b11887 - #566

Merged
bernardladenthin merged 1 commit into
mainfrom
chore/llama-b11887
Oct 25, 2026
Merged

bernardladenthin merged 1 commit into
mainfrom
chore/llama-b11887

Conversation

@bernardladenthin

Copy link
Copy Markdown
Owner

Four upstream commits, all in the tagged release b11887.

  • fix exhausting CPU and MEM caused by dry sequence breaker ggml-org/llama.cpp#31035, a cap on DRY sequence breakers. llama.h gains LLAMA_DRY_MAX_SEQ_BREAKERS (64). A long breaker list exhausted CPU and memory, because each distinct breaker costs one scan of the vocabulary when the sampler is built. Now:
    • the request schema drops duplicate dry_sequence_breakers and refuses more than 64 distinct ones as an invalid request;
    • the sampler itself stops at 64 with a warning (this covers --dry-sequence-breaker).
  • #31028: Qwen4-exp tensors are merged on conversion.
  • #30977, #31157: upstream CI and tests only.

This project

  • Two new C++ tests in test_server.cpp pin the new contract:
    • duplicates are dropped and the order of first occurrence is kept;
    • 64 distinct breakers plus a duplicate are accepted, a 65th is refused.
  • InferenceParameters.withDrySequenceBreakers Javadoc names the limit.
  • Version bump: pin, LlamaCppVersion, README, CLAUDE.md (pin and test counts 671 → 673), CHANGELOG, the breaking-changes history, the NOTICE.md version cell.
  • All twelve patches apply unchanged on 6050b467c (commit count 11887).
  • Unchanged: CMakeLists.txt, common/, the license files, vendor/, the WebUI lockfile.

Checked locally: check-patches.py (0 problems), check-natives.py, spotless:check, clang-format 23.1.3 on test_server.cpp. Build and tests are left to CI.

🤖 Generated with Claude Code

https://claude.ai/code/session_01VszvDmRRPP1UcwozsUMY1L

Four upstream commits, tagged. #31035 caps the DRY sequence breakers: llama.h gains
LLAMA_DRY_MAX_SEQ_BREAKERS (64), the request schema drops duplicate dry_sequence_breakers and
refuses more than 64 distinct ones (each costs a scan of the vocabulary when the sampler is built,
so a long list exhausted CPU and memory), the sampler stops at 64 with a warning. Two C++ tests pin
the new contract (duplicates dropped in order; 64 distinct plus a duplicate accepted, one more
refused), and withDrySequenceBreakers' Javadoc names it. #31028 merges Qwen4-exp tensors on
conversion; #30977 and #31157 touch upstream CI and tests only.

All twelve patches apply unchanged on 6050b467c (commit count 11887); CMakeLists.txt, common/, the
license files, vendor/ and the WebUI lockfile are unchanged. Checked locally: check-patches (12
patches, 94 hunks, 0 problems), check-natives, spotless:check, clang-format 23.1.3 on
test_server.cpp; the build and tests are CI's.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01VszvDmRRPP1UcwozsUMY1L
@coderabbitai

coderabbitai Bot commented Oct 25, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

Caution

Review failed

The pull request is closed.

Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@bernardladenthin
bernardladenthin merged commit 081457f into main Oct 25, 2026
8 of 15 checks passed
@bernardladenthin
bernardladenthin deleted the chore/llama-b11887 branch October 25, 2026 19:44
@sonarqubecloud

Copy link
Copy Markdown

This branch had an error being deployed

1 failed deployment
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant