Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
338 commits
Select commit Hold shift + click to select a range
16378d9
CUDA/HIP: Flash Attention tuning (gfx1201) (#28102)
pwilkin Sep 11, 2026
b0dcb81
server: fix speculation after an image (#28715)
jesdga95 Sep 11, 2026
5cdd3d1
model : fix MTP context kv cache allocation for deepseek2, glm4moe, ……
LoganChu Sep 11, 2026
aac8102
metal : fix idle threads in the remaining iq mul_mv kernels for ne00 …
masterFoad Sep 11, 2026
a2878d3
metal : single-source fusion table + fusion debug rework (#28164)
ggerganov Sep 11, 2026
1dfe94e
common : fix typo in speculative.cpp comment [no ci] (#28750)
danbev Sep 11, 2026
3bcfeb7
cmake : add PCH and unity build to improve build times (#28091)
danbev Sep 11, 2026
5bda51b
metal : skip the empty half of the mul_mm_id token tile (#28301)
masterFoad Sep 11, 2026
43f3dda
ggml: skip 0-sized ids tensor when offloading selected experts (#28739)
am17an Sep 11, 2026
8172e65
tests: tolerate a shared pool abort in test_completion_unified (#28759)
ServeurpersoCom Sep 11, 2026
982937a
tests: extend test-quantize-fns to test nrc=2 (i8mm) kernels (#16234)
Rohanjames1997 Sep 11, 2026
b78a39a
ci : run test-backend-ops as a dedicated ci/run.sh test (#28740)
ggerganov Sep 11, 2026
8ea2902
cmake : skip PCH for llama-server PCH when using MSVC (#28763)
danbev Sep 11, 2026
82d6bb2
server: refactor subproc handling (#28555)
ngxson Sep 11, 2026
d3146f2
ggml-webgpu: Update to a recent version of Dawn (#28683)
MendyBerger Sep 12, 2026
eafe15a
hexagon: support for multi-device model split (aka row-split) (#28589)
max-krasnyansky Sep 12, 2026
3f5e94d
webgpu: align tensor bindings to the type block size (#28382)
ServeurpersoCom Sep 12, 2026
07fc977
opencl: add bin kernel `kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_…
shaofeiqi Sep 12, 2026
8a56aed
opencl: fix several bugs where the backend aborts (#27630)
wanghqc Sep 12, 2026
c069aa7
server: frame the router child state command as a whole line (#28747)
ServeurpersoCom Sep 12, 2026
f3a33df
rpc : fix linking when compiling with BUILD_SHARED_LIBS=OFF (#28492)
EAddario Sep 12, 2026
2a3005c
syscl : Handle (fail gracefully) unsupported tq1_0 quants (#28681)
mctylr-gh Sep 12, 2026
718f7b4
vendor : update cpp-httplib to 0.56.0 (#28787)
cabelo Sep 12, 2026
e192abb
server : add missing headers (#28795)
angt Sep 12, 2026
c8edceb
ggml-cuda: hip add specific config table for AMD GCN (#27841)
thelittlefireman Sep 12, 2026
56381e4
server : allow model downloads at model limit fix issue #26809 (#28530)
chenmiaoming Sep 12, 2026
3057bb6
ui : add cache (#28802)
angt Sep 12, 2026
737e098
cmake: leave the timestamp out of precompiled headers on clang (#28816)
ServeurpersoCom Sep 12, 2026
ae9afff
jinja : support dot property integer literals (#28817)
CISC Sep 12, 2026
acecd56
common : implement common_schema internal representation for JSON sch…
aldehir Sep 12, 2026
8e33095
common: add LOG_JSON macro to log structured data (#28586)
ngxson Sep 12, 2026
790cf51
chat : improve parsing of complex types in qwen3-coder (#28742)
aldehir Sep 13, 2026
56b9eb2
opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0…
wanghqc Sep 13, 2026
f1e44dc
vulkan: workaround NV queuesubmit driver bug (#28830)
jeffbolznv Sep 13, 2026
002a12a
ci : cap test-backend-ops parallel jobs at 2 and add a 3600s timeout …
ggerganov Sep 13, 2026
37b3a9e
ci : remove leftover command (#28839)
CISC Sep 13, 2026
4a89937
tests : reduce FA test sizes (#28842)
ggerganov Sep 13, 2026
bc52a12
pi : prefer PI_MODEL_NAME env var for model disclosure (#28853)
ggerganov Sep 13, 2026
c95f8e4
ci : run editorconfig and code-style checks on ubuntu-slim (#28854)
ggerganov Sep 13, 2026
b6b003d
sycl : Fix get mem error (#28227)
arthw Sep 13, 2026
243a308
tests : fix typo in test-quant-type-selection for nemotron 3 nano (#2…
mctylr-gh Sep 13, 2026
6978052
ggml-cpu(s390x): guard VXE-only repack helpers (#28775)
bernardladenthin Sep 13, 2026
e49d2c2
models : guard the expert FFN size fallback in nemotron-h against a z…
YanissAmz Sep 13, 2026
5f436dd
tests : exclude HY_V4 from WebGPU test-llama-archs tests (#28855)
fairydreaming Sep 13, 2026
7a16a6c
grammar : coalesce find + insert into a single insert and adjust move…
HanClinto Sep 13, 2026
ad6c668
ggml-cuda: fallback to F32 on device without BF16 hardware accelerati…
thelittlefireman Sep 13, 2026
093a2f8
common : move llama_n_rs_seq to before llama_decode (#28749)
danbev Sep 14, 2026
661643e
sycl : fix oneDNN scratchpad breaking the pool free order (#28704)
lslusarczyk Sep 14, 2026
15d8f2d
ci : remove gg_sum summary logic (#28857)
ggerganov Sep 14, 2026
89fe242
ci : trigger self-hosted CI on changes to ci/run.sh (#28859)
ggerganov Sep 14, 2026
2f53959
ggml-cpu : disable PCH and fix CACHE_LINE_SIZE ambiguity to fix heap …
ggerganov Sep 14, 2026
21f6b0d
sycl: rfc: Use radix select for top_k (#28670)
cwriter Sep 14, 2026
3d10bcd
llama: add Maple 20B-A1B ternary MoE architecture (CPU) (#27000)
AlexGabbia Sep 14, 2026
be2c6d7
tests(s390x): add non-vxe build to tests (#28776)
taronaeo Sep 14, 2026
1aca1f9
models : fix mimo2 swa pattern load (#28865)
CISC Sep 14, 2026
97e4ca7
models : fix incorrect uses of get_key_or_arr (#28868)
CISC Sep 14, 2026
bbdd9f2
tests : add fusion baseline README and broaden fusion CI triggers (#2…
ggerganov Sep 14, 2026
eeea731
ggml : bump version to 0.24.0 (ggml/1627)
ggerganov Sep 14, 2026
d9e03f1
sync : ggml
ggerganov Sep 14, 2026
b29c606
llama.cpp : bump version to 0.4.1 (#28900)
ggerganov Sep 14, 2026
dfe4516
scripts: Add script to verify API/ABI compatibility (#28579)
ckastner Sep 14, 2026
f3a184b
cmake : remove precompiled headers (#28892)
danbev Sep 14, 2026
b4fa47d
release : added gfx1103 to ubuntu rocm build (#28423)
apparle Sep 14, 2026
41abbfd
qwen4exp: enable rms_norm + mul fusion (#28896)
am17an Sep 14, 2026
391fac1
ci : add ubuntu-cuda builds to release (#28186)
ORippler Sep 14, 2026
bfdc321
HIP: fattn-mma: use fp32 accumulation on MFMA devices (#28576)
IMbackK Sep 14, 2026
96ffdc4
CI: hip-quality-check: ignore spill added in bfdc32183d57f1e35bacf35c…
IMbackK Sep 14, 2026
7cf1c54
ci : reuse build tag name when used instead of safe one (#28911)
CISC Sep 14, 2026
1bc7a5a
webui: stop re-probing disabled /tools endpoint on every message (#28…
geckguy Sep 14, 2026
69eb250
cmake : use PROJECT_SOURCE_DIR instead of CMAKE_SOURCE_DIR (#28771)
danbev Sep 15, 2026
4c9233c
cuda : enable i16 and i32 for DUP (#28897)
amankarki151 Sep 15, 2026
987498f
ci : fix android release (#28936)
CISC Sep 15, 2026
0ecb159
ci: Bump CUDA Windows x64 builds to 13.4.1 (#28930)
shivamkumard-ctrl Sep 15, 2026
1e7bcf3
metal : add FA kernels for HSK=96, HSV=64 (MiniCPM3) (#28599)
wyanzhao Sep 15, 2026
1af6c65
ci: bump kleidiai runners from 22.04 to 24.04 (#28885)
taronaeo Sep 15, 2026
6ec1a7e
opencl: add generic ssm_scan (#28881)
lhez Sep 15, 2026
77d554b
OpenVINO: optimize stateful decode and GPU MoE inference (#28638)
wine99 Sep 15, 2026
fc82583
vulkan: support sparse Flash Attention (#28105)
0cc4m Sep 15, 2026
9e71716
models : move build_arch_graph() after graph() template specializatio…
cpeterso Sep 15, 2026
5431581
cuda: support row-contiguous SUM_ROWS (#26308)
MohamedElashri Sep 15, 2026
7609846
rpc : hash-cache only weights (#28789)
Patt92 Sep 15, 2026
6011c34
docs: Rule of thumb for AI review time [no ci] (#28945)
JohannesGaessler Sep 15, 2026
d1d3c33
ci: build MUSA for only 1 arch (#28944)
am17an Sep 15, 2026
9f31776
opencl: choose the MoE expert matmul by batch size for speculative de…
wanghqc Sep 15, 2026
38a5b42
HIP: Enable AllReduce for ROCm (#27825)
Stastez Sep 15, 2026
72b590d
hex-cpy: use dma if src and dst are contiguous (#28906)
trivikram-reddy1 Sep 15, 2026
930e2fa
hexagon: add back missing contiguous fast-path and hvx_copy_uu for ea…
jhen0409 Sep 15, 2026
e13469a
llama-bench: support --version to print build info (#28971)
asbelin Sep 16, 2026
583926e
ci : add self-hosted webgpu to hf-jobs (#28712)
CISC Sep 16, 2026
0a8b29a
metal: fix NaN in mul_mm_id when activations exceed f16 range (#26223)
mdegans Sep 16, 2026
d4365d9
vulkan: make MUL_MAT_ID BN/2 tail unconditional (#28923)
SG-Amadeus Sep 16, 2026
0bec16e
chat : force `\n</think>` on reasoning budget end for qwen3-coder (#2…
aldehir Sep 16, 2026
fccf716
HIP: broaden MoE ncols_opt tile heuristic on RDNA3.5 architecture (#2…
WenqiangJia2026 Sep 16, 2026
37b53fd
qwen4exp: add hc ops (#28901)
am17an Sep 16, 2026
b04d4e5
Change max context length for auto-fitting with unified KV (#28849)
gaugarg-nv Sep 16, 2026
6019933
rpc : invalidate cached compute graph when a referenced buffer is fre…
y198nt Sep 16, 2026
f266648
spacemit : fix wrong transpose function for int16 data (#25161)
I3eg1nner Sep 16, 2026
83078fe
CUDA/HIP: improve access patterns in im2col (#28013)
IMbackK Sep 16, 2026
7d6f5d0
model : add support for HrmTextForCausalLM (DFM Mimir 1B) (#27625)
noctrex Sep 16, 2026
7ceed87
models : allow Nemotron-H models to only define layer_norm_epsilon (#…
frozenblade1224 Sep 16, 2026
82324fc
hexagon: accept the zeroed rope probe in supports_op (#28995)
rjtokenring Sep 16, 2026
1ec8188
hexagon: Support for K-Quants Q4_K and Q6_K (#28994)
rjtokenring Sep 16, 2026
2f3fd02
Enable CUDA graph for MTP draft (#28549)
gaugarg-nv Sep 16, 2026
c6824a9
ci: switch fast jobs back to github (#28959)
netrunnereve Sep 16, 2026
fb27a52
TP: fix split state and granularity for fused QKV gemma4, qwen35 (#28…
dfriehs Sep 16, 2026
4bc272f
vulkan: work around NV bug with argsort_large.comp (#28975)
jeffbolznv Sep 16, 2026
aa39d7a
[SYCL] Fix function signature for `ggml_backend_sycl_split_buffer_typ…
mctylr-gh Sep 17, 2026
35822af
vulkan: support qwen4exp hc ops (#28988)
0cc4m Sep 17, 2026
05f2dcf
vulkan: fix buffer_reference alignment in im2col shaders (#28996)
apollo-2006 Sep 17, 2026
79bfc1d
docs: remove JG as CODEOWNER for test-llama-archs (#29003)
JohannesGaessler Sep 17, 2026
c57da6f
opencl: fix various warnings (#28984)
lhez Sep 17, 2026
817e5f8
sycl: ssm_conv: fuse the SiLU epilogue into the ssm_conv kernel (#28929)
Titaniumtown Sep 17, 2026
7490357
vulkan: skip unneeded MoE work in mul_mm coopmat1 path (#25483)
fish-jiang Sep 17, 2026
c9a5eee
sycl : fix the B70 mem allocate error when >19.3GB (#28953)
arthw Sep 17, 2026
81aeaeb
gguf : align the data section relative to the GGUF start, not the fil…
ykhrustalev Sep 17, 2026
7f6f0c2
chat : add message delimiters to the DeepSeek V3.2/V4 parser (#29008)
midagedev Sep 17, 2026
87f9c82
ci : add API/ABI check to make-release workflow [no ci] (#28947)
danbev Sep 17, 2026
f172be7
vulkan: split buffers and debug code into separate files, add shared …
0cc4m Sep 17, 2026
4ff829e
ui: fix removed reasoning menu in single model mode on desktop (#27985)
benbenbenbenbenben Sep 17, 2026
ebbb185
openvino : Update OpenVINO to 2026.4;fix clangd,MSVC warnings; (#29009)
ravi9 Sep 17, 2026
7076180
model : extend Nemotron MTP support (#29018)
frozenblade1224 Sep 17, 2026
b49650a
model : skip gate_up_exps if TENSOR_SKIP is set (#29014)
dfriehs Sep 17, 2026
c77ae69
rpc : skip ACCEL devices (#29020)
pcuenca Sep 17, 2026
972d231
ci : add missing evict-old-files (#29041)
CISC Sep 17, 2026
5c53396
vulkan: raise the hoisted row-id limit for mul_mat_id from 256 to 512…
drluoto Sep 18, 2026
bdcbaaf
ci : bump android-actions/setup-android to 4.0.4 (#29065)
CISC Sep 18, 2026
f03cf3e
ci : disable GHA cache for copilot (#29068)
CISC Sep 18, 2026
bb11ebb
gguf-py: fix Q8_1 block size in GGML_QUANT_SIZES (2+2+32) (#29036)
YangHong7 Sep 18, 2026
8ed1a55
cmake : fix build when GGML_CPU=OFF and GGML_CUDA=ON (#29026)
iamfobey Sep 18, 2026
dc85f89
vocab : add ufakzeka pre-tokenizer (#29033)
stfurkan Sep 18, 2026
bbd488c
vulkan: add IQ3_S MMQ matmul kernels (#28822)
vargad Sep 18, 2026
911f6cd
ggml : handle graph buffer reservation failure (#26070)
FaiChou Sep 18, 2026
44be98f
ggml-webgpu: fix supports_op condition for GET_ROWS (#28978)
yomaytk Sep 18, 2026
d663dd3
ci: change ubuntu-latest to ubuntu-24.04 (#29079)
taronaeo Sep 18, 2026
542348a
Model-Saver: Write the SWA pattern, 15 more architectures roundtrip (…
ServeurpersoCom Sep 18, 2026
5b335f4
ggml : check for allocation failures to prevent crashes (#28149)
sanmai Sep 18, 2026
4fea119
ggml-cpu: add F16 input to the FWHT (#27779)
bri-prism Sep 18, 2026
ec92815
opencl: add bin kernel `kernel_gemm_noshuffle_q6_k_f32_32b_trans_ila_…
shaofeiqi Sep 18, 2026
18a04f0
hexagon: HMX flash-attention head_dim padding (support DK=DV=72) (#26…
tboinovski1 Sep 18, 2026
50631b3
hexagon: im2col update (#29103)
tboinovski1 Sep 18, 2026
2b18470
hexagon: add ROLL op support (#29105)
tboinovski1 Sep 18, 2026
60081bb
opencl: add support for bin kernel `flash_attn_f32_f16_bin` (#29046)
dsproule Sep 18, 2026
b23701f
cuda : fix CUB argsort corruption caused by in-place keys (#28389)
TheArchitectit Sep 19, 2026
59fc5a1
metal : support qwen4exp hc ops (#29000)
ggerganov Sep 19, 2026
efa28e9
test-llama-archs : generate dummy test vocab (#29084)
ggerganov Sep 19, 2026
60b06ab
metal : fix FA support checks (#29122)
ggerganov Sep 19, 2026
5b59b83
metal : add MoE and SSM_CONV fusion optimizations (#28948)
ggerganov Sep 19, 2026
eb1e1f4
json-schema : accept escaped hyphen in regex patterns (#29127)
ChihebBENCHEIKH1 Sep 19, 2026
1af554f
server : improve startup log messages (#29125)
ggerganov Sep 19, 2026
7d4b92b
hexagon: enable support for TOP_K op (#29113)
aparmp-quic Sep 19, 2026
851cb34
hexagon: add support for GEGLU_QUICK (#29114)
aparmp-quic Sep 19, 2026
e613ef2
hexagon: enable I32 GET_ROWS (#29116)
aparmp-quic Sep 19, 2026
59657a6
chat : add dedicated Ling 3.0 (Bailing V3) parser (#28682)
aetherbird Sep 19, 2026
f072b10
chat : fix gemma4 required tool grammar (#29115)
aldehir Sep 19, 2026
9a9f939
metal: add F16 input to the FWHT (#29094)
bri-prism Sep 20, 2026
4260903
fix(mamba) : make time-step projection input contiguous (#28832)
abetlen Sep 20, 2026
b23efaa
ui: Fix mobile breakpoint + content overflow issues (#29108)
allozaur Sep 20, 2026
3cf0325
CUDA: enable sparse fa for qwen4 (#28770)
am17an Sep 20, 2026
3d82ef6
common/peg : handle invalid utf-8 sequences in the AST (#29161)
aldehir Sep 20, 2026
a894dae
metal : support arbitrary hc in dsv4_hc_pre (#29169)
ggerganov Sep 20, 2026
ce8caa6
CUDA: tune FA for Gemma 4 on Ampere or newer (#29152)
JohannesGaessler Sep 20, 2026
62668d6
convert: enable --fuse-qkv for muse-glimmer (#29203)
dfriehs Sep 21, 2026
932a68e
webgpu : add fused gdn + cpy (#28976)
yomaytk Sep 21, 2026
8aa161b
metal : fix deprecation warnings from macOS 27 SDK (#29136)
nikwen Sep 21, 2026
68d9053
cuda : tune MMVQ to MMQ crossover for SM70 (Volta) (#28912)
cyyself Sep 21, 2026
0c3626e
hexagon: overhaul of buffer and DMA handling to support 64bit mapping…
max-krasnyansky Sep 21, 2026
6ad1af5
ci : Upgrade CUDA to 13.4 for Ubuntu CUDA Release Builds (#29202)
sam-india-007 Sep 21, 2026
8034c1d
ggml-cpu: ARM Repack kernels for Q1_0 (#23492)
pl752 Sep 21, 2026
1aa2954
sycl : coalesce MKL-FA softmax loads instead of one work-item per row…
anantshri Sep 21, 2026
26394b4
json: Fixed json enum handling (#28518)
Silverside Sep 21, 2026
335b21f
ggml-metal : simplify fusion pattern op list declaration (#29206)
ggerganov Sep 21, 2026
711f60b
tests : remove stale comment (#29140)
mostafafaheem Sep 21, 2026
982a332
server : do not forward --api-key-file to router-spawned child instan…
nandan2003 Sep 21, 2026
e0dff58
args: add env vars for temperature, top-p, min-p and penalties (#27380)
kucharskim Sep 21, 2026
542e920
ci : refactor build-self-hosted into backend-specific workflows (#28991)
CISC Sep 21, 2026
1d72b05
tests/test-backend-ops : allow regex entries in the -o filter (#29204)
ggerganov Sep 21, 2026
161755f
test-llama-archs : make tensor data stdev configurable and improve he…
ggerganov Sep 21, 2026
1884824
CUDA: Follow up of #25635, refactoring FA shared smem swizzle (#28536)
ynankani Sep 21, 2026
af91114
sycl : pinned memory use right device context instead of 0 (#28895)
lslusarczyk Sep 21, 2026
bb3c853
sycl : support gated DSV4_HC_PRE and optional HC_POST comb matrix (#2…
cwriter Sep 21, 2026
ec91ab5
docker : bump cuda to 13.4.1 (#29207)
CISC Sep 21, 2026
6f41ac5
vendor : update cpp-httplib to 0.57.0 (#29214)
angt Sep 21, 2026
c21284c
ggml : fix dimension and stride truncation in ggml_permute (#29227)
leejet Sep 21, 2026
e6cef81
cuda : accelerate conv2d with implicit GEMM (#29135)
leejet Sep 21, 2026
f4e276a
ggml-cuda : convert contiguous tensors four elements at a time (#29155)
pwilkin Sep 21, 2026
b1c2863
cuda: fix sm_70 tile compilation error (#29224)
lingyezhixing Sep 21, 2026
9655061
llama-context : report graph inputs and input tensors during sched re…
ggerganov Sep 21, 2026
c641dfa
test-save-load-state : compare logits with NMSE and feed expected tok…
ggerganov Sep 21, 2026
fb34fc2
metal : fix mask bounds in flash attention block pre-pass (#29220)
masterFoad Sep 21, 2026
ff0dbb9
vendor : update cpp-httplib to 0.57.1 (#29239)
angt Sep 21, 2026
5836771
hexagon: new HMX-optimized GATED_DELTA_NET (#29199)
max-krasnyansky Sep 21, 2026
c550d2f
ci : update Level Zero SDK to v1.33.1 and enable the L0/oneDNN CMake …
Asahi-Prv Sep 22, 2026
ec5a12b
opencl: add A8 Q4_0 non-MoE dp4a binary kernel (#29055)
shaofeiqi Sep 22, 2026
8cfc315
Add close button to UI toasts (#28246)
agustinmista Sep 22, 2026
0ee9435
ci : publish snapdragon builds in release workflow (#29007)
ykhrustalev Sep 22, 2026
7ab4ee7
chat : Fix Muse Glimmer tool-call first parser error (#29242)
NickM-27 Sep 22, 2026
a60f9ae
cmake : allow repeated find_package calls for llama (#29228)
miyanyan Sep 22, 2026
bfd73a8
convert: add MiMo-V2.6 support (#29257)
AesSedai Sep 22, 2026
828fdf2
spec : support DFlash for HunyuanOCR (#28890)
wendadawen Sep 22, 2026
217f81c
server: Add support for binding to multiple addresses (#28690)
erusev Sep 22, 2026
348f853
jinja: use const for statement::execute and ::visit (#29271)
ngxson Sep 22, 2026
9b421fa
ui : Accept WEBM video files (#28622)
EpicEric Sep 22, 2026
c350a40
Performance tune for gemma4-26b-a4b flash attention shape. (#28450)
frobnitzem Sep 22, 2026
f95b0d9
ggml : IQ1_M build prefix sums once per block (#28706)
bartowski1182 Sep 22, 2026
0f8a414
metal : gate mul_mm_id src1 rescale behind ggml_prec (#29029)
mdegans Sep 22, 2026
73c941b
mtmd: add various sanity checks (#29276)
ngxson Sep 22, 2026
4ceb171
vulkan: add Intel Xe flash attention optimization kernels (2/3, Xe-LP…
fish-jiang Sep 22, 2026
4098fdc
server: support input_image in function_call_output (#20663) (#22575)
Empressia Sep 22, 2026
bbf99b1
server: do not pass log file to children (#29212)
dfriehs Sep 22, 2026
9919911
server: fix router eviction races with the existing queue (#29217)
ServeurpersoCom Sep 22, 2026
d5f6649
opencl: add bin kernel `kernel_gemm_noshuffle_q4_k_q8_1_dp4a_ila_a8_b…
shaofeiqi Sep 22, 2026
709fe75
jinja : fix dangling reference warning in for_statement (#29279)
ggerganov Sep 22, 2026
f46bc30
HIP : optimize IQ2/IQ3 (`__vsub4` `__vcmpne4`) using SWAR (#27962)
yanjs Sep 22, 2026
e6ab7c1
hex-dma: introduce direct-mapped DMA cache that is better suited for …
max-krasnyansky Sep 22, 2026
441df11
sampler: reduce the size of the probe (#29285)
max-krasnyansky Sep 23, 2026
08b1d2a
vulkan: hide internal symbols to prevent duplicate-dlopen state destr…
ewintr Sep 23, 2026
4d7d770
sycl : support op get_rows_back, only support fp32/fp16 (#25266)
arthw Sep 23, 2026
5e48b31
sycl: extend MMVQ GLU fusion, add rms_norm+scale and ssm_conv+silu fu…
anantshri Sep 23, 2026
384a534
sycl : support new UT case for mul_mat_hadamard fp16 (#29218)
arthw Sep 23, 2026
1a67982
cuda: top-k MoE should always fire (#28432)
am17an Sep 23, 2026
9425611
ggml-meta: resolve multi buffer views (#29266)
0cc4m Sep 23, 2026
b1ff4ca
vulkan: add IQ4_XS MMQ/MMV matmul kernels (#28415)
pwilkin Sep 23, 2026
e97545d
sycl : fix compile warnings
ggerganov Sep 23, 2026
503549c
ggml : bump version to 0.25.0 (ggml/1635)
ggerganov Sep 23, 2026
45062d4
sync : ggml
ggerganov Sep 23, 2026
183d2a0
make-release : update summary prompt
ggerganov Sep 23, 2026
86b2daa
ci : run python (jinja) test (#29302)
CISC Sep 23, 2026
633733d
model : support Gemma4 DSpark draft backbone (#29226)
hthadicherla Sep 23, 2026
18f9f7b
model-conversion : add causal-compare-logits recipe (#29305)
danbev Sep 23, 2026
26758d3
ci : fix build-cmake runner target (#29299)
CISC Sep 23, 2026
bcbc936
server: Dedup the draft HF model via dedup-cache-models (#27934)
DreamingWater Sep 23, 2026
057494f
server: accept OpenAI video_url content type and data: video URIs (#2…
calebrio02 Sep 23, 2026
ee3ecce
metal : key the fa-vec tuned table by family instead of SKU (#29075)
forforever73 Sep 23, 2026
4e416ee
jinja : parse unary +/- before variables (#29244)
cs-fisha Sep 23, 2026
42916d8
server: fix token counting API crash on sleep (#29309)
willweimike Sep 23, 2026
dc9879c
CUDA: enable sparse-fa for dsv4 prefill (again) (#29298)
am17an Sep 23, 2026
9575389
metal: add the missing f32 x bf16 mul_mv variants (#28741)
ServeurpersoCom Sep 23, 2026
bddf826
common : keep HF cache dir as path, expose UTF-8 only for logs (#29320)
angt Sep 23, 2026
66fba63
CUDA: add a reserve to avoid spurious warning on older GCC builds (#2…
am17an Sep 23, 2026
e4e2f62
ggml : bump version to 0.25.1 (ggml/1637)
ggerganov Sep 23, 2026
177cd8c
sync : ggml
ggerganov Sep 23, 2026
7fe450e
llama.cpp : bump version to 0.5.0 (#29333)
ggerganov Sep 23, 2026
fee39dd
opencl: add A8 Q6_K non-MoE dp4a binary kernel (#29057)
shaofeiqi Sep 23, 2026
6e60f35
ci : use hf-jobs-cpu-xl runner in server sanitize workflow (#29297)
ggerganov Sep 23, 2026
d2e5458
tests: add `-b/--backend` option to test-llama-archs for testing a sp…
yomaytk Sep 23, 2026
b9ae43a
server: allow preset to set log file (#29334)
ngxson Sep 23, 2026
bd4f514
convert : allow vision target for DFlash/Dspark (#29339)
tdakhran Sep 23, 2026
b7db3e6
Merge upstream/master (335 commits) into claude/hello-ky3ivj
claude Sep 24, 2026
0d4acf7
sync fixes: router stop deadlock, vulkan port misplacements, build br…
claude Sep 24, 2026
262ac61
sync log: verification results
claude Sep 24, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
12 changes: 6 additions & 6 deletions .devops/nix/package.nix
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@
]
&& blas.meta.available,
useCuda ? config.cudaSupport,
useMetalKit ? stdenv.isAarch64 && stdenv.isDarwin,
useMetalKit ? stdenv.hostPlatform.isAarch64 && stdenv.hostPlatform.isDarwin,
# Increases the runtime closure size by ~700M
useMpi ? false,
useRocm ? config.rocmSupport,
Expand Down Expand Up @@ -92,7 +92,7 @@ let

cudaBuildInputs = with cudaPackages; [
cuda_cudart
cuda_cccl # <nv/target>
cccl # <nv/target>
libcublas
];

Expand Down Expand Up @@ -166,7 +166,7 @@ effectiveStdenv.mkDerivation (finalAttrs: {
# `xcrun` is used find the path of the Metal compiler, which is varible
# and not on $PATH
# see https://github.com/ggml-org/llama.cpp/pull/6118 for discussion
__noChroot = effectiveStdenv.isDarwin && useMetalKit && precompileMetalShaders;
__noChroot = effectiveStdenv.hostPlatform.isDarwin && useMetalKit && precompileMetalShaders;

nativeBuildInputs =
[
Expand All @@ -181,10 +181,10 @@ effectiveStdenv.mkDerivation (finalAttrs: {
autoAddDriverRunpath
]
++ optionals (effectiveStdenv.hostPlatform.isGnu && enableStatic) [ glibc.static ]
++ optionals (effectiveStdenv.isDarwin && useMetalKit && precompileMetalShaders) [ xcrunHost ];
++ optionals (effectiveStdenv.hostPlatform.isDarwin && useMetalKit && precompileMetalShaders) [ xcrunHost ];

buildInputs =
optionals effectiveStdenv.isDarwin darwinBuildInputs
optionals effectiveStdenv.hostPlatform.isDarwin darwinBuildInputs
++ optionals useCuda cudaBuildInputs
++ optionals useMpi [ mpi ]
++ optionals useRocm rocmBuildInputs
Expand Down Expand Up @@ -245,7 +245,7 @@ effectiveStdenv.mkDerivation (finalAttrs: {

# Configurations that are known to result in build failures. Can be
# overridden by importing Nixpkgs with `allowBroken = true`.
broken = (useMetalKit && !effectiveStdenv.isDarwin);
broken = (useMetalKit && !effectiveStdenv.hostPlatform.isDarwin);

description = "Inference of LLaMA model in pure C/C++${descriptionSuffix}";
homepage = "https://github.com/ggml-org/llama.cpp/";
Expand Down
12 changes: 6 additions & 6 deletions .devops/openvino.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
ARG OPENVINO_VERSION_MAJOR=2026.3.1
ARG OPENVINO_VERSION_FULL=2026.3.1.22476.56d9685302d
ARG OPENVINO_VERSION_MAJOR=2026.4
ARG OPENVINO_VERSION_FULL=2026.4.0.22959.99c81491cc3
ARG UBUNTU_VERSION=24.04

# Intel GPU driver versions. https://github.com/intel/compute-runtime/releases
Expand All @@ -10,9 +10,9 @@ ARG COMPUTE_RUNTIME_VERSION_FULL=26.31.39395.13-0
ARG IGDGMM_VERSION=22.10.0

# Intel NPU driver versions. https://github.com/intel/linux-npu-driver/releases
ARG NPU_DRIVER_VERSION=v1.35.0
ARG NPU_DRIVER_FULL=v1.35.0.20260722-29947505341
ARG LIBZE1_VERSION=1.28.2-1~24.04~ppa1
ARG NPU_DRIVER_VERSION=v1.38.0
ARG NPU_DRIVER_FULL=v1.38.0.20260910-34487311128
ARG LIBZE1_VERSION=1.32.0-1~24.04~ppa1

# Optional proxy build arguments
ARG http_proxy=
Expand Down Expand Up @@ -173,7 +173,7 @@ RUN --mount=type=cache,target=/var/cache/intel-npu,sharing=locked \
fi; \
DEB=/var/cache/intel-npu/libze1_${LIBZE1_VERSION}_amd64.deb; \
if [ ! -f "$DEB" ]; then \
wget -q -O "$DEB" https://snapshot.ppa.launchpadcontent.net/kobuk-team/intel-graphics/ubuntu/20260606T100000Z/pool/main/l/level-zero-loader/libze1_${LIBZE1_VERSION}_amd64.deb; \
wget -q -O "$DEB" https://snapshot.ppa.launchpadcontent.net/kobuk-team/intel-graphics/ubuntu/20260830T100000Z/pool/main/l/level-zero-loader/libze1_${LIBZE1_VERSION}_amd64.deb; \
fi; \
mkdir /tmp/npu/ && cd /tmp/npu/ && tar -xf "$TGZ" && cp "$DEB" .; \
apt-get update; \
Expand Down
2 changes: 1 addition & 1 deletion .ecrc
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"Exclude": ["^\\.gitmodules$", "stb_image\\.h"],
"Exclude": ["^\\.gitmodules$", "stb_image\\.h", "examples/test-cmake/build/", "examples/test-cmake/build-subdir/"],
"Disable": {
"IndentSize": true
}
Expand Down
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
blank_issues_enabled: true
blank_issues_enabled: false
contact_links:
- name: Got an idea?
url: https://github.com/ggml-org/llama.cpp/discussions/categories/ideas
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/get-tag-name/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ runs:
run: |
BUILD_NUMBER="$(git rev-list --count HEAD)"
SHORT_HASH="$(git rev-parse --short=7 HEAD)"
if [[ "${{ env.BRANCH_NAME }}" == "master" ]]; then
if [[ "${{ env.BRANCH_NAME }}" == "master" || "${{ env.BRANCH_NAME }}" == "b${BUILD_NUMBER}" ]]; then
echo "name=b${BUILD_NUMBER}" >> $GITHUB_OUTPUT
else
SAFE_NAME=$(echo "${{ env.BRANCH_NAME }}" | tr '/' '-')
Expand Down
78 changes: 39 additions & 39 deletions .github/actions/windows-setup-cuda/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -100,56 +100,56 @@ runs:
echo "CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
echo "CUDA_PATH_V13_1=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
- name: Install Cuda Toolkit 13.3
if: ${{ inputs.cuda_version == '13.3' }}
- name: Install Cuda Toolkit 13.4 for x64
if: ${{ inputs.cuda_version == '13.4' && inputs.cuda_arch == 'x64' }}
shell: pwsh
run: |
mkdir -p "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3"
mkdir -p "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4"
choco install unzip -y
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_crt/windows-x86_64/cuda_crt-windows-x86_64-13.3.33-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_cudart/windows-x86_64/cuda_cudart-windows-x86_64-13.3.29-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvcc/windows-x86_64/cuda_nvcc-windows-x86_64-13.3.33-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvrtc/windows-x86_64/cuda_nvrtc-windows-x86_64-13.3.33-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/libcublas/windows-x86_64/libcublas-windows-x86_64-13.5.1.27-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/libnvvm/windows-x86_64/libnvvm-windows-x86_64-13.3.33-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvtx/windows-x86_64/cuda_nvtx-windows-x86_64-13.3.29-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_profiler_api/windows-x86_64/cuda_profiler_api-windows-x86_64-13.3.27-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/visual_studio_integration/windows-x86_64/visual_studio_integration-windows-x86_64-13.3.27-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cccl/windows-x86_64/cccl-windows-x86_64-13.3.3.3.1-archive.zip"
unzip '*.zip' -d "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3"
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\cuda_crt-windows-x86_64-13.3.33-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\cuda_cudart-windows-x86_64-13.3.29-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\cuda_nvcc-windows-x86_64-13.3.33-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\cuda_nvrtc-windows-x86_64-13.3.33-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\libcublas-windows-x86_64-13.5.1.27-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\libnvvm-windows-x86_64-13.3.33-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\cuda_nvtx-windows-x86_64-13.3.29-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\cuda_profiler_api-windows-x86_64-13.3.27-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\visual_studio_integration-windows-x86_64-13.3.27-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\cccl-windows-x86_64-13.3.3.3.1-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" /E /I /H /Y
echo "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3\bin" | Out-File -FilePath $env:GITHUB_PATH -Encoding utf8 -Append
echo "CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
echo "CUDA_PATH_V13_3=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.3" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_crt/windows-x86_64/cuda_crt-windows-x86_64-13.4.59-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_cudart/windows-x86_64/cuda_cudart-windows-x86_64-13.4.49-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvcc/windows-x86_64/cuda_nvcc-windows-x86_64-13.4.59-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvrtc/windows-x86_64/cuda_nvrtc-windows-x86_64-13.4.59-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/libcublas/windows-x86_64/libcublas-windows-x86_64-13.7.0.27-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/libnvvm/windows-x86_64/libnvvm-windows-x86_64-13.4.59-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvtx/windows-x86_64/cuda_nvtx-windows-x86_64-13.4.49-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_profiler_api/windows-x86_64/cuda_profiler_api-windows-x86_64-13.4.49-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/visual_studio_integration/windows-x86_64/visual_studio_integration-windows-x86_64-13.4.49-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cccl/windows-x86_64/cccl-windows-x86_64-13.3.4.2.1-archive.zip"
unzip '*.zip' -d "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4"
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_crt-windows-x86_64-13.4.59-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_cudart-windows-x86_64-13.4.49-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_nvcc-windows-x86_64-13.4.59-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_nvrtc-windows-x86_64-13.4.59-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\libcublas-windows-x86_64-13.7.0.27-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\libnvvm-windows-x86_64-13.4.59-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_nvtx-windows-x86_64-13.4.49-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_profiler_api-windows-x86_64-13.4.49-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\visual_studio_integration-windows-x86_64-13.4.49-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cccl-windows-x86_64-13.3.4.2.1-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
echo "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\bin" | Out-File -FilePath $env:GITHUB_PATH -Encoding utf8 -Append
echo "CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
echo "CUDA_PATH_V13_4=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
- name: Install Cuda Toolkit 13.4 for ARM64
if: ${{ inputs.cuda_version == '13.4' && inputs.cuda_arch == 'arm64' }}
shell: pwsh
run: |
mkdir -p "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4"
choco install unzip -y
curl -O "https://packages.nvidia.com/bin-archive/pool/windows-x86_64/5B515474-7E78-11F1-8656-C51E4F4B317F/cccl-windows-x86_64-13.3.4.1.2-archive.zip"
curl -O "https://packages.nvidia.com/bin-archive/pool/windows-x86_64/5B515474-7E78-11F1-8656-C51E4F4B317F/cuda_crt-windows-x86_64-13.4.46-archive.zip"
curl -O "https://packages.nvidia.com/bin-archive/pool/windows-x86_64/5B515474-7E78-11F1-8656-C51E4F4B317F/cuda_nvcc-windows-x86_64-13.4.46-archive.zip"
curl -O "https://packages.nvidia.com/bin-archive/pool/windows-x86_64/5B515474-7E78-11F1-8656-C51E4F4B317F/libnvvm-windows-x86_64-13.4.46-archive.zip"
curl -O "https://packages.nvidia.com/bin-archive/pool/windows-arm64/5B515474-7E78-11F1-8656-C51E4F4B317F/cuda_cudart-windows-arm64-13.4.46-archive.zip"
curl -O "https://packages.nvidia.com/bin-archive/pool/windows-arm64/5B515474-7E78-11F1-8656-C51E4F4B317F/libcublas-windows-arm64-13.7.0.10-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cccl/windows-x86_64/cccl-windows-x86_64-13.3.4.2.1-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_crt/windows-x86_64/cuda_crt-windows-x86_64-13.4.59-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_nvcc/windows-x86_64/cuda_nvcc-windows-x86_64-13.4.59-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/libnvvm/windows-x86_64/libnvvm-windows-x86_64-13.4.59-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/cuda_cudart/windows-arm64/cuda_cudart-windows-arm64-13.4.49-archive.zip"
curl -O "https://developer.download.nvidia.com/compute/cuda/redist/libcublas/windows-arm64/libcublas-windows-arm64-13.7.0.27-archive.zip"
unzip '*.zip' -d "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4"
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cccl-windows-x86_64-13.3.4.1.2-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_crt-windows-x86_64-13.4.46-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_nvcc-windows-x86_64-13.4.46-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\libnvvm-windows-x86_64-13.4.46-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_cudart-windows-arm64-13.4.46-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\libcublas-windows-arm64-13.7.0.10-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cccl-windows-x86_64-13.3.4.2.1-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_crt-windows-x86_64-13.4.59-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_nvcc-windows-x86_64-13.4.59-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\libnvvm-windows-x86_64-13.4.59-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\cuda_cudart-windows-arm64-13.4.49-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
xcopy "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\libcublas-windows-arm64-13.7.0.27-archive\*" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" /E /I /H /Y
echo "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4\bin" | Out-File -FilePath $env:GITHUB_PATH -Encoding utf8 -Append
echo "CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
echo "CUDA_PATH_V13_4=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.4" | Out-File -FilePath $env:GITHUB_ENV -Append -Encoding utf8
4 changes: 2 additions & 2 deletions .github/workflows/build-and-test-snapdragon.yml
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ concurrency:

jobs:
android-ndk-snapdragon:
runs-on: ubuntu-latest
runs-on: ubuntu-24.04 # previously ubuntu-latest
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-android:v0.7'
defaults:
Expand Down Expand Up @@ -59,7 +59,7 @@ jobs:
path: pkg-snapdragon/llama.cpp

linux-iot-snapdragon:
runs-on: ubuntu-latest
runs-on: ubuntu-24.04 # previously ubuntu-latest
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-linux:v0.7'
defaults:
Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/build-android.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ env:

jobs:
default:
runs-on: ubuntu-latest
runs-on: ubuntu-24.04 # previously ubuntu-latest

steps:
- name: Clone
Expand All @@ -49,7 +49,7 @@ jobs:
distribution: zulu

- name: Setup Android SDK
uses: android-actions/setup-android@40fd30fb8d7440372e1316f5d1809ec01dcd3699 # v4.0.1
uses: android-actions/setup-android@be39fa834029ff78f1a44aa3bb0819b8fc2bd8fd # v4.0.4
with:
log-accepted-android-sdk-licenses: false

Expand All @@ -59,7 +59,7 @@ jobs:
./gradlew build --no-daemon
ndk:
runs-on: ubuntu-latest
runs-on: ubuntu-24.04 # previously ubuntu-latest
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-android:v0.3'
defaults:
Expand Down Expand Up @@ -93,7 +93,7 @@ jobs:
path: pkg-adb/llama.cpp

arm64:
runs-on: ubuntu-latest
runs-on: ubuntu-24.04 # previously ubuntu-latest

env:
NDK_VERSION: "29.0.14206865"
Expand Down Expand Up @@ -123,7 +123,7 @@ jobs:
distribution: temurin

- name: Setup Android SDK
uses: android-actions/setup-android@40fd30fb8d7440372e1316f5d1809ec01dcd3699 # v4.0.1
uses: android-actions/setup-android@be39fa834029ff78f1a44aa3bb0819b8fc2bd8fd # v4.0.4
with:
log-accepted-android-sdk-licenses: false

Expand Down
Loading
Loading