Search results

Catch up to the upstream

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

Ascend NPUissues specific to Ascend NPUsissues specific to Ascend NPUs

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

pythonpython script changespython script changes

scriptScript relatedScript related

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 15642

#15642 In ggml-org/llama.cpp;

· skyne98 opened on Aug 28, 2025

fix(ggml-sycl): add synchronization before exiting argsort kernel

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 15582

#15582 In ggml-org/llama.cpp;

· MengAiDev opened on Aug 26, 2025

Eval bug: Asynchronous Kernel Execution on iGPU Causes Runtime Errors with MOE Model

bug-unconfirmed

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open.

#15580 In ggml-org/llama.cpp;

· jiujiuwei opened on Aug 26, 2025

remove templates from soft_max_f32_submitter to allow SYCL graph updates

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 13724

#13724 In ggml-org/llama.cpp;

· lslusarczyk opened on May 23, 2025

llama : try loading tensors with pre-computed hashes

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Komputehttps://github.com/KomputeProject/kompute/https://github.com/KomputeProject/kompute/

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 13106

#13106 In ggml-org/llama.cpp;

· rgerganov opened on Apr 25, 2025

<code>tool-call</code>: Phi-4 support

androidIssues specific to AndroidIssues specific to Android

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

pythonpython script changespython script changes

server

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 12288

#12288 In ggml-org/llama.cpp;

· jpohhhh opened on Mar 9, 2025

ggml: move kvalues_iq4nl definition to ggml-common.h

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 11785

#11785 In ggml-org/llama.cpp;

· HungMingWu opened on Feb 10, 2025

Clean up Test Script + Update it to work on Instruct Tuned Models

examples

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 11610

#11610 In ggml-org/llama.cpp;

· Mr-Thack opened on Feb 3, 2025

add print cpu info

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 9957

#9957 In ggml-org/llama.cpp;

· NeoZhangJianyu opened on Oct 20, 2024

[Draft] Tensor Parallel support to llama.cpp

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 9648

#9648 In ggml-org/llama.cpp;

· ClarkChin08 opened on Sep 26, 2024

Revert "ggml : remove OpenCL (#7735) + (#8235)"

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

buildCompilation issuesCompilation issues

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

nixIssues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deploymentIssues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deployment

pythonpython script changespython script changes

scriptScript relatedScript related

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Draft (not ready).

ggml-org/llama.cppnumber 8986

#8986 In ggml-org/llama.cpp;

· okias opened on Aug 11, 2024