Search results

quantize : configurable neutral imatrix prior

examples

generation qualityQuality of model outputQuality of model output

need feedbackTesting and feedback with results are neededTesting and feedback with results are needed

research 🔬

Status: Open (in progress).

ggml-org/llama.cppnumber 15060

#15060 In ggml-org/llama.cpp;

· compilade opened on Aug 3, 2025

Support streaming delta.reasoning_content in WebUI

examples

server

Status: Open (in progress).

ggml-org/llama.cppnumber 15052

#15052 In ggml-org/llama.cpp;

· mostlygeek opened on Aug 3, 2025

Fix: respect localStorage base URL override in Web UI

examples

server

Status: Open (in progress).

ggml-org/llama.cppnumber 15048

#15048 In ggml-org/llama.cpp;

· insanerest opened on Aug 3, 2025

Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode

examples

server

Status: Open (in progress).

ggml-org/llama.cppnumber 15007

#15007 In ggml-org/llama.cpp;

· matteoserva opened on Aug 1, 2025

Add support for CogVLM model

examples

pythonpython script changespython script changes

Status: Open (in progress).

ggml-org/llama.cppnumber 15002

#15002 In ggml-org/llama.cpp;

· Tianyue-Zhao opened on Aug 1, 2025

Implementation of GGML_NUMA_MIRROR for 64% inferencing performance gain on numa systems

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggml-org/llama.cppnumber 14969

#14969 In ggml-org/llama.cpp;

· dbsanfte opened on Jul 30, 2025

mtmd : support home-cooked Mistral Small Omni

examples

Status: Open (in progress).

ggml-org/llama.cppnumber 14928

#14928 In ggml-org/llama.cpp;

· ngxson opened on Jul 28, 2025

bench, common : add CPU extra buffer types

examples

Status: Draft (not ready).

ggml-org/llama.cppnumber 14925

#14925 In ggml-org/llama.cpp;

· ggerganov opened on Jul 28, 2025

imatrix: calculate activation-based statistics for new format (GGUF) imatrices

examples

Status: Draft (not ready).

ggml-org/llama.cppnumber 14891

#14891 In ggml-org/llama.cpp;

· EAddario opened on Jul 26, 2025

SvelteKit-based WebUI

examples

scriptScript relatedScript related

server

Status: Draft (not ready).

ggml-org/llama.cppnumber 14839

#14839 In ggml-org/llama.cpp;

· allozaur opened on Jul 23, 2025

feat(batched): Add functionality to upload benchmark test results

examples

Status: Open (in progress).

ggml-org/llama.cppnumber 14811

#14811 In ggml-org/llama.cpp;

· MengAiDev opened on Jul 22, 2025

webui: add missing messages in export (#13552)

examples

server

Status: Open (in progress).

ggml-org/llama.cppnumber 14764

#14764 In ggml-org/llama.cpp;

· srogmann opened on Jul 18, 2025