62
llama.cpp v1.0.0 (huggingface.co)

From their official post on Reddit:

Hey folks, it's Merve from Hugging Face. Today, llama.cpp releases v1!

Moving forward, we’ll keep covering every platform and every model type, while keeping llama.cpp robust and lean for downstream applications that build on it.

While I'm here, want to announce that we've been shipping Llama desktop apps to lower the barrier of entry to local AI to few clicks, built-on llama.cpp. I will leave link to the details for both v1 and apps in comments.

Many thanks for all the love you've shown to llama.cpp for years 🦙❤️ Cheers!

you are viewing a single comment's thread
view the rest of the comments
[-] BeefAndPoultry@lemmus.org 11 points 2 days ago* (last edited 2 days ago)

That blog post doesn't seem to talk about what changed in this release since v0.9.0 https://github.com/ggml-org/llama.cpp/releases/tag/v1.0.0

llama.cpp v1.0.0 removes the deprecated public API and promotes the NextN/speculative API to llama.h, adds OCP FP8 KV caches, a host-memory MoE expert cache with a configurable CPU share, and loading of external PLE shards. It adds three text architectures (Kimi-K3.1-Pro, Ripple and xing4_0), drama-3 TTS, and MageVL-Cowork and Kimi-K3.1 vision, hardens llama-server (SSRF, CORS, DNS rebinding, MCP tool cancellation) and adds a /v1/audio/speech endpoint, ships a redesigned web UI with chat groups and a markdown editor, and updates ggml to v1.0.0.

Some highlights:

  • llama.h: add moe_cache_size and moe_cache_cpu_share to llama_context_params (#30966)
  • FP8 KV caches (-ctk/-ctv f8_e4m3) with optional static per-tensor scales (#28392)
  • MoE cache: CPU share for misses, LRFU/ClassLRU replacement, no CPU wait on cached experts (#30966, #31233, #31888)
  • external PLE/engram loading from separate GGUF shards via --shard/--ple (#31185)
  • chat : refactor gemma4 to build loose schema rules and clean up (#31915) This one includes a compatibility break: I also took this as an opportunity to clean up the old workaround and template. The official Gemma 4 templates have addressed the issues those solved and have been out for quite a while. If anyone hasn't updated yet, it's on them! You can download the newer template from here https://huggingface.co/google/gemma-4-31B-it/blob/main/chat_template.jinja

I hope they start doing a separate bleeding edge branch and stable branch. Like how Linux has rolling distros and LTS distros.

this post was submitted on 13 Nov 2026
62 points (97.0% liked)

LocalLLaMA

5662 readers
270 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Rules:

Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.

Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.

Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.

Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.

founded 3 years ago
MODERATORS