{
  "video_id": "reddit_1tn0jyp",
  "channel_slug": "LocalLLaMA",
  "channel_handle": "r/LocalLLaMA",
  "title": "server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp",
  "url": "https://www.reddit.com/r/LocalLLaMA/comments/1tn0jyp/server_fix_checkpoints_creation_by_jacekpoplawski/",
  "external_url": "https://github.com/ggml-org/llama.cpp/pull/22929",
  "upload_date": "20260525",
  "published_at": "2026-05-25T06:22:12+00:00",
  "transcript": "Imagine you are using a local model for agentic coding. \n\nYou discuss the idea (50k tokens), then say “implement it”. The agent reads files, writes files, runs commands, produces another 20k tokens and the code is ready. Then your next prompt is just “thank you”, and... nothing happens, you have to wait for \"something\".\n\nWhat is happening is that some tools, like opencode, try to be smart and optimize the context. They modify something in the conversation history. In the best case, llama.cpp has to reprocess everything from that point. In the worst case, it has to reprocess the entire context (70k tokens) and you get “forcing full prompt re-processing...”\n\nTo avoid that, I switched from opencode to pi. Not because pi has some magical features, but because it does not do that kind of context rewriting.\n\nAnother issue is the model being smart by removing reasoning from the context. In the best case, llama.cpp only has to reprocess the last run (20k tokens). In the worst case, again, it has to reprocess everything (70k)\n\nTo avoid that, you can enable “preserve thinking”, at least with Qwen 3.6.\n\nThe goal of this PR is to avoid the worst case (full prompt re-processing) and get closer to the best case, where llama.cpp only reprocesses what actually changed. I have been using this code for about two weeks and in my opinion agentic coding is now more responsive.\n\n\n\n--- Top Comments ---\n\n\n[27 upvotes] Oh wow the poster becomes postee, Congrats on the merge!\n\n[9 upvotes] Finally. Been struggling with this a lot. Thank you man. \n\n[7 upvotes] Big hype!\n\n[6 upvotes] Merged into main? Nice! Congrats! Looking forward to trying it out.",
  "transcript_chars": 1649,
  "ingested_at": "2026-05-25T13:30:02.626519+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 119,
    "upvote_ratio": 0.98,
    "num_comments": 32,
    "author": "jacek2023",
    "is_self": false
  }
}