{
  "video_id": "reddit_1vqnbhe",
  "channel_slug": "LocalLLaMA",
  "channel_handle": "r/LocalLLaMA",
  "title": "Petition to add a rule for people to add their DAMN quant levels to their posts",
  "url": "https://www.reddit.com/r/LocalLLaMA/comments/1vqnbhe/petition_to_add_a_rule_for_people_to_add_their/",
  "external_url": null,
  "upload_date": "20260817",
  "published_at": "2026-08-17T09:20:53+00:00",
  "transcript": "Every time I see a post about a newly released model, whether it be a comparison or shitting on it, I have to dig through the endless comments to see what quants they used and what their specs were.\n\nIts quite a common occurrence here in this sub to ask someone that's saying a model is underperforming, and when you ask what quantization they are running they say something like \"oh im running q0.1bpw from nobodyknowswhothisguyis\".\n\nWorst offender is with comparison posts. \"Comparing the new Qwen3.8-27B to Qwen3.5-9B and the 9B model is better!\" I wonder why?\n\nSorry for bad england\n\n\n\n--- Top Comments ---\n\n\n[30 upvotes] Yeah i used to reply to posts/comments that didn’t mention their specific quant, inference engine and harness. Now either i keep scrolling or make a comment like your post here\n\n[17 upvotes] and posts like, how to run glm5.2 on laptop\n\n[13 upvotes] Same with sharing t/s stats.\n\nIt would be better to include full llama.cpp command & Console output. But some folks sharing only(unintentional) partial info. like \"Q4 gives me 50 t/s\" .... \n\n# BUT \n\nWhich Q4 quant? We have bunch of Q4 quants. \n\nFor what context? \n\nwhat KVCache?\n\nAny layers offloading?\n\nhow much VRAM? single or multi GPUs? Tensor parallelism?\n\netc.,?\n\n  \nSo best way to share t/s stats is below. Below block has almost all details.\n\n    llama-bench -m E:\\LLM\\models\\gpt-oss-20b-mxfp4.gguf -ngl 99 -ncmoe 10 -fa 1 -ctk q8_0 -ctv q8_0 -b 2048 -ub 512 -t 8\n    | model                          |       size |     params | backend    | ngl | threads | type_k | type_v | fa |            test |                  t/s |\n    | ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | -----: | -----: | -: | --------------: | -------------------: |\n    | gpt-oss 20B MXFP4 MoE          |  11.27 GiB |    20.91 B | CUDA       |  99 |       8 |   q8_0 |   q8_0 |  1 |           pp512 |      823.93 ± 109.69 |\n    | gpt-oss 20B MXFP4 MoE          |  11.27 GiB |    20.91 B | CUDA       |  99 |       8 |   q8_0 |   q8_0 |  1 |           tg128 |         42.06 ± 0.5\n\n[9 upvotes] Temperature, too. \n\nI RUN ALL MY BENCHMARKS AT TEMP 0 BECAUSE CHATGPT TOLD ME THIS WHAT I SHOULD ALWAYS DO",
  "transcript_chars": 2195,
  "ingested_at": "2026-08-17T13:30:04.773820+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 184,
    "upvote_ratio": 0.96,
    "num_comments": 22,
    "author": "Su1tz",
    "is_self": true
  }
}