{
  "video_id": "reddit_1txpeo0",
  "channel_slug": "LocalLLaMA",
  "channel_handle": "r/LocalLLaMA",
  "title": "Gemma 4 with quantization-aware training",
  "url": "https://www.reddit.com/r/LocalLLaMA/comments/1txpeo0/gemma_4_with_quantizationaware_training/",
  "external_url": "https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/",
  "upload_date": "20260605",
  "published_at": "2026-06-05T16:11:21+00:00",
  "transcript": "Google's collections:\n\n[https://huggingface.co/collections/google/gemma-4-qat-q4-0](https://huggingface.co/collections/google/gemma-4-qat-q4-0)\n\n[https://huggingface.co/collections/google/gemma-4-qat-mobile](https://huggingface.co/collections/google/gemma-4-qat-mobile)\n\nAnd Unsloth's:\n\n[https://huggingface.co/collections/unsloth/gemma-4-qat](https://huggingface.co/collections/unsloth/gemma-4-qat)\n\nUnsloth's analysis (KLD and such):\n\n[https://unsloth.ai/docs/models/gemma-4/qat#qat-analysis](https://unsloth.ai/docs/models/gemma-4/qat#qat-analysis)\n\n\n\n--- Top Comments ---\n\n\n[1 upvotes] Your post is getting popular and we just featured it on our Discord! [Come check it out!](https://discord.gg/PgFhZ8cnWW)\n\nYou've also been given a special flair for your contribution. We appreciate your post!\n\n*I am a bot and this action was performed automatically.*\n\n[134 upvotes] Official Google Gemma 4 QAT GGUFs:\n\nE2B [https://huggingface.co/google/gemma-4-E2B-it-qat-q4\\_0-gguf](https://huggingface.co/google/gemma-4-E2B-it-qat-q4_0-gguf)\n\nE4B [https://huggingface.co/google/gemma-4-E4B-it-qat-q4\\_0-gguf](https://huggingface.co/google/gemma-4-E4B-it-qat-q4_0-gguf)\n\n12B [https://huggingface.co/google/gemma-4-12B-it-qat-q4\\_0-gguf](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-gguf)\n\n26B-A4B [https://huggingface.co/google/gemma-4-26B-A4B-it-qat-q4\\_0-gguf](https://huggingface.co/google/gemma-4-26B-A4B-it-qat-q4_0-gguf)\n\n31B [https://huggingface.co/google/gemma-4-31B-it-qat-q4\\_0-gguf](https://huggingface.co/google/gemma-4-31B-it-qat-q4_0-gguf)\n\n[84 upvotes] They released 2 and 4 Bit QAT checkpoints amazing. I think i can run the E4B on my 6GB VRAM Laptop now properly.\n\n[47 upvotes] were there benchmark released comparing qat q4 to bf16?\n\n[35 upvotes] Blog post for the release https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/ \n\n\nNo benchmark provided to back up the \"preserving the capabilities and quality\" claim. \n\nEdit: \n\nIs this sub getting botted or what? This comment was immediately downvoted to -6 in less than ten minutes after I posted it and somehow it bounced back?",
  "transcript_chars": 2146,
  "ingested_at": "2026-06-06T01:30:04.743471+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 533,
    "upvote_ratio": 0.99,
    "num_comments": 188,
    "author": "rerri",
    "is_self": false
  }
}