{
  "video_id": "reddit_1uh8r1j",
  "channel_slug": "LocalLLaMA",
  "channel_handle": "r/LocalLLaMA",
  "title": "Running GLM5.2 on budget hardware < $2500.",
  "url": "https://www.reddit.com/r/LocalLLaMA/comments/1uh8r1j/running_glm52_on_budget_hardware_2500/",
  "external_url": null,
  "upload_date": "20260627",
  "published_at": "2026-06-27T17:33:58+00:00",
  "transcript": "Too many times I hear people whine about not being ble to run SOTA models or claim it would require $50k, or $100k.  \n  \n[https://www.ebay.com/itm/398079051468](https://www.ebay.com/itm/398079051468) Epcy Motherboard & CPU - $460\n\n[https://www.ebay.com/itm/206374955959](https://www.ebay.com/itm/206374955959) P40 24gb - $230 get 2 - $460\n\n[https://www.ebay.com/itm/318489798853](https://www.ebay.com/itm/318489798853) 512gb dd4 $1000\n\nTotal = $1920.\n\nYou need PSU, Storage, Fan for P40.  You can source those for $350 easily.  But let's go ahead and budget $580 to put the total for everything at $2500.\n\nYou can run GLM5.2 Q2/Q3/Q4 variants with cmoe and llama.cpp on this.  Sure, it would be slow, but it's yours!   If you have money or when you get more, you can replace the P40s faster GPUs 4080, 3090, etc.  You could for a bit more than $460 about $500 source 2 2080ti 22gb GPUs from China.   If you are willing to be resourceful, you can make things happen for you.   This will also run KimiK2.6, DeepSeek, MiniMax, etc   \n\nYes, the trade off is that it's slow.   You will not be running agents with these huge models, but you can spin it up for planning and serious debugging.  They can take away Fable, Mythos or whatever the F model.   You will not be counted in the group of have nots.\n\n\n\n--- Top Comments ---\n\n\n[123 upvotes] we talking 2t/s or we talking 8t/s?\n\nhow about prompt processing?\n\nsurely slow doesn't cover anything.\n\n[65 upvotes] The concern is not that it will be slow, but how much slow, 8t/s is slow but not unbearable like 1T/s  \nHow slow it will be?\n\n[38 upvotes] Ya hell ya. 2tks. One task every 24 hours. ",
  "transcript_chars": 1637,
  "ingested_at": "2026-06-28T01:30:25.566240+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 126,
    "upvote_ratio": 0.77,
    "num_comments": 200,
    "author": "segmond",
    "is_self": true
  }
}