{
  "video_id": "reddit_1udifm6",
  "channel_slug": "singularity",
  "channel_handle": "r/singularity",
  "title": "VibeThinker is a 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO",
  "url": "https://www.reddit.com/r/singularity/comments/1udifm6/vibethinker_is_a_3b_param_model_that_beats_opus/",
  "external_url": "https://arxiv.org/abs/2606.16140",
  "upload_date": "20260623",
  "published_at": "2026-06-23T14:18:24+00:00",
  "transcript": "\n\n--- Top Comments ---\n\n\n[54 upvotes] What we have here is a massive reality check for the current obsession with blindly scaling up parameters to get better performance proving that you can squeeze frontier level logical reasoning into a tiny 3b parameter model. It managed to hit a score of 94.3 on the extremely difficult AIME26 math benchmark and got an 80.2 on LiveCodeBench v6 putting their incredibly small model in the exact same weight class as massive flagship models like Gemini 3 Pro.  \n\nThey pulled it off using optimized post training pipeline based on their Spectrum to Signal paradigm  starting with curriculum based supervised fine tuning to teach the model broad concepts before forcing it to focus on extremely hard and long reasoning problems. After that they ran multi domain reinforcement learning with a huge 64K context window to make sure the model could actually finish its long thoughts without getting artificially truncated. Another trick they used was to include a Long2Short reinforcement learning stage designed to force the model to be more token efficient in its math reasoning without losing accuracy. And tied it all together with offline self distillation to bake advanced reasoning skills into the ba\n\n[22 upvotes] the caveat from what i have heard is that it thinks abysmally long amount. like even for very simple queries it had at least think a few thousand tokens. and obviously there is the general lack of world knowledge. \n\nsomething similar to this but like 30b might had been actually a bit competitive\n\n[19 upvotes] https://preview.redd.it/0eiy5nmgp29h1.png?width=675&format=png&auto=webp&s=fec5de3f3a0dde343be59447e3d49eb9dbda351a\n\nI was wondering why I've never heard of this before, well... It can't be used reliably in code harness and agentic coding.",
  "transcript_chars": 1803,
  "ingested_at": "2026-06-24T01:30:36.993006+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 229,
    "upvote_ratio": 0.92,
    "num_comments": 32,
    "author": "yogthos",
    "is_self": false
  }
}