{
  "video_id": "reddit_1w6z731",
  "channel_slug": "LocalLLaMA",
  "channel_handle": "r/LocalLLaMA",
  "title": "On GPT-6 Astra 98.6% ARC AGI-3: don't fall for the hype",
  "url": "https://www.reddit.com/r/LocalLLaMA/comments/1w6z731/on_gpt6_astra_986_arc_agi3_dont_fall_for_the_hype/",
  "external_url": null,
  "upload_date": "20260904",
  "published_at": "2026-09-04T09:11:33+00:00",
  "transcript": "Here is the news you may have missed:\n\nNvidia already demonstrated **100% on ARC AGI-3**, using their novel harness AVO:\n\n[https://developer.nvidia.com/blog/nvidia-avo-reaches-100-on-arc-agi-3-demonstrating-a-frontier-level-general-purpose-architecture-for-long-horizon-autonomous-agents/#](https://developer.nvidia.com/blog/nvidia-avo-reaches-100-on-arc-agi-3-demonstrating-a-frontier-level-general-purpose-architecture-for-long-horizon-autonomous-agents/#)\n\nOpenAI didn't use the standard harness in the ARC AGI-3, but their own.\n\n\n\n--- Top Comments ---\n\n\n[101 upvotes] With standard harness, Astra is still able to achieve 66%.\n\n[43 upvotes] NVIDIA wasn't the first to get to (or close to) 100% either. Before that, there were Arc-Skill, VISTA (which the NVIDIA article credited), and Schema harnesses used on older models, going all the way back to July.\n\nAstra still achieved a great result, but you shouldn't include the proprietary harness. If you do, it's like allowing superbikes in the Tour de France. At that point, the race becomes more about measuring the superbike than about measuring the actual rider. \n\n\n\n[25 upvotes] It's just a benchmark with a novel name, nice it's good there. Doesn't prove AGI or anything close to it. Just load up the astra model and see if it does something without input.\n\n[9 upvotes] You are wrong Nvidia did this on the EASIER and PUBLIC  arc dataset. With models that are 100% trained on these exact games.\n\nAlso all of these harnesses 90% rely on the fact that powerful models like sol 5.6 and opus 5 were trained already on these exact public games. In an efficiency sense these harnesses are probably not even that optimal for acr agi 3 since they are not used in the competition at all.\n\nYou can try to \"cheat by a harness\" here: https://www.kaggle.com/competitions/arc-prize-2026-arc-agi-3/leaderboard and see how easy it is to reach 100%",
  "transcript_chars": 1888,
  "ingested_at": "2026-09-04T13:30:03.499895+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 112,
    "upvote_ratio": 0.81,
    "num_comments": 47,
    "author": "Informal-Trouble2183",
    "is_self": true
  }
}