{
  "video_id": "reddit_1wbb5hs",
  "channel_slug": "singularity",
  "channel_handle": "r/singularity",
  "title": "Maybe Transformer is the singularity?",
  "url": "https://www.reddit.com/r/singularity/comments/1wbb5hs/maybe_transformer_is_the_singularity/",
  "external_url": null,
  "upload_date": "20260909",
  "published_at": "2026-09-09T04:16:34+00:00",
  "transcript": "The Transformer is starting to feel less like an another AI architecture and more like some fundamental object/entity we accidentally discovered.\n\nAlmost anything we throw at it seems to get absorbed into the same structure: language, vision, audio, video, code, mathematics, reasoning, tools, agents, entire environments.\n\nAnd there doesn't seem to be an obvious conceptual ceiling yet. We just keep finding new ways to make the same underlying object represent more knowledge and perform more kinds of computation.\n\nIt almost feels like an information black hole, except instead of destroying information, it absorbs it and turns it into intelligence.\n\nMaybe the Transformer isn't just one step on the road to AGI, maybe it's the substrate the whole thing happens inside.   \n  \nMaybe we passed the event horizon in 2017 when we created the first one.\n\n\n\n--- Top Comments ---\n\n\n[35 upvotes] Funny how Google's most major innovations were public information. PageRank and the Transformer. \n\n[23 upvotes] I think there is a sense in which transformers are the foundational generalizing predictive unit analogously to cortical tissue in the brain but I think there are still at least a few fundamental capacities transformers don’t use that we know that living intelligences do and there is probably still more that we just don’t even know about yet. We still just barely understand the big picture of intelligence.\n\n[18 upvotes] Are you saying it’s more than meets the eye? \n\n[7 upvotes] The AI revolution is happening because of deep learning, not because of Transformers. Maybe we'd be lacking a few years behind because Transformers are so training-efficient, but we could've had LLMs with LSTMs and CNNs as well.\n\nFunction approximation is all you need.",
  "transcript_chars": 1756,
  "ingested_at": "2026-09-09T13:30:19.524720+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 58,
    "upvote_ratio": 0.79,
    "num_comments": 49,
    "author": "notadithyabhat",
    "is_self": true
  }
}