{
  "video_id": "reddit_1uj7egu",
  "channel_slug": "LocalLLaMA",
  "channel_handle": "r/LocalLLaMA",
  "title": "Introducing LongCat-2.0 - , a large-scale MoE language model with 1.6 trillion total parameters and ~48 billion activated per token. This was the stealth model that was on Openrouter under the name 'owl-alpha'.",
  "url": "https://www.reddit.com/r/LocalLLaMA/comments/1uj7egu/introducing_longcat20_a_largescale_moe_language/",
  "external_url": "https://longcat.chat/blog/longcat-2.0/",
  "upload_date": "20260629",
  "published_at": "2026-06-29T22:42:20+00:00",
  "transcript": "\n\n--- Top Comments ---\n\n\n[1 upvotes] Until such time that weights are published, this is off-topic for LocalLLaMA, but given its >100 upvotes and some good conversation in the comments, I'm leaving it up.\n\n[26 upvotes] Some highlights from their article:\n\n>Both the full training run and the large-scale deployment are built entirely on AI ASIC superpods.\n\n> Our architecture design builds on LongCat-Flash, pushing further on parameter efficiency and improving the speed of long-context training and inference. For attention, we introduce LongCat Sparse Attention (LSA) — an evolution of DeepSeek Sparse Attention\n\n> [Our improvements to LSA] extended three strategies to the 3-step Multi-Token Prediction (MTP) module for accelerating speculative decoding.\n\n> The sparsity of MoE has crossed the sweet spot. Given that the model's sparsity has already reached approximately 97% even without considering the N-gram Embedding, the performance gain from scaling up experts by 135B parameters is negligible.\n\n\nThese are just my highlights, but love the direction. Seems like a few 'free lunches' still out there.\n\nAnyone know more about the ASICs they're using?\n\nEdit:\nMore speculation on the ASICs.\n>These are almost definitely Huawei Ascend 910C. 910C superpod has 48 machines with 8 processors each. Each processor has two physical dies that could function as two logical processors. In that mode, each die has 64GB HB\n\n[21 upvotes] Long Cat is a lot easier to say than Owl Alpha at least.\n\n[18 upvotes] Think a 3060 will be enough to run this??",
  "transcript_chars": 1546,
  "ingested_at": "2026-06-30T01:30:02.721026+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 122,
    "upvote_ratio": 0.96,
    "num_comments": 32,
    "author": "AnticitizenPrime",
    "is_self": false
  }
}