2025-08-12_scaling-the-memory-wall-the-rise-and-roadmap-of-hbm::HBM25-0006

① SA Source

Context Before

Source: SemiAnalysis

The implication of having much more I/O is increased routing density and complexity. Each I/O requires an individual wire/trace, with additional wiring required for power and control. For a HBM3E stack, there are over a 1,000 wires between the adjacent XPU and the HBM. This level of routing density is not achievable on a PCB or package substrate; therefore, an interposer (silicon or organic) in a 2.5D package assembly like CoWoS is required.

Evidence

This makes shoreline (the edge of a SOC) more valuable as HBM can only be limited to the 2 edges of the SOC with the other 2 edges reserved for I/O off the package.

Context After

To enable the 3DIC form factor, each layer of the stack needs to have TSVs (excluding the top of stack) that can deliver power and signal to the layer above. The additional area required to fit these TSVs is what makes HBM die sizes larger than their DDR equivalent: SK Hynix D1z DDR4 has a bit density of 0.296 Gb/mm2, 85% more dense than their HBM3 which is 0.16 Gb/mm2. This TSV process is one of the key differences between standard DRAM, and tooling for this is the main bottleneck when it comes to converting regular DDR DRAM wafer capacity to HBM capacity.

The other difference is at the back-end, where the HBM needs to be stacked to 9 or 13 layers in total (8/12 DRAM layers on top of a logic base die at the bottom). Along with CoWoS, HBM has brought packaging technology to the mainstream. Niche packaging technologies like MR-MUF have now become common knowledge for industry participants.

② Atomic Claim

HBM 通常受限於 SoC 的 2 個 edges,另外 2 個 edges 留給 off-package I/O,使 shoreline 成為稀缺資源。

  • Epistemic Mode: ASSERTED
  • Mapping Status: COMPLETE

③ Semantic Frame

{
  "attribute": "hbm_shoreline_constraint",
  "context_nodes": [
    {
      "id": "04_knowledge_base/HBM",
      "label": "HBM"
    }
  ],
  "entity": {
    "id": "04_knowledge_base/SoC",
    "label": "SoC"
  },
  "frame_type": "ATTRIBUTE",
  "qualifiers": {
    "condition_text": null,
    "numeric_mentions": [
      "2",
      "2"
    ],
    "temporal_mentions": []
  },
  "value": {
    "numeric_mentions": [
      "2",
      "2"
    ],
    "value_text": "2 edges for HBM; other 2 edges reserved for off-package I/O"
  }
}

④ Canonical Entity Mapping

RoleSurface LabelCanonical Target
entitySoCSoC
context_0HBMHBM

⑤ Human Review

請在 Properties 逐項確認:

  • 原文 → Atomic Claim 是否忠實
  • Atomic Claim → Semantic Frame 是否忠實
  • Canonical Entity mapping 是否正確
  • Epistemic mode 是否保留原文語氣
  • 最後選擇 review_action

Review state

Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。