VR2-0625

① SA Source

Context Before

Connecting GPUs in the Scale-Out InfiniBand Network

Broadly, there are three flavors of scale-out deployments for Vera Rubin NVL72. We have InfiniBand-based clusters which employ the NVIDIA Quantum series of switches, NVIDIA Ethernet-based clusters employing Spectrum series switches and lastly, non-Nvidia Ethernet such as Tomahawk-based, Cisco Silicon One or Teralynx-based Ethernet switches. Some Ethernet-based clusters deployed by hyperscalers will use AECs for NIC-to-TOR and switch-to-switch connections, while other Ethernet-based clusters using only optical interconnects will usually adopt a multi-plane and multi-rail networking architecture. What is particularly noteworthy about Vera Rubin NVL72 deployments, however, is that it is the first Nvidia GPU generation where we will be seeing some Co-Packaged-Optics (CPO) deployments in the scale-out backend network.

Evidence

For InfiniBand, there are two deployment types – the first is the Quantum X800-Q3400 with pluggable optics and the second is the Quantum X800-Q3450 CPO-based switch that use co-packaged Optical Engines (OE) instead of pluggable transceivers

Context After

The Quantum X800-Q3400 is logically a multi-plane switch combining 4 Quantum-3 ASICs into a single switch box, though we will dive into this equivalence later in the article. This multi-plane “topology” is abstracted away and as far as network engineers are concerned, the Q3400 is a single switch with 144 ports – or a “little boy” switch.

image

② Atomic Claim

InfiniBand 有兩種 deployment:Quantum X800-Q3400 使用 pluggable opticsQuantum X800-Q3450 則是 CPO-based switch,使用 co-packaged Optical Engines(OE)取代 pluggable transceivers

  • Epistemic Mode: ASSERTED
  • Mapping Status: PARTIAL

③ Semantic Frame

{
  "frame_type": "NARY_RELATION",
  "participants": [
    {
      "node": {
        "id": "04_knowledge_base/InfiniBand",
        "label": "InfiniBand"
      },
      "role": "user_or_subject"
    },
    {
      "node": {
        "id": "04_knowledge_base/Quantum X800",
        "label": "Quantum X800"
      },
      "role": "used_entity"
    },
    {
      "node": {
        "id": "04_knowledge_base/Pluggable optics",
        "label": "pluggable optics"
      },
      "role": "used_entity"
    },
    {
      "node": {
        "id": "04_knowledge_base/CPO",
        "label": "CPO"
      },
      "role": "used_entity"
    },
    {
      "node": {
        "id": "04_knowledge_base/Optical Engine",
        "label": "Optical Engines"
      },
      "role": "used_entity"
    },
    {
      "node": {
        "id": "04_knowledge_base/Pluggable transceiver",
        "label": "pluggable transceivers"
      },
      "role": "used_entity"
    }
  ],
  "qualifiers": {
    "condition_text": null,
    "numeric_mentions": [],
    "temporal_mentions": []
  },
  "relation_type": "USES"
}

④ Canonical Entity Mapping

RoleSurface LabelCanonical Target
user_or_subjectInfiniBandInfiniBand
used_entityQuantum X80004_knowledge_base/Quantum X800
used_entitypluggable optics04_knowledge_base/Pluggable optics
used_entityCPOCPO
used_entityOptical Engines04_knowledge_base/Optical Engine
used_entitypluggable transceivers04_knowledge_base/Pluggable transceiver

⑤ Human Review

請在 Properties 逐項確認:

  • 原文 → Atomic Claim 是否忠實
  • Atomic Claim → Semantic Frame 是否忠實
  • Canonical Entity mapping 是否正確
  • Epistemic mode 是否保留原文語氣
  • 最後選擇 review_action

Review state

Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。