VR2R-0641
① SA Source
- Source: 開啟完整 SA 文章
- Section:
Ethernet-Based Cluster Deployments - Line hint:
851
Context Before
Large-scale cluster deployments where cluster sizes exceed 100k GPUs typically utilize multi-plane network architectures because single-plane network architectures do not have enough logical ports at current switch generations to support larger networks without resorting to a high number of switch layers of 3 or more layers.
Recall from above that a Vera Rubin NVL72 cluster built with Q3400-X800 switches at 1.6T logical ports per GPU cannot scale beyond the maximum cluster size of 93,312 GPUs. Even if future switch generations continue to double the maximum possible switching capacity per switch box, the per GPU bandwidth is also expected to double, which means that the effective logical port count in a cluster network is unlikely to change.
Evidence
What this means is that deployment of large-scale GPU clusters will continue to require multi-plane network architectures. Do note however that multi-plane networking architectures are not limited by size and we have also seen NVIDIA reference architecture deployments with multi-plane clusters that are significantly below 100k GPUs each.
Context After
In multi-plane network architectures using the SN6600 switch instead of the CPO switch, each GPU fans out to multiple switch boxes using fiber shuffles. This requires customers to deploy shuffle boxes, patch panels and unwieldy octopus cables outside the switch box that introduce complexity in installation and maintenance.
Some of Nvidia’s CPO SKUs – such as the SN6800 and Q3450 –contain such a fiber shuffle within the switch box, with each optical engine fanning out to different logical ports. They therefore deliver higher aggregate bandwidth – 409.6T and 115.2T respectively than is possible with a switch box based on a single Switch ASIC.
② Atomic Claim
這表示大型 GPU cluster 的部署未來仍會需要 multi-plane network architecture。
- Epistemic Mode:
INFERRED - Mapping Status:
PARTIAL
③ Semantic Frame
{
"attribute": "LARGE_CLUSTER_MULTIPLANE_REQUIREMENT",
"context_nodes": [],
"entity": {
"id": "04_knowledge_base/GPU",
"label": "GPU"
},
"frame_type": "ATTRIBUTE",
"qualifiers": {
"condition_text": "inference from switch-radix and per-GPU bandwidth scaling",
"numeric_mentions": [],
"temporal_mentions": [
"will continue"
]
},
"value": {
"numeric_mentions": [],
"value_text": "large-scale GPU clusters will continue to require multi-plane network architectures."
}
}④ Canonical Entity Mapping
| Role | Surface Label | Canonical Target |
|---|---|---|
| entity | GPU | GPU |
⑤ V2 Draft（需要修正時直接編輯）
Inline repair
只編輯以下三個 Draft 區塊。完成後將
review_action設為REQUEST_REPAIR，再手動執行 Repair Preview。
執行腳本前，Draft 不會寫入 Claim Store 或 Graph。
V2 Atomic Claim Draft
這表示大型 GPU cluster 的部署未來仍會需要 multi-plane network architecture。
V2 Semantic Frame Draft
{
"attribute": "LARGE_CLUSTER_MULTIPLANE_REQUIREMENT",
"context_nodes": [],
"entity": {
"id": "04_knowledge_base/GPU",
"label": "GPU"
},
"frame_type": "ATTRIBUTE",
"qualifiers": {
"condition_text": "inference from switch-radix and per-GPU bandwidth scaling",
"numeric_mentions": [],
"temporal_mentions": [
"will continue"
]
},
"value": {
"numeric_mentions": [],
"value_text": "large-scale GPU clusters will continue to require multi-plane network architectures."
}
}V2 Revision Metadata Draft
{
"epistemic_mode": "INFERRED",
"mapping_status": "PARTIAL"
}⑥ Human Review
請在 Properties 逐項確認：
- 原文 → Atomic Claim 是否忠實
- Atomic Claim → Semantic Frame 是否忠實
- Canonical Entity mapping 是否正確
- Epistemic mode 是否保留原文語氣
- 最後選擇
review_action
Review state
Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。