2025-06-13_amd-advancing-ai-mi350x-and-mi400-ualoe72-mi500-ual256::AMD25-0026
① SA Source
- Source: 開啟完整 SA 文章
- Section:
MI350X, MI355X, MI400 Series UALoE72 Bill Of Materials and Total Cost of Ownership - Line hint:
423
Context Before
If AMD can execute on the MI500 UAL256, it could potentially crush Nvidia’s VR300 NVL576 Kyber rack, but this will be far from easy given the significant engineering and product ramps that this ambition design will require. Even if AMD takes a step back and de-risks the design by opting to go with an MI500 UAL128 design with just 128 physical/logical chips - this could still be competitive with VR300 NVL576 though it will fall short of decisively crushing Nvidia’s competing system.
MI350X, MI355X, MI400 Series UALoE72 Bill Of Materials and Total Cost of Ownership
Evidence
The MI400 Helios rack is composed of 18 compute trays, each containing four GPUs and one Venice CPU. Each tray also includes 12 Pensando Vulcano NICs at 800G for backend scale-up networking, three NICs per GPU. The BOM cost per compute tray is $210k.
Context After
The system also contains 6 switch trays, whose major cost items are the two 102.4T switches based on Tomahawk 6 ASICs. The BOM cost per switch tray is 4.2 million.
It is important to note that some analysts are assuming that AMD will integrate the scale-up switch tray in the same way the Nvidia currently does for their switch trays and copper backplane for the GB200 NVL72. This would mean that AMD would likely place a 40-50% gross margin on top of all the switch tray components, which would roughly double the ASP of the switch tray. We disagree with this hypothesis and think that AMD will be working with ODMs to integrate the switch tray. We also do not think it is logical for AMD to add a 2x markup on top of the Tomahawk 6 switch used in the scale-up switch tray as Broadcom’s margin is already baked into the BoM cost assumed for the Tomahawk 6 switch. However, we have added a low integration margin for the switch tray to reflect the added complexity of integrating this system.
② Atomic Claim
MI400 Helios 有 18 compute trays；每 tray 4 GPUs + 1 Venice CPU + 12 個 800G Vulcano NICs，compute-tray BOM 約 $210k。
- Epistemic Mode:
ESTIMATED - Mapping Status:
COMPLETE
③ Semantic Frame
{
"attribute": "helios_compute_tray_bom",
"context_nodes": [
{
"id": "04_knowledge_base/AMD Venice",
"label": "Venice"
},
{
"id": "04_knowledge_base/Compute Tray",
"label": "Compute Tray"
},
{
"id": "04_knowledge_base/800G",
"label": "800G"
}
],
"entity": {
"id": "04_knowledge_base/MI400",
"label": "MI400"
},
"frame_type": "ATTRIBUTE",
"qualifiers": {
"condition_text": null,
"numeric_mentions": [
"18",
"4",
"1",
"12",
"800G",
"$210k"
],
"temporal_mentions": []
},
"value": {
"numeric_mentions": [
"18",
"4",
"1",
"12",
"800G",
"$210k"
],
"value_text": "18 trays; per tray 4 GPUs + 1 Venice CPU + 12 800G NICs; $210k/tray"
}
}④ Canonical Entity Mapping
| Role | Surface Label | Canonical Target |
|---|---|---|
| entity | MI400 | MI400 |
| context_0 | Venice | 04_knowledge_base/AMD Venice |
| context_1 | Compute Tray | 04_knowledge_base/Compute Tray |
| context_2 | 800G | 800G |
⑤ Human Review
請在 Properties 逐項確認：
- 原文 → Atomic Claim 是否忠實
- Atomic Claim → Semantic Frame 是否忠實
- Canonical Entity mapping 是否正確
- Epistemic mode 是否保留原文語氣
- 最後選擇
review_action
Review state
Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。