IX2-0082
① SA Source
- Source: 開啟完整 SA 文章
- Section:
Tensor Parallel, Expert Parallel, Data Parallel (TP, EP, DP) - Line hint:
113
Context Before
Disaggregated prefill (aka PD disaggregation or simply “disagg”) is the practice of separating the prefill and decode phases across separate pools of GPUs or clusters. These separate prefill and decode pools can be tuned independently and scaled to match the needs of workloads.
Tensor Parallel, Expert Parallel, Data Parallel (TP, EP, DP)
Evidence
the drawback being an all-to-all collective (which is more costly than simpler collectives like all-reduce) is carried out for MoE layers
Context After
Tracking Improvements Over Time
One of the main goals of InferenceX is to visualize performance improvements over time. While new chips are released on an O(yearly) cadence, software releases happen on an O(weekly) cadence. Our goal is to constantly update recipes with the latest and greatest software improvements and benchmark the configurations.
② Atomic Claim
其缺點是 MoE layers 需要執行 all-to-all collective，而這比 all-reduce 等較簡單 collective 成本更高。
- Epistemic Mode:
ASSERTED - Mapping Status:
COMPLETE
③ Semantic Frame
{
"comparison_expression": "其缺點是 MoE layers 需要執行 all-to-all collective，而這比 all-reduce 等較簡單 collective 成本更高。",
"entities": [
{
"id": "04_knowledge_base/Mixture of Experts",
"label": "MoE"
},
{
"id": "04_knowledge_base/All-Reduce",
"label": "all-reduce"
}
],
"frame_type": "COMPARISON",
"metric": "COST",
"operator": "GREATER_THAN",
"qualifiers": {
"condition_text": null,
"numeric_mentions": [],
"temporal_mentions": []
}
}④ Canonical Entity Mapping
| Role | Surface Label | Canonical Target |
|---|---|---|
| comparison_entity_0 | MoE | 04_knowledge_base/Mixture of Experts |
| comparison_entity_1 | all-reduce | All-Reduce |
⑤ Human Review
請在 Properties 逐項確認：
- 原文 → Atomic Claim 是否忠實
- Atomic Claim → Semantic Frame 是否忠實
- Canonical Entity mapping 是否正確
- Epistemic mode 是否保留原文語氣
- 最後選擇
review_action
Review state
Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。