IX2-0226
① SA Source
- Source: 開啟完整 SA 文章
- Section:
Nvidia Disagg Prefill and WideEP - Line hint:
384
Context Before
Source: SemiAnalysis InferenceX ↗
Evidence
Generally, TP is preferred at lower concurrencies due to load balancing
Context After
At higher concurrencies, this tradeoff changes. Expert activation becomes more evenly distributed across larger batch sizes, and EP’s communication and weight-loading advantages dominate over TP’s expensive per-layer all-reduce. In the middle of the curve, hybrid TP+EP configurations balance both concerns using small TP groups within each expert for load balancing while EP is used across the wider set of GPUs to amortize weights and reduce communication.
For higher interactivity levels (low batch size), large scale-up world sizes tend not to deliver stronger performance. B300 disagg over IB has the same performance as GB300 with NVL72, since the workload is latency-bound, not bandwidth-bound. The massive NVLink bandwidth advantage of NVL72 doesn’t matter because not even the much slower IB link is saturated by the tiny batches of tokens in flight.
② Atomic Claim
一般而言，在較低 concurrency 下，由於 load balancing 考量，TP 會較受偏好。
- Epistemic Mode:
ASSERTED - Mapping Status:
PARTIAL
③ Semantic Frame
{
"comparison_expression": "一般而言，在較低 concurrency 下，由於 load balancing 考量，TP 會較受偏好。",
"entities": [
{
"id": "04_knowledge_base/Tensor Parallelism",
"label": "TP"
}
],
"frame_type": "COMPARISON",
"metric": "UNSPECIFIED_METRIC",
"operator": "LESS_THAN",
"qualifiers": {
"condition_text": null,
"numeric_mentions": [],
"temporal_mentions": []
}
}④ Canonical Entity Mapping
| Role | Surface Label | Canonical Target |
|---|---|---|
| comparison_entity_0 | TP | 04_knowledge_base/Tensor Parallelism |
⑤ Human Review
請在 Properties 逐項確認：
- 原文 → Atomic Claim 是否忠實
- Atomic Claim → Semantic Frame 是否忠實
- Canonical Entity mapping 是否正確
- Epistemic mode 是否保留原文語氣
- 最後選擇
review_action
Review state
Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。