IX2-0493
① SA Source
- Source: 開啟完整 SA 文章
- Section:
Optimizing Inference with Wide EP + Disaggregated Serving - Line hint:
696
Context Before
Source: SemiAnalysis InferenceX ↗
Evidence
Decode nodes are fewer but run wide DEP with large batch sizes by the same principle as with single node
Context After
On the low interactivity end of the frontier, there are fewer concurrent requests in flight, so a single prefill instance can keep pace with incoming demand. Yet each request still requires 1024 decode steps, and at high interactivity those steps must be fast. Recipes in this region shift to more decode nodes than prefill (1P3D, 1P4D), with each decode instance running TEP at low batch size. Tensor parallelism on attention minimizes per-step latency by sharding the computation across all GPUs in the instance, while expert parallelism handles MoE routing at the moderate batch sizes where EP load balance is sufficient. Multiple small-batch decode instances, rather than fewer large-batch ones, keep per-token latency low while still providing enough concurrent serving capacity.
② Atomic Claim
Decode nodes 數量較少，但同樣依 single-node 的原理，以大 batch size 執行 wide DEP。
- Epistemic Mode:
ASSERTED - Mapping Status:
PARTIAL
③ Semantic Frame
{
"comparison_expression": "Decode nodes 數量較少，但同樣依 single-node 的原理，以大 batch size 執行 wide DEP。",
"entities": [
{
"id": "04_knowledge_base/Decode",
"label": "Decode"
}
],
"frame_type": "COMPARISON",
"metric": "COUNT",
"operator": "UNSPECIFIED_COMPARISON",
"qualifiers": {
"condition_text": null,
"numeric_mentions": [],
"temporal_mentions": []
}
}④ Canonical Entity Mapping
| Role | Surface Label | Canonical Target |
|---|---|---|
| comparison_entity_0 | Decode | Decode |
⑤ Human Review
請在 Properties 逐項確認：
- 原文 → Atomic Claim 是否忠實
- Atomic Claim → Semantic Frame 是否忠實
- Canonical Entity mapping 是否正確
- Epistemic mode 是否保留原文語氣
- 最後選擇
review_action
Review state
Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。