IX2-0079
① SA Source
- Source: 開啟完整 SA 文章
- Section:
Tensor Parallel, Expert Parallel, Data Parallel (TP, EP, DP) - Line hint:
113
Context Before
Disaggregated prefill (aka PD disaggregation or simply “disagg”) is the practice of separating the prefill and decode phases across separate pools of GPUs or clusters. These separate prefill and decode pools can be tuned independently and scaled to match the needs of workloads.
Tensor Parallel, Expert Parallel, Data Parallel (TP, EP, DP)
Evidence
TP allows for maximize interactivity at small batch sizes
Context After
Tracking Improvements Over Time
One of the main goals of InferenceX is to visualize performance improvements over time. While new chips are released on an O(yearly) cadence, software releases happen on an O(weekly) cadence. Our goal is to constantly update recipes with the latest and greatest software improvements and benchmark the configurations.
② Atomic Claim
TP 可在小 batch size 下最大化 interactivity。
- Epistemic Mode:
ASSERTED - Mapping Status:
COMPLETE
③ Semantic Frame
{
"attribute": "INTERACTIVITY",
"context_nodes": [
{
"id": "04_knowledge_base/Batch size",
"label": "batch size"
}
],
"entity": {
"id": "04_knowledge_base/Tensor Parallelism",
"label": "TP"
},
"frame_type": "ATTRIBUTE",
"qualifiers": {
"condition_text": null,
"numeric_mentions": [],
"temporal_mentions": []
},
"value": {
"numeric_mentions": [],
"value_text": "TP 可在小 batch size 下最大化 interactivity。"
}
}④ Canonical Entity Mapping
| Role | Surface Label | Canonical Target |
|---|---|---|
| entity | TP | 04_knowledge_base/Tensor Parallelism |
| context_0 | batch size | 04_knowledge_base/Batch size |
⑤ Human Review
請在 Properties 逐項確認：
- 原文 → Atomic Claim 是否忠實
- Atomic Claim → Semantic Frame 是否忠實
- Canonical Entity mapping 是否正確
- Epistemic mode 是否保留原文語氣
- 最後選擇
review_action
Review state
Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。