IX2-0024

① SA Source

Context Before

Key Observations and Results to Highlight

We see competitive perf per TCO results on FP8 MI355X disagg+wideEP SGLang on AMD compared to FP8 B200 disagg+wideEP SGLang, but when compared to widely used Dynamo TRTLLM B200 FP8, TRT continues to framemog. This is amazing news that AMD SGLang Disagg prefill+wideEP for FP8 is able to match NVIDIA’s SGLang performance.

Evidence

We recommend that NVIDIA focus even more on SGLang & vLLM ecosystem in addition their TRTLLM engine

Context After

SemiAnalysis InferenceX is free open source software and reader-supported. To receive new posts and support our work consider becoming a free or paid subscriber.

Subscribed

② Atomic Claim

SemiAnalysis 建議 NVIDIA 除了 TRTLLM engine 外,也應投入更多資源到 SGLangvLLM ecosystem。

  • Epistemic Mode: ASSERTED
  • Mapping Status: COMPLETE

③ Semantic Frame

{
  "attribute": "RECOMMENDED_RESOURCE_FOCUS",
  "context_nodes": [
    {
      "id": "04_knowledge_base/SGLang",
      "label": "SGLang"
    },
    {
      "id": "04_knowledge_base/vLLM",
      "label": "vLLM"
    },
    {
      "id": "04_knowledge_base/TensorRT-LLM",
      "label": "TRTLLM"
    }
  ],
  "entity": {
    "id": "02_companies/NVDA",
    "label": "NVIDIA"
  },
  "frame_type": "ATTRIBUTE",
  "qualifiers": {
    "condition_text": null,
    "numeric_mentions": [],
    "temporal_mentions": []
  },
  "value": {
    "numeric_mentions": [],
    "value_text": "SemiAnalysis 建議 [[02_companies/NVDA|NVIDIA]] 除了 [[04_knowledge_base/TensorRT-LLM|TRTLLM]] engine 外,也應投入更多資源到 [[04_knowledge_base/SGLang|SGLang]] 與 [[04_knowledge_base/vLLM|vLLM]] ecosystem。"
  }
}

④ Canonical Entity Mapping

RoleSurface LabelCanonical Target
entityNVIDIANVDA
context_0SGLangSGLang
context_1vLLMvLLM
context_2TRTLLMTensorRT-LLM

⑤ Human Review

請在 Properties 逐項確認:

  • 原文 → Atomic Claim 是否忠實
  • Atomic Claim → Semantic Frame 是否忠實
  • Canonical Entity mapping 是否正確
  • Epistemic mode 是否保留原文語氣
  • 最後選擇 review_action

Review state

Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。