clm_a6734a8623784755b3fe68bc0e08f753_r1

IX2-0012

① SA Source

• Source: 開啟完整 SA 文章
• Section: Introduction
• Line hint: 27

Context Before

InferenceXv2 builds on this foundation. It expands coverage to include large scale DeepSeek MoE disaggregated inference (disagg prefill, or simply “disagg”) with wide expert parallelism (wideEP) optimization to **all 6 NVIDIA western GPU SKUs from the past 4 years **as well as to every single AMD western GPU SKU released in the past 3 years – in total InferenceXv2 utilizes close to 1000 frontier GPUs for a full benchmark run across all SKUs.

With today’s release, InferenceXv2 is now the first suite to benchmark the Blackwell Ultra GB300 NVL72 and B300 across the whole pareto frontier curve, and it is the first third party benchmark to test disagg+wideEP multi-node FP4 and FP8 MI355X performance. In future iterations of InferenceX, we will continue to focus heavily on disaggregated serving with wide expert parallelism as that is what is deployed in production at Frontier AI Labs like OpenAI, Anthropic, xAI, Google Deepmind, DeepSeek as well as advanced API providers like TogetherAI, Baseten, and Fireworks. In this article, we will also break down the system engineering principles and economics in play around the latest Claude Code Fast mode feature ↗.

Evidence

Our benchmark is completely open-source under Apache 2.0 – this means that we are able to move at the same rapid speed at which the AI software ecosystem is advancing

Context After

We will add DeepSeekv4 and other popular Chinese frontier models with day 0 support as over the past 6 months, we now have cleaned up a lot of tech debt and are able to move fast with stable infrastructure ↗. We will also be adding TPUv7 Ironwood and Trainium3 to InferenceX later this year! If you want to contribute to our impactful mission while earning a competitive compensation, consider applying here ↗.

② Atomic Claim

關於 InferenceX：這套 benchmark 完全以 Apache 2.0 開源，因此能以接近 AI software ecosystem 演進的速度快速更新。

• Epistemic Mode: ASSERTED
• Mapping Status: PARTIAL

③ Semantic Frame

{
  "attribute": "SOFTWARE_STATUS",
  "context_nodes": [],
  "entity": {
    "id": "04_knowledge_base/InferenceX",
    "label": "InferenceX"
  },
  "frame_type": "ATTRIBUTE",
  "qualifiers": {
    "condition_text": null,
    "numeric_mentions": [
      "2.0"
    ],
    "temporal_mentions": []
  },
  "value": {
    "numeric_mentions": [
      "2.0"
    ],
    "value_text": "關於 InferenceX：這套 benchmark 完全以 Apache 2.0 開源，因此能以接近 AI software ecosystem 演進的速度快速更新。"
  }
}

④ Canonical Entity Mapping

Role	Surface Label	Canonical Target
entity	InferenceX	InferenceX

⑤ Human Review

請在 Properties 逐項確認：

• 原文 → Atomic Claim 是否忠實
• Atomic Claim → Semantic Frame 是否忠實
• Canonical Entity mapping 是否正確
• Epistemic mode 是否保留原文語氣
• 最後選擇 review_action

Review state

Markdown 內文不是正式 approval。只有 Apply bridge 寫入的 Decision Ledger event 才是正式決策。