2025-05-23_amd-vs-nvidia-inference-benchmark-who-wins-performance-cost-per-million-tokens

Canonical Target Counts

TargetOccurrences
02_companies/AMD91
04_knowledge_base/H20081
04_knowledge_base/GPU60
04_knowledge_base/MI325X60
02_companies/NVDA52
04_knowledge_base/vLLM43
04_knowledge_base/Large language model40
04_knowledge_base/MI300X39
04_knowledge_base/NVIDIA B20027
04_knowledge_base/H10026
04_knowledge_base/SGLang22
04_knowledge_base/Prefill18
04_knowledge_base/Llama15
04_knowledge_base/KV cache14
02_companies/DeepSeek11
04_knowledge_base/MI355X8
03_industries/Neocloud產業8
04_knowledge_base/HBM7
04_knowledge_base/Decode7
04_knowledge_base/MI3006
04_knowledge_base/ROCm6
04_knowledge_base/FP86
04_knowledge_base/Time to First Token6
04_knowledge_base/Disaggregated prefill6
04_knowledge_base/NVMe5
04_knowledge_base/Hyperscaler5
04_knowledge_base/NVIDIA Dynamo4
02_companies/OpenAI4
04_knowledge_base/Mixture of Experts4
04_knowledge_base/Mooncake4
04_knowledge_base/Disaggregated serving4
04_knowledge_base/Batch size4
04_knowledge_base/HGX3
02_companies/GitHub3
04_knowledge_base/NVIDIA Inference Xfer Library (NIXL)3
04_knowledge_base/MI3253
04_knowledge_base/FP163
04_knowledge_base/CUDA2
04_knowledge_base/PyTorch2
04_knowledge_base/Blackwell2
04_knowledge_base/NVLink2
04_knowledge_base/Hopper2
04_knowledge_base/Tensor Parallelism2
04_knowledge_base/Backplane2
04_knowledge_base/Sequence length2
04_knowledge_base/Inference engine2
04_knowledge_base/Time Between Output Tokens2
04_knowledge_base/E2E latency2
04_knowledge_base/Disaggregated Decode2
04_knowledge_base/AMD AITER1
04_knowledge_base/Ethernet1
04_knowledge_base/PSU1
04_knowledge_base/Kubernetes1
04_knowledge_base/IC design verification1
02_companies/Crusoe1
02_companies/Nebius1
02_companies/CRWV1
02_companies/Nscale1
04_knowledge_base/Arithmetic intensity1
02_companies/Tensorwave1
04_knowledge_base/General Matrix Multiplication1
02_companies/META1
04_knowledge_base/InfiniBand1
04_knowledge_base/TFLOPS1
04_knowledge_base/NIC1
04_knowledge_base/x861
04_knowledge_base/CPU1
04_knowledge_base/GB200 NVL721
04_knowledge_base/SXM1
04_knowledge_base/GB2001