2024-12-22_mi300x-vs-h100-vs-h200-benchmark-part-1-training

Canonical Target Counts

TargetOccurrences
02_companies/AMD227
02_companies/NVDA97
04_knowledge_base/GPU89
04_knowledge_base/MI300X87
04_knowledge_base/PyTorch71
04_knowledge_base/H10069
04_knowledge_base/H20052
04_knowledge_base/InfiniBand27
04_knowledge_base/Ethernet22
04_knowledge_base/FP818
04_knowledge_base/MLPerf18
02_companies/META17
03_industries/Neocloud產業14
04_knowledge_base/BF1614
04_knowledge_base/Llama12
04_knowledge_base/HBM11
02_companies/Switch11
04_knowledge_base/NVIDIA Collective Communications Library (NCCL)9
04_knowledge_base/GPT-39
04_knowledge_base/FLOP9
04_knowledge_base/FP168
04_knowledge_base/NVLink7
04_knowledge_base/Large language model7
04_knowledge_base/ROCm Communication Collectives Library7
04_knowledge_base/L2 cache7
02_companies/Tensorwave6
04_knowledge_base/CUDA6
04_knowledge_base/Fully Sharded Data Parallel6
02_companies/Together AI6
04_knowledge_base/Transformer architecture6
04_knowledge_base/NIC6
04_knowledge_base/Software Stack6
04_knowledge_base/Transistor6
04_knowledge_base/ROCm5
04_knowledge_base/Hyperscaler5
04_knowledge_base/Flash memory5
04_knowledge_base/AWS5
04_knowledge_base/NVIDIA Spectrum-X4
04_knowledge_base/Sparsity4
04_knowledge_base/Tensor Core4
02_companies/OpenAI4
04_knowledge_base/RoCEv24
04_knowledge_base/GCP4
04_knowledge_base/CI-CD4
04_knowledge_base/Batch size4
04_knowledge_base/MI3003
04_knowledge_base/Blackwell3
04_knowledge_base/AMD HIP3
04_knowledge_base/Tensor Parallelism3
04_knowledge_base/Tomahawk 53
04_knowledge_base/ChatGPT3
04_knowledge_base/400G3
04_knowledge_base/Quantum-23
04_knowledge_base/ClusterMAX3
02_companies/Nebius2
04_knowledge_base/Feed-forward Network2
04_knowledge_base/Scale-out networking2
04_knowledge_base/Pollara2
04_knowledge_base/Anthropic Claude2
02_companies/Crusoe2
02_companies/Lambda2
04_knowledge_base/HBM32
04_knowledge_base/2-of-4 Sparsity2
02_companies/Arista2
02_companies/AVGO2
04_knowledge_base/torch.compile2
04_knowledge_base/Reference Design2
04_knowledge_base/CoWoS1
04_knowledge_base/800G1
04_knowledge_base/IC design verification1
02_companies/GOOG1
04_knowledge_base/ConnectX-81
04_knowledge_base/Triton1
04_knowledge_base/SIMT1
02_companies/Anthropic1
02_companies/xAI1
04_knowledge_base/Expert Parallelism1
04_knowledge_base/WhiteBox Ethernet1
02_companies/MSFT1
04_knowledge_base/MI325X1
04_knowledge_base/液冷散熱1
04_knowledge_base/ASIC1
04_knowledge_base/MI355X1
04_knowledge_base/Pipeline parallelism1
04_knowledge_base/NVSwitch1
02_companies/GitHub1
04_knowledge_base/Grok1
04_knowledge_base/Data Parallelism1
04_knowledge_base/Scale-up network1
04_knowledge_base/Checkpointing1
04_knowledge_base/Network Topology1
04_knowledge_base/CPU1
04_knowledge_base/Fat Tree1
04_knowledge_base/CUTLASS1
04_knowledge_base/NVIDIA Nsight Systems1
04_knowledge_base/EFAv31
04_knowledge_base/BlueField-31
04_knowledge_base/EFAv21
04_knowledge_base/ConnectX-71
04_knowledge_base/Direct Current1
04_knowledge_base/GB2001
04_knowledge_base/Thermal Design Power1
04_knowledge_base/Congestion Control1
04_knowledge_base/QM97001
04_knowledge_base/200G1
04_knowledge_base/SN56001
04_knowledge_base/NVIDIA Nsight Compute1
04_knowledge_base/NVIDIA B2001
04_knowledge_base/Distributed Data Parallel1