| 04_knowledge_base/GB200 NVL72 | 61 |
| 04_knowledge_base/GPU | 55 |
| 04_knowledge_base/H100 | 49 |
| 02_companies/NVDA | 27 |
| 04_knowledge_base/Llama | 19 |
| 04_knowledge_base/Backplane | 19 |
| 04_knowledge_base/Mixture of Experts | 14 |
| 04_knowledge_base/BF16 | 14 |
| 04_knowledge_base/GB200 | 12 |
| 04_knowledge_base/FP8 | 11 |
| 04_knowledge_base/GPT-3 | 11 |
| 02_companies/Switch | 9 |
| 04_knowledge_base/Paladin connector | 9 |
| 02_companies/DeepSeek | 8 |
| 04_knowledge_base/Hyperscaler | 8 |
| 04_knowledge_base/Compute Tray | 8 |
| 03_industries/Neocloud產業 | 7 |
| 04_knowledge_base/PyTorch | 7 |
| 04_knowledge_base/NVLink | 6 |
| 04_knowledge_base/Batch size | 5 |
| 04_knowledge_base/Sequence length | 5 |
| 04_knowledge_base/Hopper | 4 |
| 04_knowledge_base/Copper | 4 |
| 04_knowledge_base/Weak scaling | 4 |
| 04_knowledge_base/NVSwitch | 3 |
| 04_knowledge_base/TPU | 3 |
| 04_knowledge_base/Expert Parallelism | 2 |
| 04_knowledge_base/TorchTitan | 2 |
| 02_companies/META | 2 |
| 04_knowledge_base/H200 | 2 |
| 04_knowledge_base/HGX | 2 |
| 04_knowledge_base/GCP | 2 |
| 04_knowledge_base/NVIDIA Collective Communications Library (NCCL) | 2 |
| 04_knowledge_base/Burn-in | 2 |
| 04_knowledge_base/Trainium | 2 |
| 04_knowledge_base/Pre-training | 2 |
| 04_knowledge_base/Data Parallelism | 2 |
| 04_knowledge_base/CUDA | 2 |
| 04_knowledge_base/CI-CD | 2 |
| 04_knowledge_base/NVIDIA B200 | 2 |
| 04_knowledge_base/FSDP2 | 2 |
| 04_knowledge_base/Strong Scaling | 2 |
| 04_knowledge_base/Model FLOPS Utilization | 2 |
| 04_knowledge_base/Power Usage Effectiveness | 2 |
| 02_companies/GOOG | 1 |
| 04_knowledge_base/Arithmetic intensity | 1 |
| 04_knowledge_base/ASIC | 1 |
| 02_companies/AMD | 1 |
| 02_companies/APH | 1 |
| 04_knowledge_base/PCB | 1 |
| 04_knowledge_base/Mid-training | 1 |
| 04_knowledge_base/Blackwell | 1 |
| 04_knowledge_base/Scale-out networking | 1 |
| 04_knowledge_base/InfiniBand | 1 |
| 04_knowledge_base/液冷散熱 | 1 |
| 04_knowledge_base/Tensor Parallelism | 1 |
| 04_knowledge_base/Flyover cable | 1 |
| 04_knowledge_base/Pipeline parallelism | 1 |
| 04_knowledge_base/Slurm | 1 |
| 04_knowledge_base/ClusterMAX | 1 |
| 04_knowledge_base/Reinforcement learning | 1 |
| 04_knowledge_base/CPU | 1 |
| 04_knowledge_base/Software Stack | 1 |
| 04_knowledge_base/Bianca Board | 1 |
| 04_knowledge_base/Chiller | 1 |
| 04_knowledge_base/DGX | 1 |