Eight H200s Doing Absolutely Nothing

Description

The image is a terminal screenshot running `nvidia-smi` from a shell prompt shown as `(.venv) falai@ll-h200-demo2:~$ nvidia-smi`. The output is dated "Fri Aug 30 18:25:28 2024" and reports NVIDIA-SMI 550.107.02, Driver Version 550.107.02, CUDA Version 12.4, and eight GPUs numbered 0 through 7, each listed as "NVIDIA H200". Every GPU shows roughly 29-32C, P0 state, about 73-79W out of a 700W cap, 1MiB / 143771MiB memory usage, 0% GPU utilization, and the process table says "No running processes found". The technical humor is the silent absurdity of having a massive AI training-class machine provisioned and powered while doing no work at all.

Common Tags

Gpu NvidiaCuda Hardware MachineLearning ModelTraining AIResearch CloudInfrastructure Infrastructure ResourceAllocation CapacityPlanning CloudCostOptimization TerminalCommands Linux

Comments

Anonymous ★ Top Pick Eight H200s at 0% utilization is the most expensive way to keep a blinking shell prompt warm.

Anonymous ★ Top Pick

Eight H200s at 0% utilization is the most expensive way to keep a blinking shell prompt warm.
@razordude 1y

Somebody's running a Llama 3.1 405B ;)
@korenkonder 1y

You can cook on this thing
1. dev_meme 1y
  
  100k$+ cookware? Nah, not that dream
@callofvoid0 1y

143GiB ?
1. dev_meme 1y
  
  Yep, H200
2. dev_meme 1y
  
  40k$ per card
@sidewayscoitus 1y

i once had a dream: https://github.com/Nvidia/linux-kernel-drivers
1. @ZgGPuo8dZef58K6hxxGVj3Z2 1y
  
  According to influencers its good. Is it actually?
  
  @sidewayscoitus 1y
  
  more yes than no, cus Nvidia might actually start working for anything else than compute