How do I see which GPU is idle?
PeakNode marks every GPU with less than 5% utilization as idle and shows since when. The GPU nodes page counts the idle cards across all servers.
How does PeakNode calculate the idle cost of a GPU?
From the stored reports: every GPU below 5% utilization in a report counts as idle for the time back to the previous report, at most for one reporting interval plus 10%. The sum is the idle GPU hours. Multiplied by your cost per GPU hour, this gives the amount for 7 and 30 days.
Does PeakNode measure the power consumption of the whole server?
No. It measures the board power of the GPUs as reported by nvidia-smi, added up over time to kWh. CPU, power supply losses and cooling are not included.
Does a GPU with a loaded model count as idle?
Yes, if its utilization is below 5%. PeakNode evaluates utilization, not memory in use. An inference server without requests therefore shows as idle, even if the model is loaded.
What happens to periods in which the server did not report?
They do not count towards idle time: a report covers at most one reporting interval plus 10%, larger intervals are gaps. For energy, the portal bridges an interval up to the offline limit with the mean of the two power readings; longer pauses do not count there either. Without a single report in the period, it shows “-” instead of 0.
Are idle time and energy also in the monthly report?
Yes. The SLA and monthly report lists the GPU energy in kWh and the idle time in GPU hours for each server, and with a stored cost also the amount. The API provides both as well.
How much does a GPU hour cost?
That depends on your own numbers: for rented GPUs the provider’s hourly rate, for your own servers for example depreciation plus electricity, divided by the hours. You enter this rate per server monitor, and PeakNode uses it to calculate the cost of idle GPU hours. For the electricity share, the portal provides the measured GPU energy in kWh.
Is 100% GPU utilization bad?
No, high utilization is what you want for training and inference. It becomes suspicious when the card draws hardly any power at the same time: at 90% utilization or more with less than 30% of the power limit over three consecutive reports, PeakNode flags the GPU as a suspected hung process. If a card throttles because of heat, hardware health shows it.