Power Efficiency Measurements & Inference Precision

Emperor

New member
Hi @Andrey Ignatov ,

Two questions about the Power Efficiency section of the Burnout benchmark:
  • What inference precision (INT8, FP16) was used for calculating the metrics "NPU FPS / Watt" and "NPU, Avg. Watt"?
  • How was the power measured; which profiler was used for this?
Thanks, E.
 

Andrey Ignatov

Administrator
Staff member
What inference precision (INT8, FP16) was used for calculating the metrics "NPU FPS / Watt" and "NPU, Avg. Watt"?

In the standard benchmark mode, only INT8 inference is tested. However, one can also check the results of FP16 inference in the PRO mode.

How was the power measured; which profiler was used for this?

You can switch between different NPU inference profiles in the settings, sustained speed is used by default.
 
Top