Power Efficiency Measurements & Inference Precision

[Emperor]

Hi @Andrey Ignatov ,

Two questions about the Power Efficiency section of the Burnout benchmark:

• What inference precision (INT8, FP16) was used for calculating the metrics "NPU FPS / Watt" and "NPU, Avg. Watt"?
• How was the power measured; which profiler was used for this?

Thanks, E.

 

[Emperor]

Hey Everyone, @Andrey Ignatov , a boost on the previous message. I hope someone can help. Thanks

 

[Andrey Ignatov]

What inference precision (INT8, FP16) was used for calculating the metrics "NPU FPS / Watt" and "NPU, Avg. Watt"?

In the standard benchmark mode, only INT8 inference is tested. However, one can also check the results of FP16 inference in the PRO mode.

How was the power measured; which profiler was used for this?

You can switch between different NPU inference profiles in the settings, sustained speed is used by default.