Custom vendor NN libraries not available?

teskspek

New member
Hello, I encountered two issues while trying with this benchmark. I have 2 phones:
-Phone 1: Xiaomi Redmi K30 Pro Zoom with Snapdragon 865
+Android version 11
-Phone 2: Asus ROG Phone 5s with Snapdragon 888
+Android version 11
With AI Benchmark version 4.0.4 stable and nightly 10.08, Hexagon NN libs option will not be available on the Asus phone but available on the Xiaomi phone.
With AI Benchmark v5 preview, all the Qualcomm NN libs are not available to use on both phones. In addition the v5 version is running super slow/crashes on the Asus phone, when it run its ~20x slower versus 4.0.4 stable and nightly when using default NNAPI options or force-enable any Qualcomm vendor libs. Switch to Tensorflow lite GPU only (both FP and INT8 models) will return the performance to normal (altho not good as expected).
I assume the app looking for specific files to enable those options? I hope those issue would be corrected fast. Thank you for the amazing tool.
 
Last edited:

Andrey Ignatov

Administrator
Staff member
In addition the v5 version is running super slow/crashes on the Asus phone

A quick answer:

1) AI Benchmark V4 was based on Android Neural Networks API (NNAPI) specs and formats defined at the end of 2019. Those were quite limited but supported by almost all platforms released since that time.

2) AI Benchmark V5 is using the updated ops and models corresponding to NNAPI 1.3+ / TF 2.5+. They allow to run a considerably larger amount of neural networks, but not everything is now supported by all vendors. The current issues should be fixed in the next few months.

More detailed answers:

Hexagon NN libs option will not be available on the Asus phone but available on the Xiaomi phone.

The Hexagon NN delegate do not and will not support the SDM888 chipset from the Asus phone. In the current AIBV5 build, it is also not enabled on any Qualcomm device due to a known initialization issue that should be fixed in the next few weeks.

default NNAPI options

The Asus ROG 5s phone should get the updated NNAPI drivers supporting all AI Benchmark V5 models at the beginning of the next year through the Google Play Services update.

force-enable any Qualcomm vendor libs

Additionally, the SDM888 platform would also be supported by the Qualcomm QNN delegate. Its test and working version supporting the majority of models would be released together with the upcoming AIBv5 Preview update next week, though the results of this platform would still be improved later on.
 
Top