Recent content by Mako443

  1. M

    How to reproduce Float16 models on HTP

    Happy to help! And yes of course, let's connect. I'll send a DM. Cheers, Manuel
  2. M

    How to reproduce Float16 models on HTP

    Answering my own question for anyone else trying to optimize their models on Qualcomm based on some of our findings in the meantime: Generally, we have found the Qualcomm tools and documentation to be somewhat confusing or inconsistent at times, so be prepared for that. To go from Float32 to...
  3. M

    How to reproduce Float16 models on HTP

    Dear AI Benchmark team, The app was super helpful in benchmarking our NN on Android with the Float16 inference on HTP showing the best performance. Our question however is, how are you guys running Float16 models on the HTP chip? The "old" Qualcomm SNPE SDK does not offer the HTP runtime at...
Top