I have solved most of the issues that I have described in the original post. Mostly I got rid of Split OPs and forced manual broadcast by applying tile and reshape. Surprisingly, I can even use models with multiple inputs. I am still using your advice with having only 1 input and slicing during...
If I make the input tensors equal size, the app runs with GPU delegate without errors. But it is not suitable for my model, I would always have some kind of broadcasting, tiling somewhere.
I further removed the split op, but this still gives the following error. So there is no broadcast support for GPU delegate?
I tried using tile, repeat, tf.broadcast_to to make the shapes of the tensors equal. But it didn't help. The TFlite model ignores the tile op. For the repeat op, it...
Phone Model: Samsung Galaxy S21
APP version: 5.0.3. I also tried the nightly version (24.12.2022).
TF version: 2.10, tried 2.12 and 2.5 as well
I can run the model on CPU without any errors. However, once I choose the TFLite GPU Delegate, I am getting this error:
The model consists of just...