All questions related to Monocular Depth Estimation Challenge can be asked in this thread.
Traceback (most recent call last): File "./data/mobile_ai_2022_monocular_depth_estimation_challenge/scoring_programs/0/evaluation.py", line 116, in raise Exception('Target evaluation server is not available') Exception: Target evaluation server is not available
The evaluation fails on 2022.06.13 09:56 a.m.
Are you using an old TFLite binary with a newer model?
T leaderboard | T my |
0.156 | 0.080 |
0.121 | 0.050 |
1.566 | 1.062 |
Hi @Andrey Ignatov , when will the testing phase end while it starts on 30 Jun 2022?
You can find the information about the dataset and captured images in our previous challenge paper.Is there any information about the intrinsic parameters of the used RGB cameras?
when will the testing phase end while it starts on 30 Jun 2022?
The preliminary end date is the 30th of July. Note that the test phase consists in only submitting the final models, codes and reports - you won't be getting the results on the test dataset.testing phase starts on 22 Jul 2022.
The model is running on the Raspberry Pi 4 Model B Rev 1.2 multiple times, and the average runtime is then computed. TFLite 2.5.0 / 4 threads are used for inference. Maybe your Raspberry Pi is a bit overclocked, or you have an advanced cooling system allowing for more stable CPU clock rates. In any case, all solutions would be tested on the same device, thus only their relative performance would matter.Could you share some details how does the benchmarking procedure look like?
Will it be possible to submit solutions to the Development Phase, after Testing Phase starts on 22.07?