Mobile AI Workshop General Organization Questions

[Andrey Ignatov]

Any questions related to general MAI Workshop and Challenges organization can be asked in this thread.

 

[Finn]

hello， When will the evaluation method be released ?

 

[Andrey Ignatov]

When will the evaluation method be released ?

The scoring system will be released next week, it will have the same form for all challenges (except for the Learned ISP track):

Score (submission) = F_fidelity (submission, baseline) / Runtime (submission)

 

[Choi SangBum]

F_fidelity (submission, baseline) what does this variable suppose to mean?

 

[Andrey Ignatov]

F_fidelity (submission, baseline) what does this variable suppose to mean?

F_fidelity is a function from two parameters: submission and baseline. We already provided its definition for all challenges, please find it under the Performance Evaluation tab.