Any questions related to general MAI Workshop and Challenges organization can be asked in this thread.
Any questions related to general MAI Workshop and Challenges organization can be asked in this thread.
No, the deadline is on the 28th of March as was stated on the Codalab webpage.The official page of the competition states that the submission deadline is March 21st. Has the competition ended now?
As was stated in the latest instructions, you can send us up to three models this week for runtime validation on the target device.As the submission deadline for the model file and factsheet is approaching, we have yet to receive updates regarding the inference speed and performance on the NPU.
Good point, we will fix this. In principle, both instructions tell you to send us the TFLite model, visual results (if test set provided in the challenge) and the factsheet. But we will clarify this.We understand that the sRGB challenge has Final Submission Instructions for Get Data in Participate as well as for Evaluation in Learn the Details, which one of these instructions should be referred to for submissions during the Test phase?
Thank you for your prompt reply, I also noticed a problem. I was about to submit information for the sRGB challenge and the system platform detected the need that I need to have 3145 png images. However, as far as I know, the sRGB track does not provide input images for testing in the current testing phase. I'm not sure if this is a bug in the sRGB challenge system platform, my attachment is two system platform logs.We've just sent the final submission instructions for all challenges.
No, the deadline is on the 28th of March as was stated on the Codalab webpage.
As was stated in the latest instructions, you can send us up to three models this week for runtime validation on the target device.
The deadline for the current competitions cannot be extended due to hard restrictions from CVPR main organizers. However, all current challenges would transition to ICCV challenges with a new deadline set in summer.
Good point, we will fix this. In principle, both instructions tell you to send us the TFLite model, visual results (if test set provided in the challenge) and the factsheet. But we will clarify this.
These are separate things:As I understand it, people who want to submit a TFLite model and submit a paper because they need to show a report paper in order to organize a CVPR workshop, are they submitting a paper?
Yes, there will be CVPR challenge winners and ICCV challenge winners. We therefore encourage you to submit your current solution now, and then continue with its improvement till the next deadline as you can potentially win both competitions / get two publications.Or is there a challenge winner in CVPR and a challenge winner in ICCV?
Yes, that's right, you can ignore this error. What we need is just a zip archive uploaded to Codalab with the requested TFLite model and a factsheet.However, as far as I know, the sRGB track does not provide input images for testing in the current testing phase. I'm not sure if this is a bug in the sRGB challenge system platform, my attachment is two system platform logs.
which of the two submission guidelines should I follow?
Good point, we will fix this. In principle, both instructions tell you to send us the TFLite model, visual results (if test set provided in the challenge) and the factsheet. But we will clarify this.
Yes, I've wondered that too. Since the first submission was Failed, I kept making corrections and submitting, and have submitted 4 times now. But I guess it might be possible that only the last submission is chosen as a valid submission, hopefully.Before your notification, we had already exhausted the number of submissions on Codalab. Can we increase the number of submissions by 3 times or delete our previous submissions?
We extended the number of submissions to 10 in the test phase in all challenges. Note, however, that only your last submission counts.Before your notification, we had already exhausted the number of submissions on Codalab. Can we increase the number of submissions by 3 times or delete our previous submissions?
Training code is also needed as we check some submissions for reproducibility.Only the TFLite model, visual results (if a test set is provided in the challenge), and situation sheet are needed. Do I need to submit training code?
Excuse me, can we use inference scripts to run the model for inference? For example, in PyTorch, our input is in NCHW format. Can we also use NCHW format to input the model for testing? If NHWC input format is mandatory, can we use inference scripts to convert it into NCHW as model input?
Yes, it is based solely on NPU runtime, CPU runtime is provided only for the reference.I would like to know whether the evaluation of the runtime component in the final score calculation for the Real-Time Image Super-Resolution Challenge is based solely on the NPU runtime, or if it incorporates a combined assessment of both CPU and NPU runtimes.
Using logarithm operator is not a very good option itself as it's a purely logical op, i.e., no acceleration by NPU/GPU if supported at all by the platform.log operator
the submission limit on the Codalab is 300MB
may we submit a zip file that contains both the items specified in the figure and the rendered results on the test set?
First of all, this is not about 0.002dB accuracy difference - this is about some ops that are completely screwed up by the ai-edge-torch converter, so that you get total corruptions instead of real output.there will inevitably be a slight accuracy loss during the conversion process (approximately 0.002dB)
Alright, I understand.First of all, this is not about 0.002dB accuracy difference - this is about some ops that are completely screwed up by the ai-edge-torch converter, so that you get total corruptions instead of real output.
Secondly, this primarily refers to the challenges, where we have an unconstrained track but still require the participants to submit TFLite models. Some teams, e.g., were developing transformer models, and in this case neither TF re-implementation nor manual PyTorch-to-TF conversion is really possible.
have you solved these problems?i've met the sameExcuse me, the Real Image Denoising dataset URL is 404NotFound.
You don't need to upload the results on the test images in this challenge.Dear organizers,i can't download test datasets,the page shows 404 not found
That's another issue, we've mentioned during yesterday's Q&A session that for the denoising challenge the data would be provided later when this challenge transitions to ICCV.have you solved these problems?i've met the same
Dear organizers, how can i get the test datasets in SISR? The download link is not open.
You don't need to upload the results on the test images in this challenge.
100x100When calculating PSNR for sRGB image enhancement, is it calculated at a resolution of 100x100 or at the original image resolution?
For the majority of challenges, the results would be sent this week.Dear organizers, when will final results be released ?
You need to follow the final submission instructions. All conditionally accepted papers would be checked before sending them to the publisher to see whether all issues are fixed. If this was not done, the paper would be rejected.Our paper has been conditionally accepted. How do we submit the revised paper?
No, you need to select the "Author" registration option even if you have only one workshop paper. That's not really fair, but this was always the rule at the CVPR.Is the ‘ONE DAY WORKSHOP/TUTORIAL PASS’ sufficient to cover the registration requirement for publishing a paper in the MAI Workshop?
The results were sent today by email.Dear organizers, when will the competition results be released , and how they will be sent ?
Yes, this will be done soon.can the status of the papers submitted on cmt3 be turned over as soon as possible so that we can register for the CVPR conference before April 30?