Real-Time Camera Scene Detection Challenge

sayak

New member
The submission instruction mail states the maximum number of entries have been increased to 10 but I still see it to be 3 -

1615953472128.png
 

Andrey Ignatov

Administrator
Staff member
The submission instruction mail states the maximum number of entries have been increased to 10 but I still see it to be 3

This was done for the development phase.

In the final test phase, you need to submit your final results only as specified in the email sent yesterday.
 

mobileai

New member
Hello! The online validation server is running the following error with a new submission:


WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmpscXoW5/run/program/evaluation.py", line 37, in
accuracy = 100.0 * n_correct_prediction/len(label_list)
NameError: name 'label_list' is not defined

Earlier, the same model was running fine and I had an accuracy of 91.5. The model is running fine on the lightspeed and local phone.
 

andrewBatutin

New member
Regarding
- fully-quantized INT8 model (with no FP32 / FP16 / INT16 ops);

Is it ok to use tensorflow Integer with float fallback option?

Or we need to make it strictly INT8 model with tf.lite.OpsSet.TFLITE_BUILTINS_INT8 ?

 

YxChen

New member
If the image is required to be input in INT8 format, can you tell me how to preprocess the image value from [0, 255] to range [-1.1] in the model
 

andrewBatutin

New member
Hi folks,

What version of iOS TensorFlowLite do you use for lightspeed service and for final evaluation?

Can you publish the code of iOS app you use to test the model?

I'm having an issue with submitting my model to lightspeed

Code:
Status: Error
         
Inference time (sec): Unknown

email - johnmeetup56@gmail.com
model - efficientnetb2_no_norm_quantized.tflite

And i had an issue with running my model on old iOS TensorFlowLite 2.0 lib version

Code:
TensorFlow Lite Error: Didn't find op for builtin opcode 'RESIZE_BILINEAR' version '3'

After i've updated to iOS TensorFlowLite 2.4 - issue was fixed on device, and my model runs OK

Can it be the same issue with lightspeed service?

Thnx
 

YxChen

New member
I would like to ask if the ZIP submitted during the test phase must contain sheets, Tflite models, checkpoint files and all codes?Or just two models. Tflite.
Can I see the results of every test I take?Are the three test opportunities to choose the best as the final result, or choose the latest as the final result?
What information is required for sheet files and what content is required for codes? I read the sheet. tex provided by the officia and feel very confused. I don't know what information to provide.
 

Andrey Ignatov

Administrator
Staff member
ZIP submitted during the test phase must contain sheets, Tflite models, checkpoint files and all codes

Yes.

Are the three test opportunities to choose the best as the final result, or choose the latest as the final result?

Only the latest one will be used.

What information is required for sheet files and what content is required for codes?

In the provided factsheet template, you can find all the information that you need to add there.

issue was fixed on device, and my model runs OK

We used TFLite-2.4 nightly, updating it to the latest nightly build has probably solved the above issue. However, EfficientNets are anyway incompatible with TFLite CoreML and NNAPI delegates as they contain some dynamically sized tensors that are not yet implemented.
 

andrewBatutin

New member
Question about fact check doc


Other details

Novelty degree of the solution and if it has been previously published.

• Planned submission of a solution description paper to Mobile AI 2021 workshop.
What does this mean?
Is this like yes/no question? Will we submit or not?

thnx
 

andrewBatutin

New member
Hi folks, it's me again😁

Can't get runtime for model from lightspeed

Website constantly sends same request with no response

Code:
curl 'http://lightspeed.difficu.lt:60002/status/null' \
  -H 'Accept: */*' \
  -H 'Referer: http://lightspeed.difficu.lt:60002/' \
  -H 'DNT: 1' \
  -H 'X-Requested-With: XMLHttpRequest' \
  -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 11_0_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.90 Safari/537.36' \
  --compressed

Is it up?
 
Top