Monitoring Night Skies with Deep Learning.

The surveillance of meteors is important due to the possibility of studying the Universe and identifying hazardous events. The EXOSS initiative monitors the Brazilian sky with cameras in order to identify meteors, leading to a great quantity of non-meteor captures that must be filtered. We approach the task of automatically distinguishing between meteor and non-meteor images with the use of pre-trained convolutional neural networks. Our main contributions are the revision of the methodology for evaluating models on this task, showing that the previous methodology leads to an overestimation of the expected performance for future data on our dataset; and the application of probability calibration in order to improve the selection of most confident predictions, showing that apart from obtaining probabilities that better reflect the confidence of the model, calibration can lead to concrete improvements on both accuracy and coverage. Our method achieves 98% accuracy predicting on 60% of the images, improving upon the performance of the uncalibrated model of 94% accuracy predicting on 70% of the images.