Integrated Analysis and Hypothesis Testing for Complex Spatio-Temporal Data

Analysis of unstructured, complex data is a challenging task that requires a combination of various data analysis techniques, including, among others, deep learning, statistical analysis, and interactive methods. A simple use of individual data analysis techniques addresses only a part of the overall data exploration and analysis challenge. The visual exploration process also requires exploration of what-if scenarios, a continuous and iterative process of generating and testing hypotheses. We describe a comprehensive approach to exploration of complex data that combines automatic and interactive data analysis and hypotheses testing techniques. The proposed approach is illustrated on a publicly available spatio-temporal data set, a collection of bird songs recorded over an extended period of time. Convolutional Neural Network is used to identify and classify bird species from the bird songs data. In addition, two new interactive views, integrated within a coordinated multiple views setup, are introduced: the what-if view and the spectrogram view. The proposed approach is used to develop a unified tool for exploration of bird songs data, called Bird Song Explorer.