FBDD: Feature-Based Drift Detector for Batch Processing Data

The concept and data drift problems have received much attention in recent years. This aspect is crucial in many domains exhibiting non-stationary and cyclical patterns affecting their generative processes. Drift detection can be treated as a supervised task, with labeled data constantly used to validate the learned model. From a practical point of view, this is an impractical task because labeling is complex, costly, and time-consuming. On the other hand, unsupervised change detection techniques are cumbersome in applications because they generate many false alarms. The paper presents a new concept drift detection method based on feature analysis. Stream of data carries information about the distribution patterns that reflect different concepts that may be hidden in the data. The essential features are searched and ranked by LASSO. The rank of features and statistics are employed to feature drift detection. The proposed approach was experimentally checked based on synthetic and natural datasets. The results show that the proposed FBDD algorithm has an advantage over other solutions.