Comparisons between Heuristics Based on Correlativity and Efficiency for Landmarker Generation

Recently, we proposed a new meta-learning approach based on landmarking. This approach, which utilises a new set of criteria for selecting landmarkers, generates a set of landmarkers that are each functions over the performance over subsets of the candidate algorithms being landmarked. In this paper, we experiment with three heuristics based on correlativity and efficiency. With each heuristic, the landmarkers generated using linear regression are able to estimate accuracy well, even when only utilising a small fraction of the given algorithms. The resultsalso show that the heuristic in which efficiencies are estimated via 1-nearest neighbour outperformed the other heuristics.